Program Participant - NYAS

A writer conducts an interview with an AI researcher.

Various ethical considerations must be applied to the development of artificial intelligence technologies like voice biometrics to ensure disenfranchised populations are not negatively impacted.

Published August 29, 2024

By Nitin Verma, PhD

Nitin Verma, PhD, (left) conducts an interview with Juana Caralina Becerra Sandoval at The New York Academy of Sciences’ office in lower Manhattan.
Photo by Nick Fetty/The New York Academy of Sciences.

Juana Catalina Becerra Sandoval, a PhD candidate in the Department of the History of Science at Harvard University and a research scientist in the Responsible and Inclusive Technologies initiative at IBM Research, presented as part of The New York Academy of Sciences’ (the Academy) Artificial Intelligence (AI) & Society Seminar series. The lecture – titled “What’s in a Voice? Biometric Fetishization and Speaker Recognition Technologies” – explored the ethical implications associated with the development and use of AI-based tools such as voice biometrics. After the presentation, Juana sat down with Nitin Verma, PhD, a member of the Academy’s 2023 cohort of the AI & Society Fellowship, to further discuss the promises and challenges society faces as AI continues to evolve.

*Some quotes have been edited for length and clarity*

Tell me about some of the big takeaways from your research so far on voice biometrics that you covered in your lecture?

I think some of the main takeaways from the history of the automation of speaker recognition are, first, really trying to understand what are the different motivations or incentives for investing in a particular technology and a particular technological future. In the case of voice biometrics, a lot of the interesmyt is coming from different sectors like the financial sector, or the security and surveillance sector. It’s important to keep those interests in mind and observe how they inform the way in which voice biometrics get developed or not.

The other thing that’s important is that even though we have a notion of technological progress, some of the underlying ideas and assumptions are very old. This includes ideas about the body, about what the human body is, and how humans have the ability to change, or not, their body and the way they speak. In the case of voice biometrics, these ideas date back to 19th-century eugenic science, and they continue informing research, even as we have new technologies. We need to not just look at this technology as new, but ask what are the ideas that remain, or that sustain over time, and in which context did those ideas originate.

So, in your opinion, what role does, or would, AI play in your historical accounting of voiceprint technology?

I think, in some way, this is the story of AI. So, it’s not a separate story. AI doesn’t come together in the abstract. It always comes along in relation to a particular application. A lot of the different algorithmic techniques we have today were developed in relation to voice biometrics. Really what AI entails is a shift in the logic of the ontology of voice where you can have information surface from the data or emerge from statistical methods, without needing to have a theory of what the voice is and how it relates to the body or identity and illness. This is the kind of shift and transformation that artificial intelligence ushers.

What would you think is the biggest concern regarding the use of AI in monitoring technologies such as voice biometrics?

Well, I think concerns are several. I definitely think that there’s already inscripted within the history of voice biometrics an interest in over-policing, and over-surveilling of Black and Latinx communities. There’s always that inherent risk that technology will be deployed to over-police certain communities and voice biometrics then enter into a larger infrastructure where people are already being policed and surveilled through video with computer vision or through other means.

In the security sector, I think my main concern is that there’s a presumption that the relationship between voice and identity is fixed and immutable, which can create problems for people who want to change their voice and or for people whose voice changes in ways outside of their control, like from an injury or illness. There are numerous reasons why people might be left out of these systems, which is why we want to make sure we are creating infrastructures that are equitable.

Speaking to the other side of this same question, in your view, what would be some of the beneficial or ethical uses of this technology going forward?

Rather than starting from the point of ‘what do corporations or institutions need to make their job easier or more profitable?’, we should instead focus on ‘what are the kinds of tools and techniques that people want for themselves and for their lives?’, and ‘in what ways can we leverage the current state of the art towards those ends?’. I think it’s much more about the approach and the incentive.

There’s nothing inherent to technology that makes it cause irreparable harm or be inherently unethical. It’s more about: what is the particular ontology of voice?; what’s the conception of voice that goes into the system?; and towards whose ends is it being leveraged? I’m hopeful and optimistic about anything that is driven by people and people’s desires for a better life and a better future.

Your work brings together various threads of research or inquiry, such as criminology, the history of technology, inequality, and the history of biometric technology as such. What are some of the challenges and benefits that you’ve encountered on account of this multidisciplinary approach to studying the topic?

I was trained as a historian, and originally my idea was to be a professor, but once I started working at IBM Research and the Responsible and Inclusive Tech team, I think I got much closer to the people who very materially and very concretely wanted to make technology better, or, more specifically, to improve the infrastructures and the cultures in which technology is built.

That really pushed me to take a multidisciplinary approach and to think about things not just from a historical lens, but be very rooted in the technical, as well as present day politics and economic structures. I think of my own immigrant background. I’m from Colombia and I naturally already had this desire to engage with humanities and social science scholarship that was critical of these aspects of society, but this may not be the same for everyone. I think the biggest challenge is effectively engaging different audiences.

In the lecture you described listening as a political process. Can you elaborate on that?

I’m really drawing on scholars in sound studies and voice studies. The Sonic Color Line, Race as Sound, and Black Linguistics, are three of the main theoretical foundations that I am in conversation with. The point they try to make is that when we attend to listening, rather than voice itself as a sort of thing that stands on its own, we can see and almost contextualize how different voices are understood, described, interpreted, classified, and so on.

The political in listening is what makes people have reactions to certain voices or interpret them in particular ways. Accents are a great example. Perceptions of who has an accent and what an accent sounds like are highly contextual. The politics of listening really emphasizes that contextuality and how we’ve come to associate things like being eloquent through particular ways of speaking or with how particular voices sound, and not others.

Is there anything else you’d like to add?

Well, I think something that strikes me about the story of voice biometrics and voiceprints is how little the public knows about what’s happening. A lot of decisions about these technologies are made in contexts that are not publicly shared. So, there’s a different degree of awareness in the kind of different public discourses around the ethics of AI and voice. It’s very different from facial recognition, computer vision, or even toxic language.

Also read: The Ethics of Surveillance Technology

Assisting Dementia Patients with AI and AR

A photo of a man checking his smartwatch, with AI graphics over-imposed.

Winners of the Junior Academy Innovation Challenge Spring 2024: “Wearables”

Published August 14, 2024

By Nicole Pope

Sponsored by The New York Academy of Sciences

Team members: Riya K. (India) (Team Lead), Shreeniket B. (United States), Sysha R. (India), Prakul P. (India), Tisha S. (India), Medha T. (United States)

Dementia is a neurodegenerative condition that affects 55 million people worldwide and 1 in 10 people older than 65 in the United States, according to the World Health Organization. Alzheimer’s disease is the best-known form of this debilitating condition, which leads to memory loss and confusion. It gradually erodes individuals’ ability to perform simple functions or even recognize familiar faces.

The impact of dementia is not limited to the individuals affected by the condition. Caregivers, who are often family members, bear the burden of providing support, often at great personal cost.

Harnessing the power of wearable technology, the members of this enterprising team composed of high-schoolers from the U.S. and India, devised the VisionXcelerate glasses – an innovative device designed to provide personalized assistance to dementia patients and help them perform every-day tasks independently, thus lightening the burden of carers. Some of the sensors are contained in an eyeglass chain that also ensures users do not lose the device. The students reached out to patients, hospitals and nursing homes to identify specific needs.

“After contacting 90 dementia patients in total, I gained new research and critical thinking abilities. I was able to identify their needs by observing them and analyzing their responses,” explains Sysha, who also learned about coding while working on the image/facial recognition for the glasses. “I have gained more empathy for others by trying to find a solution for people suffering from Alzheimer’s.”

“Wonder Glasses”

The VisionXcelerate smart glasses and their numerous features, including collecting user health data, are the result of an intense group effort, with each team member contributing different skills and strengths. “Being the Team Lead for this project, I’ve witnessed firsthand how collaboration, hard work, new ideas, and obstacles have shaped our journey,” explains Team Lead Riya. “Each member of our team has contributed significantly, from ideation to prototyping. It’s been inspiring to see everyone’s passion and commitment to the project.”

The students used both Artificial Intelligence (AI) and Augmented Reality (AR) to develop the various functions of their “wonder glasses”, which provide real-time assistance, and help dementia patients overcome some of the challenges posed by memory loss and help wearers identify objects and faces. “I was mainly involved in the research and design aspects of the project, particularly surrounding the technologies we wanted to implement in our design and their practicality/viability,” explains Shreeniket, whose approach was partly shaped by observing elderly family members.

For example, the device includes a virtual personal assistant that prompts users to take medication at specific times and to eat or drink at regular intervals, in a voice that mimics the patients’ loved ones. This helps to foster trust and build emotional connection.

VirtualXcelerate also features an app that allows caregivers to monitor the patients and their activities from afar. “The experience of working with teammates sitting in different corners of the world has helped me gain new insights and think about solutions from a completely new perspective,” explains Tisha.

A Rewarding Journey

Working across time zones was not always smooth sailing. “There were a few hiccups. But at the end of the day, everything came together beautifully,” says Prakul. “Despite the obstacles, the journey was rewarding. It pushed me out of my comfort zone, taught me valuable skills in teamwork, problem-solving, and project management, and allowed me to contribute to a meaningful cause.”

This experience gave team members a new understanding of dementia and how it affects patients and those around them. “I learned about the difficulty dementia patients face on a daily basis, and how our solution was impactful to them,” says Medha. “During this process, I helped contribute to researching certain features on the glasses, such as the reminders. Additionally, I sketched out each feature on the glasses, in a variety of angles to demonstrate the importance of location. Overall, this experience was an outstanding opportunity for me.”

As dementia sufferers are prone to falling, the glasses have detection systems to alert caregivers in case of a mishap while GPS tracking and geofencing allows them to locate patients who have wandered beyond a safe area and are too confused to find their way home. These security features not only contribute to dementia patients’ well-being, but also provide carers and relatives peace of mind.

With user feedback, the team plans to continue to refine their solution and add more elements that will further enhance the quality of life of people living with dementia, help them retain their independence longer, and ease the pressure on caregivers.

Read about the other winner from the Spring 2024 Junior Academy Innovation Challenge:

Developing Circular Textile Practices Through Recyclable Fabrics and Reducing Color Dye Pollution

Students Make Sustainable Fashion Statement

Sustainable textiles hanged up on a tree outside.

Winners of the Junior Academy Innovation Challenge Spring 2024: “Circular Textiles”

Published August 14, 2024

By Nicole Pope

Sponsored by Royal Swedish Academy of Engineering Sciences (IVA)

Team members: Rachita J. (India) (Team Lead), Mariia H. (Ukraine), Sofía R. (Colombia), Alex B. (United States), Sylvia X. (United States), Altynay N. (Kazakhstan)

Textiles and fashion are important sectors for the world economy but as demand increases, so do the environmental and human costs – due to harmful production processes that degrade natural resources and the mountains of textile items that are discarded every year.

Estimates suggest that 87% of global textile waste ends up in landfills or incinerators. These environmental impacts apply not only to the clothes we wear in our daily life, but also to the textiles used in the medicine, agriculture, and manufacturing sectors.

For the Junior Academy Innovation Challenge “Circular Textiles”, this international team of students came up with new suggestions to improve environmental standards in textiles, each member sharing their own insights to the design of their solution. “Throughout the project, everyone contributed their unique ideas and leveraged their specialized skills to advance our goals,” explains Sylvia. “The synergy within the team was palpable, fostering an environment of creativity and productivity.”

Collaborating online through the Academy’s Launchpad platform, the students divided the tasks across the group to develop their comprehensive plan. “I did some research and produced tables that consisted of the information about the project,” says Mariia. “I also contacted some experts and I was working on Lean Canvas.” The team found that technical textiles – engineered and manufactured with specific functions in mind – was a rapidly growing sector that reached US$213 billion in 2023, a 5.6% increase in the previous year.

Replacing Non-Sustainable Synthetics

The group focused on finding a sustainable replacement for fossil fuel-based synthetic yarns, nature-based materials like Rayon (viscose) that are linked to deforestation, as well as fibers like cotton that require water-intensive cultivation. They landed on Biofabrics as a potential solution. The students proposed addressing the three main drawbacks of Biofabric clothing – the expensive cost, the susceptibility to microbes, and the poor resistance to repeated washing – to create a more affordable, longer lasting product.

Their solution was using agricultural waste to optimize the production of a synthetic cellulose fiber called Lyocell and relying on deep eutectic solvents (DES) as an alternative to the more expensive chemicals traditionally used in cellulose extraction to reduce the cost. Another ground-breaking innovation involves the application of silver nanostructures to the Lyocell fibers, which would confer both greater durability and antibacterial properties to the fabric, and last more than 20 washes.

To tackle the pollution caused by fabric coloration, the team members suggested employing Direct Laser Interference Patterning (DLIP), a cutting-edge technique that uses laser beams to create nano-texture surfaces with precise interference patterns to impart vibrant colors without the need of toxic dyes.

Throughout the competition, the team’s schedule was intense. Finding time to meet across time zones was not always easy. “There were some challenges during the entire duration of the project, the biggest being the time difference,” says Team Lead Rachita. “I however tried to manage this by dividing the team further into teams and distributing tasks after getting approved by the entire team.” Team member Alex, for his part, created a spreadsheet to keep track of availability. “This helped us schedule meetings with as many people able to attend as possible,” he says.

Striving for Sustainable Textile Production

The students realized that, in addition to using technology to make textile production less damaging to the ecosystem, promoting circularity and sustainability in the sector also required raising awareness of environmental impacts among consumers, particularly in low and middle-income groups, which account for an estimated 90 percent of the global population.

They developed “EcoFashion,” an app designed to educate users of all ages and engage with them, which includes age-specific games aimed at toddlers and teenagers, challenges to motivate adults, as well as mini courses and interactive modules that deliver a wealth of information and leverage psychology to change consumer behavior.

For nine weeks, the team members worked long hours to develop their innovative approach and outline their findings in a polished presentation. “With the abundance of information and the high quality of research done by each team member, condensing it into a concise presentation was daunting,” says Sofia. “To overcome this hurdle, we collectively decided to put in extra hours, working diligently to summarize our findings effectively while ensuring the essence of our work remained intact.”

Their success, and the skills they acquired along the way while developing friendships across borders, made it all worth it. “The experience was great as it was the first time I did such a thing,” says Altynay. “I think such experience will help me in the future in researching other things, and in communicating with different people.”

Read about the other winner from the Spring 2024 Junior Academy Innovation Challenge:

Using Artificial Intelligence and Augmented Reality to Assist Dementia Patients

Improving Classroom Accessibility with AI

A photo of a city skyline with an over-imposed graphic denoting different AI applications.

Winners of the Junior Academy Innovation Challenge Fall 2023: “Cognitive Classrooms”

Published August 14, 2024

By Nicole Pope

Advancing Education Through Digital Technology

The team developed an AI-led application designed to diversify the education experience, give students access to new visualized learning styles, and enable teachers to monitor individual students’ performance and provide support when needed.

The tool analyzes the students’ learner profile and enables teachers to provide them with a personalized teaching plan that considers their strengths and weaknesses. By providing visual learning features, such as 3D models and live simulations using VR/AR, the app enhances the learning experience and supports students with learning difficulties. The teacher can more easily track individual students’ progress, track their response, and identify when individuals need additional attention.

The team drew on individual members’ skills to build their app. “I’ve enjoyed working with the team, capitalizing on our respective strengths for the best possible outcome,” explains Anoushka. “This journey helped me truly appreciate the power of collaboration and teamwork!” Their end product—an elegant app that uses OpenAI API, Python and Eleven Labs API to improve the classroom experience for both students and teachers—won praise from the judges.

Their already impressive achievement is made even more outstanding by the difficulties they overcame to reach their solution. For six intense weeks, the team worked across time zones and at odd hours of the night to create their prototype app. “Even though we all had various commitments, whatever time I had spare, it would be dedicated to this even if it was midnight at my time!” explains Jefferson.

Sharpening Practical Skills

“Working countless hours at awkward times in the morning, just to meet up with your friends from halfway across the globe and work on something that truly motivates you is a feeling I cannot describe,” says Team Lead Dawik. “This project has taught me how to lead better, how to work with my peers and manage my time as well as the importance of meeting deadlines and staying committed to your work.”

Through the challenge, the team members were able to sharpen skills that will be essential in future endeavors, like teamwork and critical thinking. “My journey with this team has proven to be incredibly enriching. The team’s diverse skills and backgrounds, coupled with our unwavering unity, created an environment of continuous learning and personal growth,” believes Abhay. “We tackled challenges head-on, demonstrating resilience and innovative problem-solving.”

The Cognitive Classroom challenge was a wonderful learning opportunity for the members of the team and it left them hungry for more creative discoveries. “From late-night discussions to constructing prototypes and presentations, this environment taught me many things and opened new paths I never dreamed could exist,” explains Asmit.

His teammate Atharv concurs: “The diversity, unwavering support, and commitment to excellence of team members have pushed me to grow professionally and personally. I’m grateful to be part of this remarkable team, and I eagerly look forward to our next adventures.”

Read about other winners from the Fall 2023 Junior Academy Innovation Challenge:

Alternatives To Mineral Space Mining

A shot of Lithium from the periodic table of elements.

Winners of the Junior Academy Innovation Challenge – Fall 2023 “Minerals of Technology”

Published August 14, 2024

By Nicole Pope

Sponsored by Royal Swedish Academy of Engineering Sciences (IVA)

Team members: Sriyash T. (Team Lead) (India), Radoslav K. (United States), Aarish K. (United States), Rehan S. (India), Aashritha T. (United States), Farhan M. (United States)

For the “Minerals of Technology” Junior Academy Innovation Challenge, high school students were asked to come up with an innovative approach to secure the supply of the critical minerals needed to support the transition to a fossil fuel-free society.

Critical minerals are used in the manufacture of cell phones, photovoltaic solar plants, electric vehicles and numerous other modern appliances. As a growing number of countries move away from fossil fuels to combat climate change and limit the global temperature rise to 1.5°, ensuring a sufficient supply of these critical minerals has become a global concern. The supply will need to increase six-fold by 2040 to support the shift to a more climate-friendly, fossil fuel-free world. Crucially, these rare minerals are not renewable, and must therefore be used efficiently and sustainably.

For their winning project, the MINnovator’s team members from the United States and India sought a solution to this issue in space. They proposed developing a fleet of autonomous asteroid mining drones, powered by hydrogen and solar energy. The drones would extract and process the resources they collected in space. The students’ plan would reduce the carbon emissions associated with conventional mining methods and mitigate the risk of mineral shortages on Earth.

Intrigued, Yet Skeptical

“Initially intrigued, yet skeptical about the idea of harvesting resources from asteroids for a cleaner alternative, I’ve witnessed the evolution of this concept into a tangible project,” says Aarish. “Our space droid, fueled by solar and hydrogen energy and employing 3D printing technology, promises to revolutionize resource acquisition. The droid’s ability to gather rare metals, silicon, oxygen, and water presents a promising solution to the scarcity of these vital resources on Earth.”

According to their ambitious solution, the drones would include a retractable drill to harvest materials through precision scraping or strip mining of resource-dense veins, as well as 3D printers and robotic assemblers to process them in situ. Only finished products would need to be transported back to Earth, in bulk shipments, to maximize cost efficiency and minimize environmental impact. Thanks to a modular design, the drones could be adapted and configured for optimal use during specific aspects of the mining cycle.

“One of my primary roles within the group was the creation of 3D models that visualized the intricate details of our proposed asteroid mining operations,” explains Farhan. “This involved a steep learning curve, but the opportunity to immerse myself in the technical aspects of space mining was both exciting and rewarding. The models not only enhanced our presentations but also provided a tangible visual aid that helped the team grasp the complexity of the project.”

Opening New Horizons

The topic of this Junior Academy challenge opened up new horizons for the team members. “Working with this team on the mineral conservation project through asteroid mining was an illuminating journey,” explains Aasritha. “Working with a diverse team has been a profound and enriching experience, one that has stretched my perspectives and broadened my understanding of collaboration in many ways I never anticipated.”

“It was both inspiring and incredibly satisfying to think that our study would open the door for asteroid mining to provide sustainable mineral conservation,” says Rehan. “The problem we faced was extremely complex and offered many difficulties, one of which was coordinating communication across time zones.”

Tackling a global issue that could shape the future of their generation, gave the participants a great sense of achievement. “This initiative underscores the potential of youth to wield significant influence, irrespective of age or background,” says Team Lead Sriyash. “I want to express profound gratitude to my exceptional teammates. The formation of MINnovators was driven by the intent to unite diverse individuals who share a common fervor for leveraging science to transform the world.”

His teammate Radoslav, echoes Sriyash’s sentiment: “Even when this challenge is over, I trust every one of us to go out into the world and continue to make the world a better place, one project at a time.”

Read about other winners from the Fall 2023 Junior Academy Innovation Challenge:

The Environmental Benefits of Vertical Farming

A shot of people picking up litter at an outdoor park.

Winners of the Junior Academy Innovation Challenge – Fall 2023 “Green Homes, Green Schools, Green Communities”

Published August 14, 2024

By Nicole Pope

Sponsored by The New York Academy of Sciences

Team members: Iga P. (Team Lead) (Poland), Eliska B. (Slovakia), Alfiya K. (Kazakhstan), Ivanna V. (Ukraine), Linda M. (Slovakia), Nouha O. (Tunisia)

Mentor: Adeola Akinsulure (Nigeria)

In Fall 2023, The New York Academy of Sciences invited high school students from around the world to select an environmental issue they encounter at school, at home, or within their community, and devise a creative solution to address it, as part of a Junior Academy Innovation Challenge.

Working in virtual teams through the platform Launchpad, over 800 students responded to the invitation and offered novel approaches to specific environmental issues they had identified.

The six members of the winning team, Destination: Green, honed their focus on urban farming, which can increase the resilience of city dwelling communities to the impacts of climate change and reduce excessive pressure on fragile land resources.

“The existing food system faces vulnerabilities,” says Nouha. “It is susceptible to weather and economic changes, leading to a rise in the number of people experiencing food shortages. Conventional farming practices cause environmental harm, polluting the natural resources and damaging ecosystems.”

Increasing Resilience Through Vertical Farming

Vertical farming enables individuals living in urban environments to cultivate nutritious fresh food, in spite of limited access to land. Having decided to focus on this practice as a way to improve the sustainability of food supplies, the team first conducted a survey to assess overall knowledge of this cultivation method and identify the obstacles that currently limit the growth of urban food production.

The results revealed poor awareness of farming opportunities in urban settings and highlighted the need for educational efforts: while 64% of respondents weren’t familiar with the concept of vertical farming, 95% of people surveyed expressed an interest and 92% said they would start a farm if they had the necessary information.

The team members used these results to craft their solution. To address the knowledge gap, the team designed an app that guides users through the launch and development of a vertical farm, providing educational resources to make urban farming more accessible.

“Each of us had different strengths; some of us were better with finding ideas for [our] project, some with completing specific tasks,” explains Linda. “My main contribution to the project was probably [the] creation of all the designs of an app in Canva. Apart from that, I wrote some of the milestone texts, participated in meetings, discussed what the app should look like, and found information about some specific topics.”

The app will feature easy-to-follow vertical farming techniques, with tutorials and tips to support aspiring urban farmers. Other features include an AI chatbot that provides assistance and recommendations, a progress tracker, a shopping page for supplies, and a discussion forum to promote community engagement.

Overcoming Unique Challenges

Eliška admits she initially had doubts about working as part of a team. But her misgivings evaporated rapidly when she started collaborating virtually with her fellow team members.

“Right after the first online meeting, we immediately decided when we would meet and planned our work,” she says. “Overall, I liked working with my team. We organized it very well and I never felt like I had to do everything by myself.”

To devise a comprehensive solution and complete their project on time, the team participants had to overcome some unique challenges. Alfiya joined her teammates online from Kazakhstan, across multiple time zones.

“Usually when we met, it was pretty late for me, around 10 or 11 pm, but I wanted to put my efforts into this project,” she says, expressing her pride at having contributed to the solution. “During this challenge, I took different tasks like creating a Google form to ask people about vertical farming, gathering information about microgreens, and much more.”

Destination: Green team members are delighted that their collective efforts have been recognized. The challenge provided an enriching learning experience for the participants, who developed new skills in the course of the project. As Team Lead, Iga guided discussions and shared relevant research, as well as contributing botanical expertise.

“Learning to lead and efficiently delegate tasks were pivotal skills I acquired, enhancing my ability to communicate and motivate the team effectively,” she says. “I realized that collective success is built on trust and collaboration.”

Read about other winners from the Fall 2023 Junior Academy Innovation Challenge:

A More Scientific Approach to Artificial Intelligence and Machine Learning

A researcher poses next to a vertical banner with the text "The New York Academy of Sciences."

Taking a more scientific perspective, while remaining ethical, can improve public trust of these emerging technologies.

Published August 13, 2024

By Nitin Verma, PhD

Savannah Thais, PhD, is an Associate Research Scientist in the Data Science Institute at Columbia University with a focus on machine learning. Dr. Thais is interested in complex system modeling and in understanding what types of information is measurable or modelable and what impacts designing and performing measurements have on systems and societies.

*This interview took place at The New York Academy of Sciences on January 18, 2024. This transcript was generated using Otter.ai and was proofread for corrections. Some quotes have been edited for length and clarity*

Tell me about the big takeaways from your talk?

The biggest highlight is that we should be treating machine learning and AI development more scientifically. I think that will help us build more robust, more trustworthy systems, and it will help us better understand the way that these systems impact society. It will contribute to safety, to building public trust, and all the things that we care about with ethical AI.

In what ways can the adoption of scientific methodology make models of complex systems more robust and trustworthy?

I think having a more principled design and evaluation process, such as the scientific method approach to model building, helps us realize more quickly when things are going wrong, and at what step of the process we’re going wrong. It helps us understand more about how the data, our data processing, and our data collection contributes to model outcomes. It helps us understand better how our model design choices contribute to eventual performance, and it also gives us a framework for thinking about model error and a model’s harm on society.

We can then look at those distributions and back-propagate those insights to inform model development and task formulation, and thereby understand where something might have gone wrong, and how we can correct it. So, the scientific approach really just gives us the principles, and a step-by-step understanding of the systems that we’re building. Rather than, what I see a lot of times, a hodgepodge approach where the only goal is model accuracy, in which something goes wrong, we don’t necessarily know why or where.

You have a very interesting background, and your work touches on various academic disciplines, including machine learning, particle physics, social science, and law. How does this multidisciplinary background inform your research on AI?

I think being trained as a physicist really impacts how I think about measurements and system design. We have a very specific idea of truth in physics. And that isn’t necessarily translatable to scenarios where we don’t have the same kind of data or the same kind of measurability. But I think there’s still a lot that can be taken from that, that has really informed how I think about my research in machine learning and its social applications.

This includes things like experimental design, data validation, uncertainty, propagation in models. Really thinking about how we understand the truth of our model, and how accurate it is compared to society. So that kind of idea of precision and truth that’s fundamental physics, has affected the research that I do. But my other interests and other backgrounds are influential as well. I’ve always been interested in policy in particular. Even in grad school, when I was doing a physics PhD, I did a lot of extracurricular work in advocacy in student government at Yale. That impacted a lot how I think about understanding how systems affect society, resource access, and more. It really all mixes together.

And then the other thing that I’ll say here is, I don’t think one person can be an expert in this many things. So, I don’t want it to seem like I’m an expert at law and physics and all this stuff. I really lean a lot on interdisciplinary collaborations, which is particularly encouraged at Columbia. For example, I’ve worked with people at Columbia’s School of International and Public Affairs as well as with people from the law school, from public health, and from the School of Social Work. My background allows me to leverage these interdisciplinary connections and build these truly collaborative teams.

Is there anything else you’d like to add to this conversation?

I would reemphasize that science can help us answer a lot of questions about the accuracy and impact of machine learning models of societal phenomena. But I want to make sure to emphasize at the same time that science is only ever going to get us so far. And I think there’s a lot that we can take from it in terms of experimental design, documentation, principles, model construction, observational science, uncertainty, quantification, and more. But I think it’s equally important that as scientific researchers, which includes machine learning researchers, we really make an effort to both engage with other academic disciplines, but also to engage with our communities.

I think it’s super important to talk to people in your communities about how they think about the role of technology in society, what they actually want technology to do, how they think about these things, and how they understand them. That’s the only way we’re going to build a more responsible, democratic, and participatory technological future. Where technology is actually serving the needs of people and is not just seen as either a scientific exercise or as something that a certain group of people build and then subject the rest of society to, whether it’s what they actually wanted or not.

So I really encourage everyone to do a lot of community engagement, because I think that’s part of being a good citizen in general. And I also encourage everyone to recognize that domain knowledge matters a lot in answering a lot of these thorny questions, and that we can make ourselves better scientists by recognizing that we need to work with other people as well.

Also read: From New Delhi to New York

Cancer Metabolism and Signaling in the Tumor Microenvironment

A man presents during a research symposium.

From metabolic reprogramming in cancer cells to creating nucleotide imbalances. These experts are advancing the field of medical research and cancer treatment.

Published August 6, 2024

By Megan Prescott, PhD

What causes a normal cell to become a cancer cell? How do cancer cells cooperate to form a tumor? How can we interrupt these processes to inhibit cancer growth? Can nutrients directly modulate disease progression and therapeutic response?

These and related questions were the focus of a conference held on April 17, 2024. The conference was presented by The New York Academy of Sciences and NYU Langone Health. The program held at the NYU Medical Center, included presentations by world renowned researchers in the field of cancer metabolism. The goal was to understand how these findings can be translated into therapies that will impact the lives of patients.

Metabolic pathways represent a powerful, yet underappreciated set of therapeutic targets for cancer. They play a crucial role in tumorigenesis, the transformation of normal cells into cancerous ones. Oncogenic mutations may alter these metabolic pathways, enabling cells to extract energy from their surroundings. Additionally, they manipulate signaling pathways to drive tumor development and advancement.

Mitochondrial Adaptations and Signaling in Tumors

Navdeep Chandel, PhD.
Photo by Nick Fetty/The New York Academy of Sciences

Opening speaker, Navdeep Chandel, PhD, David W. Cugell, MD Professor at Northwestern University, described how metabolic reprogramming in cancer cells is directly triggered by oncogenes. Some of the metabolic genes important for oncogenesis include those found in the electron transport chain (ETC) of mitochondria.

Since mitochondria are a biosynthetic and bioenergetic hub inside of cells, many types of cancer cells, which proliferate quickly and have high energy demands, rely heavily on mitochondria for their survival. Electron transport chain function is responsible for providing metabolites linked to the tricarboxylic acid cycle (TCA). This provides the building blocks for cell proliferation. Dr. Chandel has shown that the widely used anti-diabetic drug metformin has anti-tumor effects through inhibition of Mitochondrial Complex I of the ETC within cancer cells.

Immune-dependent attenuation of tumor growth was seen in work from Pere Puigserver, PhD. Dr. Puigserver is a professor of cell biology at Harvard Medical School and the Dana-Farber Cancer Institute. Mitochondrial Complex I inhibition in tumors triggered by deletion of the subunit Ndufs4, increases the activation status of CD8+ T Cells and Natural Killer cells within the tumor environment. This finding has potential implications in the field of immunotherapy.

Oxygen, Iron, and Vitamins in the Tumor Microenvironment

Electron Transfer Reactions in the mitochondria are facilitated by iron-sulfur containing proteins. Isha Jain, PhD, assistant professor in biochemistry and biophysics in the School of Medicine at the University of California, San Francisco, showed how these proteins are damaged in high oxygen (hyperoxic) conditions. While researchers have studied the detrimental effects of low oxygen on the body for a long time, Dr. Jain’s work focuses on discovering why too much oxygen is toxic in some cases.

“We found that certain proteins that contain iron, basically rust in high oxygen, and that’s why things go wrong,” she explained. Her work opens the question of whether treatments that can be developed to protect or repair these proteins.

Richard Possemato, PhD
Photo by Nick Fetty/The New York Academy of Sciences

Research from Richard Possemato, PhD, associate professor in pathology at the NYU Grossman School of Medicine, showed that iron-sulfur clusters are important for tumor growth in breast cancer. DNA Polymerase Epsilon (POLE) contains an iron-sulfur cluster, and inhibition of POLE by disrupting its iron-sulfur cluster eradicates tumors in a mouse model of triple negative breast cancer. Furthermore, tumor eradication by this method induces adaptive immunity, and researchers were unable to grow tumors in these mice again.

Recent work has emphasized that the stressful conditions of the tumor microenvironment. Parts of the tumor periodically experience limited availability of primary nutrients and oxygen. This also affects the metabolism of cancer cells. Cell proliferation, the hallmark of cancer, is metabolically demanding. It requires energy and cellular ‘building blocks’ in the form of amino acids for proteins, fatty acids for lipids, and nucleotides for DNA and RNA.

How Cells Rewire Their Metabolism

Gerta Hoxhaj, PhD, assistant professor in the Children’s Medical Center Research Institute at the University of Texas Southwestern Medical Center, described how cells rewire their metabolism to fuel the growth and survival of cancer cells. Cells need a constant supply of nucleotides to grow, proliferate, and function.

Cells can either get their supply of purine nucleotides from simple molecules like amino acids by de novo synthesis or can recover purines from the breakdown of DNA and RNA through the salvage pathway. While de novo synthesis and salvage pathways contribute similarly to purine pools in tumors, the salvage pathway is critical for tumor growth in mouse models of liver cancer, among others.

Research from Celeste Simon, PhD, the Arthur H. Rubenstein, MBBCh Professor at the University of Pennsylvania, demonstrates that metabolic crosstalk is also important in Pancreatic Ductal Adenocarcinoma (PDAC), the second leading cause of cancer related death in 2023. Fibroblasts help PDAC cells survive by supplying these tumor cells with unsaturated fatty acids for the maintenance of lipid homeostasis in low oxygen (hypoxic) and nutrient-poor environments. Finding drugs to disrupt this cross-talk could be a novel metabolic target in PDAC treatment.

Cancer Cell Intrinsic and Extrinsic Determinants of Tumor Metabolism

The tumor microenvironment of PDAC has abundant fibroblasts of different lineages and functions according to Mara Sherman, PhD, head of the Mara Sherman lab at Memorial Sloan Kettering Cancer Center. “We identified one lineage that promotes pancreatic cancer metastasis and seems to do so along nerves,” she said.

Lydia Finley, PhD, Geoffrey Beene Junior Faculty Chair, Memorial Sloan Kettering Cancer Center; Dafna Bar-Sagi, PhD, Executive Vice President and Vice Dean for Science, Chief Scientific Officer, NYU Langone Health; Melanie Brickman Borchard, PhD, Director of Life Sciences Conferences for the Academy; Alec Kimmelman, MD, PhD, Director, Laura and Isaac Perlmutter Cancer Center, NYU Langone Health; Megan Prescott, PhD, Program Manager of Life Sciences for the Academy; Costas Lyssiotis, PhD, Maisel Research Professor of Oncology, University of Michigan; and Steven Gross, PhD, Professor of Pharmacology, Weill Cornell Medical College.

Social interactions between cancer cells, such as competition and cooperation, is an interest of Carlos Carmona-Fontaine, PhD, associate professor of biology at NYU. “The key currency for this cell-cell interaction is nutrients and other metabolites including oxygen,” he noted. Specifically, his presentation asked how amino acids become cooperative goods in low oxygen environments.

Amino acid starved cells cooperate to digest extracellular peptides: Both low, and high density, populations die without glutamine, but high-density populations recover when it is added back. The essential enzyme in this process is CNDP2. Inhibition of this form of cooperation impaired tumor growth.

The Impact of Blocking Adenosine Uptake in T-cells

Matthew Vander Heiden, PhD, Lester Wolfe Professor of Molecular Biology at MIT and director of the Koch Institute for Integrative Cancer Research, found that the nucleotide precursor adenosine suppresses anti-cancer immune responses. He presented work that showed blocking adenosine uptake in T-cells rescues proliferation and partially rescues cytokine production in these cells through salvaging pyrimidine nucleotides. Environmental conditions promoting nucleotide imbalance in T cells can regulate immune response, showing that if you can create nucleotide imbalances, then you can change cell fate.

This conference provided insight into metabolic changes, genes and pathways that support tumor growth and proliferation, and how this knowledge can inform new treatments that disrupt the strategies cancer cells depend on to survive.

Supporting Scientists in the South Bronx

Nayem Haque not only wants to inspire tomorrow’s scientists, but also to motivate the next generation of mentors who train these aspiring science professionals.

Published July 17, 2024

By Nicole Pope

A mentor for The New York Academy of Sciences is motivated to inspire tomorrow’s scientists as a result of his own positive classroom experience nearly a decade and a half ago.

“Walking through the doors of my old school as an adult, I was overwhelmed with gratitude. The sight of bustling classrooms, dedicated teachers, and supportive community members highlighted just how much had changed since I attended the school 14 years ago,” says Nayem Haque, a PhD student in biomedical science at Albert Einstein College of Medicine, who has returned to his elementary school in the South Bronx to provide after-school mentoring in science.

Nayem is one of more than 1,500 mentors that the Academy has placed in over 800 area classrooms since 2010 as part of its highly regarded Afterschool STEM Mentoring Program (ASMP).

Creating “a self-sustaining loop”

The young scientist hopes his engagement will inspire the children he teaches to embrace science and, eventually, follow in his footsteps and help others around them.

“Maybe they will come back to their old school like I did, and create a self-sustaining loop,” he says.

The mentors – most of them students and early career scientists – are placed in after school classrooms at schools to increase STEM instruction for students. When Nayem was in elementary school, his exposure to science was minimal.

He only discovered his passion as an undergraduate student studying biological sciences when he had an opportunity to work with one of his professors, in a research lab. From then on, Nayem’s path was set: the young man opted to pursue a career in biomedical sciences.

“I like research. I like the independence of having your own project but also being part of a team,” he says. “I’ve been able to travel to attend conferences and present my research.”

After obtaining a BSc in biological sciences from the University at Buffalo, Nayem is now studying for a doctorate. When he heard about the ASMP program, he jumped at the opportunity.

“I’m giving back to the community I grew up in. When I was in school, a lot of the other students were smarter than me, but growing up in the South Bronx, it’s very easy to get mixed up with the wrong people – easy for people to end up in less-than-ideal situations,” he says. “I feel that if students had the opportunities and the exposure, they could end up in higher education and it could have a big impact on their lives.”

Effective Engagement Begins at an Early Age

Getting children interested in science at an early age is important because it allows them to pursue opportunities to join special science programs or camps at the elementary or middle school level, Nayem believes. He finds second and third graders particularly inquisitive: they display a genuine interest by asking a lot of questions in class, Nayem has observed. By fifth grade, students can get more distracted, but he deploys proven techniques to keep them engaged.

“We work with a site mentor – an after-school specialist, who helps us prepare the lessons and keep the class focused,” says Nayem.

These specialists work with the students both during and outside of ASMP programming and assist mentors with strategies to manage the dynamics of an informal classroom environment.

In addition, two scientist mentors are often paired up to teach, which makes it easier to work with individual children and ensure that all students are engaged with the lessons.

“If kids don’t get the concepts we teach and we move on, they lose interest and won’t learn,” Nayem says.

The mentors are given a 10-week curriculum and the resources necessary to conduct high quality, hands-on experiments in the classroom.

“This semester, students are learning about the properties of light,” explains Nayem, who enjoys co-mentoring with a friend he recruited for the ASMP program. “We teach them about lasers, microscopes, and optical illusions. Depending on their age group, some kids prefer a lectured approach; but younger ones prefer a hands-on approach and experiments.”

An Important Resource

After-school science classes can have a transformative effect on young school children.

“The ASMP program is a step in the right direction. It’s a program that can foster a lot of interest in STEM in places where there aren’t many resources,” Nayem says. “It is really critical for students to have this head start.”

But mentors, too, benefit from the program. Aside from the satisfaction of serving the community, Nayem says that mentoring school children of different ages and having to adapt his teaching approach and vocabulary has helped him develop his communication skills.

“It has helped me with professional presentations, when I present my research to the school and faculty,” Nayem says, adding that he is considering a teaching career. “I try to break down my presentation as much as possible, so I usually get good feedback.”

Now in the second year of his PhD program, the young man plans to remain an ASMP mentor until he completes his doctorate. To other young scientists who, like him, want to help the next generation discover STEM, he strongly advocates joining the ASMP.

“It’s a really fulfilling opportunity. It is especially rewarding to see the switch that happens several weeks into the program in students who may not have been very engaged at the beginning,” he says. “You see you’re making a tangible change.”

Big Time Research from the Junior Academy

A woman in her office presenting as part of a virtual event.

Rising young stars in science are celebrated for their innovative ideas in artificial intelligence and sustainability applications.

Published July 11, 2024

By Kaitlin Green

The New York Academy of Sciences’ Junior Academy celebrated the hard work and dedication of students from the 2023-24 academic year on June 27th, 2024, during the annual Virtual Student Symposia.

More than 80 students, mentors, coaches, sponsors and partners, in 29 countries, were invited to celebrate a successful year of innovation. Meghan Groome, PhD, Senior Vice President of Education at the Academy, opened the proceedings with an inspiring address.

Meghan Groome, PhD, Senior Vice President of Education at The New York Academy of Sciences, presents during the live streamed Virtual Student Symposia on June 27, 2024.
Photo by Nick Fetty/The New York Academy of Sciences.

“The Junior Academy was formed to provide a pathway for students and scientist mentors to begin a journey together – to do research together. As you give your first scientific talks today at The Academy, know that we’re so proud of your game changing research.” she said, reflecting on its history.

The strong bond between working scientists and students provides insights into the real-world scientific workplace to ensure a future pipeline of qualified STEM professionals.

“Science is about working together – working across differences, and we know that diversity drives innovation,” Dr. Groome concluded.

The Junior Academy proudly embodies that scientific diversity and creativity, which is evidenced by the creative solutions proposed by this year’s winners. The projects were judged on their overall presentation quality, scientific quality, innovation and design thinking, sustainability, potential, and collaboration.

The Winning Ideas

In order to hone their presentation skills, winning teams work with a communication coach to shape their presentations into five-minute informational speeches. As a result, the students delivered succinct team research project summaries.

Team: AI4Access: Redefining Accessible Classrooms

In the Cognitive Classrooms Challenge students were asked to consider potential applications of artificial intelligence (AI) and virtual reality/augmented reality (VR/AR) towards creating a more inclusive, equitable, and efficient classroom environment. The six person AI4Access team from Qatar, India and the United States developed a tool that not only enriched the students’ education towards achieving an individualized learning experience, but also improved the workload and efficiency of the educator in maintaining a harmonious and well-managed environment where everyone can thrive. Mentor: Aryan C.

Team: Destination: Green

In the Green Homes, Green Schools, Green Communities Challenge, students were given the opportunity to think critically about environmental challenges that impact their lives and what they could do to improve those challenges. As a result, the six person Green team from Poland, Slovakia, Kazakhstan, Ukraine, and Tunisia designed a solution to enhance access and education to sustainable farming practices. Their solution can be applied both to large-scale and at-home farming practices, making it an excellent solution to improve environmental problems at all levels of a community. Mentor: Adeola A.

Team: MINnovators

Students were tasked with designing an innovative approach to secure the supply of critical minerals in the transition to a fossil-free society in the Minerals of Technology Challenge. The six person MINnovators team from India and the United States researched the feasibility of using asteroid mining to reduce carbon emissions. Their solution has the potential to support a more environmentally sustainable ecosystem when compared to conventional mining practices. Mentor: Ilayda G.

Team: VisionXcelerate

In the spring Wearables Challenge, students were required to design or employ a wearable technology, or network of wearables, that can be utilized to address either public health issues surrounding non-communicable diseases or natural or manmade disaster response. The six person VisionXcelerate team from the United States and India focused on helping individuals with dementia by developing a pair of smart glasses integrated with AI and AR technologies to assist with daily tasks such as medication reminders and person recognition, along with fall detection systems and GPS tracking to assist caretakers.

The VisionXcelerate team during their presentation.

Team: EcoFashion

Students in the Circular Textiles challenge were tasked with choosing one aspect of the “take-make-waste” textile supply chain, and to design an innovative adaptation to fit the circular textile model. The six person EcoFashion team from India, Colombia, Ukraine, Kazakhstan, and the United States developed an innovative approach to the Circular Textile model by developing a synthetic cellulose fiber using agricultural waste, sustainable color dye methods, and an app to educate users on sustainable fashion practices. Mentor: Xanthhi C.

Each team presentation was followed up by an audience Q&A.

The Immeasurable Impact of Mentors

What sets the Junior Academy apart from similar STEM education programs are the international professionals, graduate students, PhD candidates, and postdocs who understand the importance of mentorship and offer their time and expertise to the program. This year’s event included two distinguished mentors: Tomaz Maria Suller and Katherine Wert, PhD.

Tomaz joined the Junior Academy as a secondary student in 2018, participating in many challenges on the online platform Launchpad. He earned his bachelor’s in computer engineering at Poli-USP in Brazil and is currently pursuing a master’s in computer science and engineering at Politecnico di Milano in Italy. He became a Junior Academy mentor in the winter of 2023, advising five teams in four challenges. One of his teams, ZynoFiber, was recognized as a finalist in the Spring 2024 Circular Textiles challenge.

“Why are we here today?” Tomaz asked, reflecting on his time as both a Junior Academy student and now as a mentor. “We want to create a community of engineers, scientists, and innovators who will shape our future – and shape our present.”

Dr. Katherine Wert discovered the impactful mentoring opportunities at the Academy in 2012 during her time as a PhD student at Columbia University. She joined the Junior Academy in 2016 as one of the first cohorts of mentors onto Launchpad and has since mentored over 25 teams.

“I love that this program works hard to include anyone who has a true motivation toward STEM and does not simply focus on their global location or what resources they’ve had available to them,” Dr. Wert said.

Dr. Wert ended her address by advising both students and mentors to take advantage of the Junior Academy community, emphasizing the importance of communication and networking.

“You never know when someone’s crazy idea will mesh with others. The most successful teams I’ve worked with let everyone’s voices be heard – even the most out-of-the-box ideas. You are part of a very special and unique community of passionate STEM professionals and peers,” she said.

Looking Forward

As the 2023-24 academic year ends, Dr. Groome and the Education Team expressed their pride in this incredible community of innovators. They recognize that support for these programs is made possible because of the Academy’s generous partners and sponsors. These supporters’ belief in our mission of “science for the public good” ensures the Junior Academy opportunity is free for all students.

“To our mentors, your support, volunteerism, and deep understanding of the importance of STEM role models in our global community is unmatched. Thank you,” said Dr. Groome. “The Junior Academy students never cease to amaze us with their creativity, innovation, and willingness to connect with peers from around the world. Together, we create a truly special and welcoming environment. Cheers to a fantastic year.”

Older posts

Newer posts