As advanced medical technology approaches consumer markets, the demand for protective usage regulations is increasing. What might start as a neural implant to aid communication could ultimately become a tool for surveilling one’s innermost thoughts. Rachel Sava, a PhD candidate in the Harvard-MIT Program in Health Sciences and Technology, explores the far-reaching benefits and risks of neural implants in her winning submission, "Superintelligence, Superintimate," for the fourth annual Envisioning the Future of Computing Prize.
Sava's concept was inspired by an internship at IBM, where she collaborated on a project with the PACE Center in London. She was influenced by her mentor Kevin Brown, who designed one of the earliest brain decoders—an EEG-based system for a colleague who suffered a stroke and was left with locked-in syndrome. Sava notes that research and applications are at a "watershed moment in neurotechnology."
She cites examples of companies potentially exploiting neural implants to monitor mental productivity or authorities policing populations for "thought crimes." As this technology hits consumer markets, there is genuine concern that what begins as a revolutionary medical device could morph into more dystopian uses.
The competition, presented by the Social and Ethical Responsibilities of Computing (SERC), invited MIT students to identify which sector stands to gain the highest net positive impact from artificial intelligence in fewer than 3,000 words. Students were encouraged to explore realistic technological deployments while considering potential risks and ethical concerns. All submissions were eligible for cash awards, with the grand prize set at $10,000.
During a live awards ceremony hosted by former SERC associate dean and philosophy professor Caspar Hare, three finalists each presented their concepts for 20 minutes and took questions from judges and audience members. “SERC and the donors who make this prize possible year after year are asking us, the next generation of scientists: ‘what world do you want to see?’” Sava stated.
Each year, the Envisioning the Future of Computing Prize asks students to look beyond technological advancement and consider the societal benefits and costs of their work from the outset. Since its inception, the competition has consistently attracted undergraduate and graduate students from a wide range of disciplines. “This year’s submissions were amazing and included essays on brain-computer interfaces, AI and religion, AI for scientific discovery, and finding efficiencies in the power grid,” said Brian Hedden, co-associate dean of SERC and a professor of philosophy. “They showcased the breadth and depth of thinking at MIT regarding the social and ethical impacts of technologies.”
Nikos Trichakis, co-associate dean of SERC, added, “What is most striking about these essays is the breadth of imagination they display: the students fluidly traverse medicine, neurotechnology, law, ethics, and public institutions, while keeping human agency at the center. Their work is creative, rigorous, and deeply thoughtful, demonstrating a remarkable ability to envision not only what AI can do, but what it should do.”
In addition to awarding Sava the $10,000 grand prize, the judges recognized two runners-up with $5,000 each: Cordiana Cozier, a PhD candidate in the Department of Chemistry, for her paper on the use of AI as a cognitive buffer for public defenders; and Strahinja Janjusevic, a graduate student in the Technology and Policy Program in the Institute for Data, Systems, and Society, for his submission on agency and ownership in the field of neural-controlled prosthetics. The judges also named four honorable mentions, each of whom received a $500 cash prize.
Blogger's Review: This article delves into the ethical and societal impacts of neurotechnology, reminding us to not overlook the potential risks of surveillance and misuse as technological advancements occur. Ensuring the protection of human agency becomes imperative as technology rapidly evolves. Only by finding a balance between technology and ethics can we truly realize its positive potential.