AI headphones let wearer listen to a single person in a crowd, by looking at them just once

Engineers have developed an artificial intelligence system that lets someone wearing headphones look at a person speaking for three to five seconds to ‘enroll’ them. The system then plays just the enrolled speaker’s voice in real time, even as the pair move around in noisy environments.

Accelerate Mixtral 8x7B pre-training with expert parallelism on Amazon SageMaker

Mixture of Experts (MoE) architectures for large language models (LLMs) have recently gained popularity due to their ability to increase model capacity and computational efficiency compared to fully dense models. By utilizing sparse expert subnetworks that process different subsets of tokens, MoE models can effectively increase the number of parameters while requiring less computation per…

ContextQ: Generated Questions to Support Meaningful Parent-Child Dialogue While Co-Reading

Much of early literacy education happens at home with caretakers reading books to young children. Prior research demonstrates how having dialogue with children during co-reading can develop critical reading readiness skills, but most adult readers are unsure if and how to lead effective conversations. We present ContextQ, a tablet-based reading application to unobtrusively present auto-generated…

A community collaboration for progress

While decades of discriminatory policies and practices continue to fuel the affordable housing crisis in the United States, less than three miles from the MIT campus exists a beacon of innovation and community empowerment. “We are very proud to continue MIT’s long-standing partnership with Camfield Estates,” says Catherine D’Ignazio, associate professor of urban science and…

Generating fashion product descriptions by fine-tuning a vision-language model with SageMaker and Amazon Bedrock

In the world of online retail, creating high-quality product descriptions for millions of products is a crucial, but time-consuming task. Using machine learning (ML) and natural language processing (NLP) to automate product description generation has the potential to save manual effort and transform the way ecommerce platforms operate. One of the main advantages of high-quality…

2024 MAD Design Fellows announced

Since its launch in 2022, the MIT Morningside Academy for Design (MAD) has supported MIT graduate students with a fellowship, allowing recipients to pursue design research and projects while creating community. Pulling from different corners of design, they explore solutions in fields such as sustainability, health, architecture, urban planning, engineering, and social justice.  On May…