Person using gaze-directed hearing aid in a noisy environment.

Unlock Your Hearing Potential: How Gaze-Directed Tech Can Change Lives

"Discover the cutting-edge mobile tech that's revolutionizing hearing aids by using eye-tracking to focus on what you want to hear."


In today's noisy world, deciphering sounds can be a real challenge, especially in bustling environments. This is often referred to as the 'cocktail party problem' – the struggle to concentrate on a single voice amidst background noise. While those with healthy hearing can usually navigate these situations well, individuals with hearing loss often find it difficult to filter out distractions and focus on the sounds they want to hear.

Traditional hearing aids can amplify sounds, but they don't always solve the core issue of understanding speech in noisy environments. They often amplify background noise along with the desired sounds, leading to confusion and frustration for the user. This is where a new approach called gaze-directed beamforming comes into play, offering a smarter way to focus on specific sounds.

Gaze-directed beamforming uses eye-tracking technology to determine where a person is looking and then focuses the hearing aid's microphones on that direction. This allows the user to essentially 'listen' with their eyes, isolating the sounds they want to hear and reducing surrounding noise. Think of it like having a spotlight for your ears, illuminating the sounds that matter most.

AI Search Multiple angles on this topic

The Cocktail Party Problem

Contemporary hearing aids remain markedly limited in their most important role: improving speech perception in dynamic "cocktail party" environments with multiple, competing talkers, according to research into a novel gaze-directed beamforming neuro-technology. Even when devices are fitted, keeping them effective over time matters; online hearing tests and audiogram printouts let users confirm their hearing aids keep working properly. Differential testing encourages calling the audiologist when the audiogram shows significant changes, though it requires running the test at least once to acquire a reference. Local support also factors into impact, with providers such as Direct Hearing offering hearing-aid repair across two locations in Illinois.

From Buy-Direct to OTC Earbuds

Hearing aids remain far less prevalent than the corrective devices that inspired the market, with Fast Company reporting they are used by only one in four of those who need them. Online marketplaces such as Audicus aim to make hearing aids more widely available and desirable by selling directly to consumers, modeled on how glasses are purchased. Newer options push further: Olive Max positions its OTC hearing-aid earbud and tinnitus app as redefining the limits of hearing aids by pairing comprehensive hardware with software such as a smart sound algorithm and Bluetooth technology. The shared limitation is adoption and convenience, whether the route to purchase is a buy-direct marketplace or a direct-to-consumer earbud.

From Early Electrical Devices to Online Screening

The roots of electrical hearing aids reach back to the beginning of the 1900s, when some of the world's first manufacturers of electrical hearing aids began production, a lineage companies such as A&M still trace today. From those early electrical devices, hearing technology has advanced through generations of amplification and signal processing. A more recent milestone is the arrival of accessible screening tools, such as Phonak's free, three-minute online hearing test, which can provide some quick and useful feedback about a user's hearing. Self-service testing of this kind marks a departure from the clinic-bound history of hearing evaluation.

Cochlearity: A New Approach to Assistive Hearing

Person using gaze-directed hearing aid in a noisy environment.

Researchers have developed a mobile platform called 'Cochlearity' that utilizes gaze-directed beamforming to enhance speech perception. This open-source platform runs on Android devices and uses an array of microphones, which can be worn comfortably on the head, for example, on eyeglasses. The system then uses eye-tracking to steer an acoustic beamformer, ensuring the listener hears best wherever they look.

Cochlearity uses a combination of passive (delay-and-sum) and adaptive (MVDR) beamforming algorithms to separate the 'attended' voice from the 'unattended' voice in a two-talker scenario. Delay-and-sum beamforming is a simpler method that uses the geometry of the microphone array and the speed of sound to combine signals. Adaptive beamforming, on the other hand, uses statistical learning to analyze noise sources in the environment and improve performance.

The Cochlearity platform offers several key advantages:
  • Mobile and Accessible: Runs on widely available Android devices.
  • Open-Source: Encourages broader adoption and further improvements.
  • Combined Approach: Uses both passive and adaptive beamforming.
  • Real-Time: Aims to provide low latency processing for a natural listening experience.
AI Search Multiple angles on this topic

Following the Eyes: Gaze-Directed Beamforming

Recent research has demonstrated the potential practical benefit of gaze-directed beamforming for hearing aids, using a head-mounted system in experiments that involved behavioral engagement in an ongoing listening task. The results illustrate how detailed speech-intelligibility data can be retrieved from such realistic experiments. Related work on partner-directed gaze found that old and young talkers use gaze differently in a communicative task (DiapixUK) in which a lead talker and a follower engage in spontaneous dialogue, evidence that gaze patterns are central to everyday conversation. Stigma remains a stubborn barrier regardless of technology: one reporter describes refusing a hearing aid in her twenties because she did not want to look old, a decision she later learned harmed her.

The Case for Testing First

A key counterargument to device-first enthusiasm is that no hearing technology substitutes for a proper test. Signia notes that getting your hearing tested can identify problems with your hearing before they start to affect your life, and that hearing loss can lead to a number of social, emotional, and mental repercussions if left untreated. The implication for advanced devices such as gaze-directed beamformers is that screening and diagnosis should precede adoption of even the smartest hardware. In this view, the failure mode is less likely to be the engineering and more likely to be users skipping the test that would reveal how much they need.

Comparing Options Side by Side

Consumers weighing hearing options can compare devices on dedicated platforms such as Versus, which offers side-by-side comparisons with detailed specifications, filters, and clear data visualizations across over 100 categories. The traditional route remains visible online too, with popular demonstration videos walking viewers through hearing-aid fittings and newer devices like the Oticon Sage for NHS users. At the premium end, manufacturers such as Phonak position their latest models as AI-powered hearing aids with speech clarity, Bluetooth connectivity, and long battery life, engineered to support every level of hearing loss. The contrast highlights a widening market, from spec-driven comparison shopping to guided fittings to flagship feature sets.

The system's effectiveness was tested by playing two different stories simultaneously from different locations. By tracking the direction of the user's gaze, Cochlearity was able to isolate the story the user was focusing on, effectively reducing the noise from the other story. This demonstrates the potential of gaze-directed beamforming to significantly improve speech perception in complex auditory environments.

The Future of Hearing is in Sight

The development of Cochlearity represents a significant step forward in assistive hearing technology. By combining eye-tracking with advanced beamforming algorithms, this platform offers a promising solution for individuals who struggle to hear in noisy environments. As the technology continues to evolve, we can expect even more sophisticated and user-friendly gaze-directed hearing aids that will empower people to connect with the world around them.

AI Search Multiple angles on this topic

Expert Care Around the Technology

Synthesizing the field, expert commentary converges on the importance of professional care around whatever device a user chooses. Audiology practices such as Hearing Solutions in the Triangle, PLLC provide expert hearing-aid cleaning and servicing as part of their comprehensive care approach, underscoring that ownership extends well beyond the initial purchase. The same provider directory context reflects a market increasingly organized around top OTC hearing aids and hearing aids for severe hearing loss. In synthesis, gaze-directed innovation is one promising piece of the puzzle, but sustained professional support is what keeps devices working for real users.

The Ear as the Next Wearable Platform

The future of hearing devices may extend far beyond sound correction, with hearables described as the future of wearables: smarter devices people always wear that track well-being and understand their users, while still serving a medical purpose for those who require them. The vision is shared across the industry; reports of Apple's plans, for example, suggested future AirPods could monitor body temperature and posture and work as a hearing aid, though such products were not expected to launch in the near term and might never be released. The underlying need is projected to grow sharply, with nearly 2.5 billion people expected to experience hearing loss by 2050 and over 700 million needing rehabilitation. If cultural perceptions shift as projected, hearing aids may become as common as reading glasses.

The Hardest Environments Remain the Goal

Even though many hearing aids already include noise-reduction algorithms and directional microphones (beamformers) designed to emphasize sounds coming from the front, crowded spaces remain a systemic challenge, which is why researchers benchmark new algorithms against the industry-standard algorithm currently inside hearing aids. Following conversation in noisy, dynamic settings is precisely the problem gaze-directed approaches target. Meanwhile, alternative transmission routes broaden the field: bone-anchored hearing systems transmit sound through the skull bone, bypassing the external and middle ear entirely, offering a distinct solution for certain users. Together these efforts frame the broader systemic goal of making speech intelligible in real-world conditions, not just in quiet rooms.

Dinner-Table Proof

The real-world test that matters most to users is often the dinner table. In a busy restaurant filled with music, dishes clinking, and overlapping conversations, Dr. Allen Craig put the Edge Mode+ feature in Starkey Genesis AI hearing aids to the test, calling the environment the perfect challenge for advanced AI noise management. Such in-the-field demonstrations highlight that the practical value of hearing technology is judged in everyday, demanding settings. It is in these human moments that gaze-directed and AI-driven innovations must prove themselves if they are to change lives.

About this Article -

Written with AI assistance from published research, and reviewed by the Mystum team. See our About page for more information.

This article is based on research published under:

DOI-LINK: 10.1109/embc.2018.8513566, Alternate LINK

Title: Towards Mobile Gaze-Directed Beamforming: A Novel Neuro-Technology For Hearing Loss

Journal: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

Publisher: IEEE

Authors: Markham H. Anderson, Britt W. Yazel, Matthew P. F. Stickle, Fernando D. Espinosa Inguez, Nathaniel-Georg S. Gutierrez, Malcolm Slaney, Sanjay S. Joshi, Lee M. Miller

Published: 2018-07-01

Everything You Need To Know

1

How does gaze-directed beamforming technology work to improve hearing in noisy environments?

Gaze-directed beamforming utilizes eye-tracking technology to pinpoint the direction a person is looking. This information is then used to focus the hearing aid's microphones in that specific direction. This allows the user to concentrate on the sounds they want to hear, effectively reducing surrounding noise and improving speech perception. It's like having a spotlight for your ears, illuminating the sounds that are most important to you.

2

What is meant by the 'cocktail party problem,' and how does it relate to the challenges faced by individuals with hearing loss?

The 'cocktail party problem' refers to the difficulty people often experience when trying to focus on a single voice in a noisy environment with multiple conversations happening simultaneously. Individuals with healthy hearing can usually navigate these situations, but those with hearing loss find it challenging to filter out distractions and concentrate on the sounds they intend to hear. Traditional hearing aids, which amplify all sounds, often exacerbate this problem by amplifying background noise as well.

3

What is Cochlearity, and how does it utilize gaze-directed beamforming to improve speech perception?

Cochlearity is a mobile platform designed to enhance speech perception using gaze-directed beamforming. It runs on Android devices and utilizes an array of microphones, often worn on eyeglasses, to capture sound. The system uses eye-tracking to steer an acoustic beamformer, ensuring the listener hears best wherever they look. Cochlearity combines passive (delay-and-sum) and adaptive (MVDR) beamforming algorithms to separate the 'attended' voice from the 'unattended' voice in scenarios with multiple speakers.

4

What are the key advantages of the Cochlearity platform?

Cochlearity offers several advantages, including its mobile accessibility, as it runs on widely available Android devices. Being open-source, it encourages broader adoption and further improvements from the community. The combined approach, using both passive and adaptive beamforming algorithms, enhances its performance. Furthermore, Cochlearity aims for real-time, low-latency processing to provide a natural listening experience.

5

What are the broader implications of Cochlearity for the future of assistive hearing technology and individuals with hearing impairments?

Cochlearity represents a significant advancement in assistive hearing technology by combining eye-tracking with advanced beamforming algorithms. This offers a promising solution for individuals who struggle to hear in noisy environments. The potential impact is far-reaching, as it could empower more people to connect with the world around them, improving their social interactions, work productivity, and overall quality of life. Further development could lead to more sophisticated and user-friendly gaze-directed hearing aids, customized to individual needs and preferences. Integration with other assistive technologies could also offer a more holistic solution for individuals with hearing impairments.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.