Person using gaze-directed hearing aid in a noisy environment.

Unlock Your Hearing Potential: How Gaze-Directed Tech Can Change Lives

"Discover the cutting-edge mobile tech that's revolutionizing hearing aids by using eye-tracking to focus on what you want to hear."


In today's noisy world, deciphering sounds can be a real challenge, especially in bustling environments. This is often referred to as the 'cocktail party problem' – the struggle to concentrate on a single voice amidst background noise. While those with healthy hearing can usually navigate these situations well, individuals with hearing loss often find it difficult to filter out distractions and focus on the sounds they want to hear.

Traditional hearing aids can amplify sounds, but they don't always solve the core issue of understanding speech in noisy environments. They often amplify background noise along with the desired sounds, leading to confusion and frustration for the user. This is where a new approach called gaze-directed beamforming comes into play, offering a smarter way to focus on specific sounds.

Gaze-directed beamforming uses eye-tracking technology to determine where a person is looking and then focuses the hearing aid's microphones on that direction. This allows the user to essentially 'listen' with their eyes, isolating the sounds they want to hear and reducing surrounding noise. Think of it like having a spotlight for your ears, illuminating the sounds that matter most.

Cochlearity: A New Approach to Assistive Hearing

Person using gaze-directed hearing aid in a noisy environment.

Researchers have developed a mobile platform called 'Cochlearity' that utilizes gaze-directed beamforming to enhance speech perception. This open-source platform runs on Android devices and uses an array of microphones, which can be worn comfortably on the head, for example, on eyeglasses. The system then uses eye-tracking to steer an acoustic beamformer, ensuring the listener hears best wherever they look.

Cochlearity uses a combination of passive (delay-and-sum) and adaptive (MVDR) beamforming algorithms to separate the 'attended' voice from the 'unattended' voice in a two-talker scenario. Delay-and-sum beamforming is a simpler method that uses the geometry of the microphone array and the speed of sound to combine signals. Adaptive beamforming, on the other hand, uses statistical learning to analyze noise sources in the environment and improve performance.
The Cochlearity platform offers several key advantages:
  • Mobile and Accessible: Runs on widely available Android devices.
  • Open-Source: Encourages broader adoption and further improvements.
  • Combined Approach: Uses both passive and adaptive beamforming.
  • Real-Time: Aims to provide low latency processing for a natural listening experience.
The system's effectiveness was tested by playing two different stories simultaneously from different locations. By tracking the direction of the user's gaze, Cochlearity was able to isolate the story the user was focusing on, effectively reducing the noise from the other story. This demonstrates the potential of gaze-directed beamforming to significantly improve speech perception in complex auditory environments.

The Future of Hearing is in Sight

The development of Cochlearity represents a significant step forward in assistive hearing technology. By combining eye-tracking with advanced beamforming algorithms, this platform offers a promising solution for individuals who struggle to hear in noisy environments. As the technology continues to evolve, we can expect even more sophisticated and user-friendly gaze-directed hearing aids that will empower people to connect with the world around them.

Newsletter Subscribe

Subscribe to get the latest articles and insights directly in your inbox.