Welcome, dear Guest [Log on]

Inspiring a Digital Society (Hall X3)


Natural sense of vision through acoustics and haptics


Area: Inspiring a Digital Society (Hall X3)

Stand number: i11

In the Sound of Vision project (No. 643636), the consortium created and developed a concrete wearable assistive system with enough capabilities to substantially alleviate the situation of visually impaired people. It allows them to perceive the environment and move independently, in indoor or outdoor areas, without the need for predefined tags/sensors located in the surroundings.

The final prototype of the Sound of Vision system is a state-of-the art device, using the latest technologies such as 3D cameras, advanced graphics processing unit computing, haptics and wearable electronics.

The system works by permanently scanning the environment, extracting essential information and conveying it in real-time to the user through audio (sounds) and haptic (vibrations). The system provides rich and natural-like perception by means of audio and haptic representations of the sensed environment. Audio encoding models inspired by natural phenomena like liquid behavior and image-like haptic projections of objects onto the user’s abdomen support our approach to natural perception.

The Sound of Vision system is accompanied by teaching material that supports users to learn and achieve proficiency. The system was extensively tested, in both laboratory and real-world environments, with excellent results achieved by most of the visually impaired users. More than 45 visually impaired persons participated in the development (over 1000 hours of training and testing).

Website: https://soundofvision.net/

Watch a video presentation.

ID: 22219