The Sound of Vision solution is a state-of-the art device that uses the latest technologies, such as 3D cameras, advanced GPU computing, haptics, naturalistic sensory substitution and wearable electronics. It works by permanently scanning the environment, extracting essential information and conveying it in real-time to the user through sounds and vibrations.
According to the project's final report, even with a small amount of training, visually impaired participants are able to perform difficult mobility tasks with the Sound of Vision system.
It gave them a better and more complex perception of the environment, which led to safer mobility and increased confidence. An affordable commercial product is expected to be on the market in 1-2 years.
Validation of the system
During the project, three functional prototypes were developed and extensively tested. Each new version included improvements based on the experience with the last prototype, using test results and feedback provided by visually impaired persons, training specialists and specialists in psychophysics. Overall, more than 45 visually impaired persons participated in the evaluation.
This project was awarded a budget of € 3,960,709 under the framework program for research and innovation Horizon 2020. It integrated research groups, universities and companies from Hungary, Iceland, Italy, Poland and Romania.