No snow white, seven dwarfs or evil queen: The mirror in this story doesn't know if you are beautiful or good looking. However, using multispectral face imagery and 3D reconstruction it could tell you something about your health.

In fact, the mirror's reflective surface hides 8 cameras and several other sensors. "Together they analyse facial signs to measure the health level of the person in front of it," explains Sara Colantonio, coordinator of the Semeoticons project.

Veronica Chiara Zuccalà, researcher in biomedical engineering, describes the different steps: "An ultraviolet flash will identify substances in the skin associated with the risk of diabetes". Then the system takes images for 20 seconds to study facial micro-movements that indicate a person's stress level. Finally, a spot light allows the system to study skin indicators related to cholesterol.

Clinical trials in France and Italy showed a good correlation between the mirror's reading and results from conventional diagnostic methods.

The Semeoticons project lasted 3 years from November 2013. Close to 3.9 mio Euros of its total budget of almost 5.4 mio Euros were contributed by the EU.

Semeoticons is featured in a contribution to the Futuris programme on the pan-European TV channel Euronews.  It was shown on TV more than a dozen times until 19 February 2017 and can still be watched online in several languages:

Euronews video (4:20) also available in DE, EL, ES, FR, HU, IT, PT and a number of additional languages

Takeaway (0:55) short version of the video. English subtitles. No narration.

Blogpost by project coordinator Sara Colantonio

Project website

On Cordis