Research & Innovation - Participant Portal


TOPIC : Multimodal and Natural computer interaction

Topic identifier: ICT-22-2014
Publication date: 11 December 2013

Types of action: RIA Research and Innovation action
IA Innovation action
Opening date:
11 December 2013
Deadline: 23 April 2014 17:00:00

Time Zone : (Brussels time)
  Horizon 2020
Topic Description

Specific Challenge: As devices and systems are becoming increasingly powerful, the interface between human and computer is often lagging behind and constitutes a bottleneck for seamless and efficient use.  Leveraging on multidisciplinary expertise combining knowledge from both the technological and human sciences, new technologies need to offer interactions which are closer to the communication patterns of human beings and allow a simple, intuitive and hence more "natural" communication with the system.

Scope: The topic will be addressed by the following focused actions: 

a.      Research & Innovation Actions: Provide interactive information retrieval systems with more efficient and natural ways of delivering answers to users' queries especially in unexpected and/or difficult circumstances. This should be supported by research on knowledge-based autonomous human-like social agents that can handle and learn from conversational spoken and multimodal interaction as well as react proactively to new communicative situations. Systems should cope with spontaneous spoken dialogue and gestural interaction, in multiple languages, and exhibit adequate communicative, conversational, affective and social capabilities in relation to the domain/task under consideration and the needs and abilities of the user. Technologies should be designed to match multiple delivery platforms and be demonstrated in real environments, while research is expected to be based on and/or produce freely available and re-usable resources.

b.      Research & Innovation Actions: Develop novel multi-modal, adaptive interfaces, including Brain Computer Interfaces, assisting people with disabilities. Research should explore: how users interact and cooperate with (intelligent) systems, including user modelling aspects for the identification of necessary abilities for different functions and environments; how to detect behaviours, emotions and intentions of the user; how to sense and understand the environment and other context factors; how multimodal (including nonverbal) interaction is used in ambient environments. Activities may cover also interoperability standards (for software and devices) as well as interaction and cooperation between machine intelligence in environments and human intelligence.

c.       Innovation Actions: Develop and validate innovative multimodal interfaces to provide more efficient and natural ways of interacting with computers and improve users' experience. Leveraging on one or multiple smart devices and sensors with capabilities such as scene analysis, voice recognition, human position, gestures and body language detection capabilities, such systems must provide non-intrusive interaction with human where real and virtual content are blended. Built with a user centric approach, solutions should be cost effective; address clear market needs and be validated in domains such as those of the creative industries fields.

Expected impact:

a.      Research & Innovation Actions

         Improve multilingual speech processing and bridging the gap between recognition and synthesis, exploiting metadata and other contextual data.

         Increase the automatic inferences capacities from rich context thanks to improved language understanding, sensed environments/objects, use of social media and agent’s experience.

b.      Research & Innovation Actions

         Advance the capacity of human-machine interaction technologies to enable disabled and elderly people to fully participate in society.

c.       Innovation Actions

         Enable better uses of ICT technologies within the creative industries by providing directly usable solutions addressing their specific needs.

         Provide a large spill over of the knowledge acquired to a maximum of European industries.

         Improve the competitive position of the European industries through the provision of cost effective, innovative and high-value products and services.

Types of action:

a.       Research & Innovation Actions – Proposals requesting a Small contribution are expected

b.      Research & Innovation Actions – Proposals requesting a Small contribution are expected

c.       Innovation Actions – Proposals requesting a Small contribution are expected


Cross-cutting Priorities:

Socio-economic science and humanities

Topic conditions and documents

Please read carefully all provisions below before the preparation of your application.

To see the budget earmarked for this topic, please look at the call budget distribution table by topic in the workprogramme.

  1. List of countries and applicable rules for funding: described in part A of the General Annexes of the General Work Programme.
  2. Eligibility and admissibility conditions: described in part B and C of the General Annexes of the General Work Programme
  3. Evaluation

    3.1 Evaluation criteria and procedure, scoring and threshold: described in part H of the General Annexes of the General Work Programme

    3.2 Guide to the submission and evaluation process
  4. Proposal page limits and layout: Please refer to Part B of the standard proposal template.
  5. Indicative timetable for evaluation and grant agreement:
    Information on the outcome of one-stage evaluation: maximum 5 months from the final date for submission.
    Signature of grant agreements: maximum 3 months from the date of informing successful applicants.
  6. Provisions, proposal templates and evaluation forms for the type(s) of action(s) under this topic:

    Research and Innovation Action:

    Specific provisions and funding rates
    Standard proposal template (administrative forms and structure of technical annex)
    Standard evaluation form
    Annotated Model Grant Agreement

    Innovation Action:

    Specific provisions and funding rates
    Standard proposal template (administrative forms and structure of technical annex)
    Standard evaluation form
    Annotated Model Grant Agreement
  7. Additional provisions:

    Horizon 2020 budget flexibility

    Classified information
  8. Open access must be granted to all scientific publications resulting from Horizon 2020 actions, and proposals must refer to measures envisaged. Where relevant, proposals should also provide information on how the participants will manage the research data generated and/or collected during the project, such as details on what types of data the project will generate, whether and how this data will be exploited or made accessible for verification and re-use, and how it will be curated and preserved.


Additional documents

  • Call Flash Info en
  • Legal basis - Framework Programme H2020 en
  • Legal basis - Specific Programme H2020 en
  • WP H2020 - 1. Introduction en
  • WP H2020 - 5. Introduction to Leadership in enabling and industrial technologies (LEITs) en
  • WP H2020 - 5i. Information and communication technologies (ICT) en
  • WP H2020 - 17. Communication and Dissemination en
  • WP H2020 - 19. General Annexes en
  • A guide to ICT-related activities in WP2014-15 en

Submission Service

No submission system is open for this topic.

Get support

National Contact Points (NCP) – contact your NCP for further assistance.

Enterprise Europe Network – contact your EEN national contact for advice to businesses with special focus on SMEs. The support includes guidance on the EU research funding.

B2Match networking platform with project ideas and participant profiles following the networking event in ICT 2013 in Vilnius

Ideal-IST partner search facility

Research Enquiry Service – ask questions about any aspect of European research in general and the EU Research Framework Programmes in particular.

IT Helpdesk – contact the Participant Portal IT helpdesk for questions such as forgotten passwords, access rights and roles, technical aspects of submission of proposals, etc.

Ethics – to ensure compliance with ethical issues, further information is available on the Participant Portal and on the Science and Society Portal.

European IPR Helpdesk assists you on intellectual property issues.

The European Charter for Researchers and the Code of Conduct for their recruitment

CEN and CENELEC, the European Standards Organisations, advise you how to tackle standardisation in your project proposal. Contact CEN-CENELEC Research Helpdesk at

Partner Search Services helps you find a partner organisation for your proposal.

H2020 Online Manual your online guide on the procedures from proposal submission to managing your grant.