Data > Data validation EN REVAMP

Eurostat performs data validation by verifying whether data are in accordance with certain basic criteria that serve to assess the plausibility of the given data. The following definition is applicable in tihs context: Data validation is an activity verifying whether or not a combination of values is a member of a set of acceptable combinations.

Data validation is a key task performed in all statistical domains. To increase overall data quality and workflow efficiency, the European Statistical System (ESS) is moving towards more harmonised validation activities.

Eurostat supports the effort towards more integration by

  • defining common standards for validation
  • providing common validation tools or services to be used by the ESS
  • providing statistical, methodological, administrative, and technical support.

In the target business process, validation rules are jointly designed and agreed upon at the level of the working group of each statistical domain. The resulting validation rules are documented using common cross-domain standards, with clear validation responsibilities assigned to the different groups participating in the production process of European statistics.

ESS data validation workflow

“Validation rules for each data collection are designed by Eurostat in consultation with national authorities. The validation rules are then documented and made available to national data providers. National data providers have the responsibility of checking that the data they send to Eurostat complies with the validation rules prior to transmitting the data to Eurostat. Upon data transmission to Eurostat, Eurostat also checks that the validation rules are respected and sends back a validation report to national data providers. Based on the validation report, Eurostat assesses whether the data can be accepted.
 

Further information

  • Data and metadata exchange group, which contains information on:
    • validation in the ESS: definitions, principles, possible implementation scenarios for the EU members and a description of the validation life cycle, amongst others
    • tools: displays and describes Eurostat IT architecture for data and metadata transmission and validation
    • training courses and user guides: training calendar and tutorials on data and metadata processes and services, including validation
  • Video on ESS validation
  • Quality of European statistics
  • SDMX info space