Data validation

Data validation

Eurostat performs data validation by verifying whether data are in accordance with certain basic criteria that serve to assess the plausibility of the given data. In this context, the following specific definition is applicable: Data validation is an activity verifying whether or not a combination of values is a member of a set of acceptable combinations.

Data validation is a key task performed in all statistical domains. In order to increase overall data quality and workflow efficiency, the European Statistical System (ESS) is moving towards more harmonised validation activities. Eurostat supports the effort towards more integration by defining common standards for validation, providing common validation tools or services to be used by the ESS, and providing statistical, methodological, administrative and technical support.

In the target business process, validation rules are jointly designed and agreed upon at the level of each statistical domain’s Working Group. The resulting validation rules are documented using common cross-domain standards, with clear validation responsibilities assigned to the different groups participating in the production process of European statistics.

Illustration of the ESS data validation workflow with processes and information objects

Diagram explaining data validation

Further information can be found on the ESS Data Validation pages on CROS which contain the following main sections:

  • Validation concepts - including the description of typical validation processes,
  • Validation in the ESS - including validation principles, the target business process, possible implementation scenarios for the Member States, and a summary of relevant standards (SDMX, VTL, CSPA)
  • Validation services - including the overview of  Eurostat IT tools or services that are or will be available
  • Trainings and tutorial - information about the training schedule and tutorials on validation processes and validation services
  • Further information - information related to other data validation related content.

See also: Video presentation on ESS Validation.

For further information, contact: