Data validation
Data validation
Eurostat performs data validation by verifying whether data are in accordance with certain basic criteria that serve to assess the plausibility of the given data. In this context, the following specific definition is applicable: Data validation is an activity verifying whether or not a combination of values is a member of a set of acceptable combinations.
Data validation is a key task performed in all statistical domains. In order to increase overall data quality and workflow efficiency, the European Statistical System (ESS) is moving towards more harmonised validation activities. Eurostat supports the effort towards more integration by defining common standards for validation, providing common validation tools or services to be used by the ESS, and providing statistical, methodological, administrative and technical support.
In the target business process, validation rules are jointly designed and agreed upon at the level of the 'Working Group' of each statistical domain. The resulting validation rules are documented using common cross-domain standards, with clear validation responsibilities assigned to the different groups participating in the production process of European statistics.
Illustration of the ESS data validation workflow with processes and information objects
More information
- Data and Metadata exchange group on the CROS portal, which contains information on:
- Validation in the ESS: definitions, principles, possible implementation scenarios for the Member States and a description of the validation life cycle, amongst others
- Tools: displays and describes Eurostat IT architecture for data and metadata transmission and validation
- Training courses and user guides: training calendar and tutorials on data and metadata processes and services, including validation
See also
Video presentation on ESS Validation.