The purpose of this document is to outline the scope, approach, objectives, preliminary resource implications and impact on stakeholders of the BIG DATA project (BIGD) for endorsement by the ESSC. The BIGD project is part of the Vision 2020 implementation portfolio responding to the pressing need of harnessing new data sources to deliver better statistical products and service in response to users' needs. The project will implement the short and medium term objectives of the Big Data Action Plan and Roadmap, which was endorsed by the ESSC at its meeting in Riga on 26 Sep 2015. The proposals are based on stakeholder analysis and an initial feasibility and cost-benefit study.
The aim of the BIGD project is to provide the ESS with necessary capabilities, operational experiences, methodological and ethical guidelines, and testing infrastructures required for a stepwise integration of big data sources into the production of official statistics. The project envisages: (i) short-term actions aimed at building capacity in the ESS to harness big data sources and delivering first results on the use of big data as an auxiliary source for the production of official statistics; (ii) medium-term actions to create the legal, technical and statistical infrastructure for systematic use of big data sources in different domains of official statistics. The corresponding long term vision (beyond 2020) of the Big Data Action Plan and Roadmap is to effectively achieve a full integration of big data sources into the regular production of statistics and the statistical information architecture in a multisource framework.
At its meeting from 20-21 May 2015 in Luxemburg, the European Statistical System Committee expressed its support for launching the ESS.VIP on Big data (BIGD). In detailed planning and implementation of the project, Eurostat confirmed that the concrete proposals made by the ESSC, such as exploring experience with public-private partnerships, privacy and legal issues, would be taken into account.