INSEE (for the French Public Statistical System - SSP)

Division Enquêtes thématiques et études transversales - Timbre E430

88 avenue Verdier CS 70058
92541 Montrouge Cedex

Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises.

Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age. Part of this is the "European strategy for data", envisioning a single market for data to ensure the EU's global competitiveness and data sovereignty, in which context a comprehensive set of new rules for all digital services was proposed: the Digital Services Act and the Digital Markets Act, which are centrepieces of the EU digital strategy. Furthermore, the Commission and the High Representative of the Union for Foreign Affairs and Security Policy presented a new “EU cybersecurity strategy”, which is intended to bolster the EU's collective resilience against cyber threats, safeguard a global and open internet and protect EU values and the fundamental rights of its people. Furthermore, data will allow monitoring the progress towards  A Europe fit for the digital age, one of the six priorities for the period 2019-2024 of the von der Leyen European Commission.

The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.

 NACE Rev.2 2008

All economic activities in the scope of Annex I of the Commission Regulation are intended to be included in the general survey, covering enterprises with 10 or more employees and self-employed persons. These activities are: NACE Rev. 2 sections C, D, E, F, G, H, I, J, L, M and N, division 95.1.

For micro-enterprises see the sub-concepts below.

Micro-enterprises are not included in the survey.

The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following areas:

-          Access to and use of the Internet

-          E-commerce and e-business

-          Use of cloud computing services

-          Artificial Intelligence

-          Other topics: Data utilisation, sharing, analytics and trading, Invoicing.

The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey.

Enterprise

Target Population

As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons shall be covered by the survey.

For micro-enterprises see the sub-concepts below.

Not applicable

 France (all territory, including overseas regions).

Years 2022 and 2023.

Not applicable

Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons, Million euro.

Reference periods defined in the model questionnaire were followed in the national survey.

Complementary national legislation constituting the legal basis for the survey on the use of ICT in enterprises:

The survey is mandatory at national level. Non-respondent units can be fined by the litigation commitee after the data collection period.

Data are shared on demand within the national statistical system.

Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.

At national level :

No cell of the table may concern less than three units.

No cell of the table may contain data for which a company represents more than 85 % of the total.

No cell of the table can be calculated from other cells.

Data are transmitted via eDamis (encrypted) and delivered to a secure environment where they are treated. Flags are added for confidentiality in case results must not be disclosed.

At national level : 

The tool Tau-Argus is used to identify values to flag as confidential.

Some indicators calculated from microdata are planned to be disseminated in December 2023.

A publication analysing results of the survey is planned to be released in April 2024.

There is a short-time release calendar on Insee website.

Not available.

Data tables of indicators and a thematic analyse are publicly disseminated on our website Insee.fr. Information on publication releases is given by Insee twitter account. Users can also subscribe to the newsletter on Insee.fr.

Annual

National dissemination of results

Information on publication releases is given by Insee twitter account. Users can also subscribe to the newsletter on Insee.fr.

National dissemination of results

Some indicators calculated from microdata are planned to be disseminated in December 2023.

A publication analysing results of the survey is planned to be released in April 2024.

See detailed section 10.3.1.

Results for selected variables collected in the framework of this survey are available for all participating countries on Digital economy and society of Eurostat website.

At national level :

Every survey year leads to a database publication, there is no fixed location on the Insee website for a unique database.

The number of consultations is not available.

Microdata are disseminated via the CASD. Any access has to be justified and granted (for example a study of a PHD student) by the Insee comité du secret. Some restrictions (for example relating to confidentiality) are indicated to users.

Not requested

Not requested

A national quality report is published in French and in English in SIMS format.

Not requested

At the end of the survey, a methodological documentation of every part of the survey process is published with microdata (with restricted access, see 10.4).

The European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises provides guidelines and standards for the implementation of the surveys. It is updated every year according to the changed contents of the model questionnaires.

At national level :

The Methodological Manual provides guidelines and standards for the implementation of the surveys in the Member States. It is updated every year according to the changed contents of the model questionnaires.

The quality informations are filled in the SIMS format.

European level :

At European level, the recommended use of the annual Eurostat model questionnaire aims at improving comparability of the results among the countries that conduct the survey on ICT usage and e-commerce in enterprises. Moreover, the Methodological Manual provides guidelines and clarifications for the implementation of the surveys.

National level :

Model questionnaire is translated to produce the national questionnaire. Methodological Manual guidelines are also used.

European level : 

At European level, European Commission users (e.g. DG CNECT, DG GROW, DG JUST, DG REGIO, DG JRC) are the principal users of the data on ICT usage and e-commerce in enterprises and contribute in identifying/defining the topics to be covered. Hence, main users are consulted regularly (at hearings, task forces, ad hoc meetings) for their needs and are involved in the process of the development of the model questionnaires at a very early stage.

User needs are considered throughout the whole discussion process of the model questionnaires aiming at providing relevant statistical data for monitoring and benchmarking of European policies.

National level :

Once available, the model questionnaire is translated into French and discussed with national stakeholders (from administrations and civil society) and users (e.g. researchers). The discussion includes fine-tuning the translations, choosing the proper examples, deciding on the optional questions considering the overall response burden/length of the questionnaire and sometimes adding national questions.

European level : 

At European level, contacts within the Commission, the OECD and other stakeholders give a clear picture about the key users' satisfaction as to the following data quality aspects: accuracy and reliability of results, timeliness, satisfactory accessibility, clarity and comparability over time and between countries, completeness and relevance. Overall users have evaluated positively (good, very good) the data quality on the ICT usage and e-commerce in enterprises.

National level :

A satisfaction survey is being conducted from March until June 2020 on data users (users displaying ICT survey aggregated data and publications on the NSI website or being granted an access to ICT survey microdata through CASD.eu). Results have been detailed in the 2020 quality report.

During the annual meeting concerning the national questionnaire, users provide feedback on the survey.

Detailed information is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

Not requested. 

Comments on reliability and representativeness of results and completeness of dataset

These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates).

More detailed information is available in “ Annex II. _ Accuracy “ excel file - related to European aggregates, comments on reliability and use of flag.

For calculation of the standard error see 13.2.1.1.

Standard error (for selected indicators and breakdowns)

Precision measures related to variability due to sampling, unit non-response (the size of the subset of respondents is smaller than the size of the original sample) and other (imputation for item non-response, calibration etc.) are not (yet) required from the Member states for all indicators.  Eurostat will make basic assumptions to compute these measures for all indicators produced (e.g. stratified random sampling assuming as strata the crossing of the variables “Number of employees and self-employed persons” and “Economic Activity” as it was defined in the 3 tables of section 18.1).

More detailed information is available in“ Sample and standard error tables 2023 “ excel file – worksheets starting with “Standard error".

Calculation of the standard error

Various methods can be used for the calculation of the standard error for an estimated proportion. The aim is to incorporate into the standard error the sampling variability but also variability due to unit non-response, item non-response (imputation), calibration etc. In case of census / take-all strata, the aim is to calculate the standard errors comprising the variability due to unit non-response and item non-response.

See detailed sections below.

See concept 18.1.1. A) Description of  frame population.

Over-coverage is treated during collection:
-during data collection, if a unit states that it is out of scope, mostly because they stopped existing or their number of persons employed dropped under 5* persons, it is properly flagged and excluded from the data
processing;
-an estimate of the share of over-coverage due to ceased units (not existing anymore) is calculated and used during calibration step.
Over-coverage concerns about 2% of units in the sample (excluded from final data).
*threshold of 5 persons instead of 10 is used to compensate for the units that were not included in the frame because they were registered below 10 in the business register, though they would have 10 or more persons employed at the time of the survey

Not requested

None

See detailed sections below.

See detailed sub-concepts below.

The following table contains the number of units (i.e. enterprises), by type of response to the survey and by the percentage of these values in relation to the gross sample size.

Monitoring the survey included the following phases:
- First reminder by mail one month after having sent the first letter;
- Second reminder by mail 20 days after (giving notice to answer);
- No response statements 30 days after;
- Fine for main non-responding units (not this first year on enterprises);
A systematic phone call reminder was organised at the same time for the most important units.
Reminders are sent to respondents who have logged in the response website but have not finilized and send the questionnaire.

Not available

Not available

Other comments relating to the item non-response

There is no imputation for unit non-response (treated with reweighing).

The imputation rates for item non-response are attached (file Imputation_rates_2023.ods).

Not requested

See detailed section below.

Not applicable

European level : 

Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year e.g. e-commerce).

At national level : 

December of the reference year. T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year.

 See detailed section below.

Date of data delivery to Eurostat : 05/10/2023

Time lag between the actual date of data delivery to Eurostat and the deadline (5th October) : 0

The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in reference periods, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the metadata.

The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data.

Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

Not applicable

See section below.

The length of comparable time series depends on the module and the variable considered within each survey module. Additional information is available in annexes attached to the European metadata.

No significant change that could impact the comparability with previous year.

Not applicable

 Not applicable

Not applicable

Not applicable

Should a considerable mistake be noticed after the timely data transmission, a corrected table would be produced and sent, even years after (as was done in 2018 to fix mistakes in number of person  employed in 2016 data).

Not available

 Not requested

A) Frame population description and distribution

For more information see concept 18.1.1.

B) Sampling design - Sampling method

Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata: 

This section includes a description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE categories related to the "possible calculation of European aggregates", and the final number of strata.

The sample is stratified by sector (divisions or groupings of divisions), reported employment and turnover (about 200 non-empty strata each year). Random sampling is used for most strata. A full enumera on is used for strata meeting one of the following criteria (take-all strata):
• 500 persons employed and more
• High level of turnover (“high” depends on the employment range (e.g. >=100 M€ for 10-19 persons employed strata, turnover>=110 M€ for 20-49 persons employed strata, etc.))
• Retail sale via mail order houses or via Internet (NACE 47.91A and 47.91B) (to gain precision in the measure of the e-sales amounts)
Local accuracy constraints are added to improve the quality of the results for small strata. The goal is that in every breakdown, the estimated standard error shall be less than 5 percentage points. Last, the response rate per strata from the previous year is used to  adjust the number of units in each stratum (increasing the size of strata with lesser response rates). Coordination with the sampling of 2022 ICT survey (only for single legal units this year due to statistical unit transition from legal unit to enterprise) is done in order to keep in 2023 half of the sample of the 2022 survey (besides the take-all strata). That way, we steady the year-to-year comparisons, especially for e-sales amounts.
Negative coordination with most of the other surveys led in 2022 by Insee is done to make sure the response burden is equally shared within the enterprises (other than the enterprises belonging to a takeall strata).

C) Gross sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: GROSS SAMPLE)

D) Net sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: NET SAMPLE)

A) Description of frame population

 B) Frame population distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: FRAME POPULATION)

Annual

See detailed sections below.

Web survey (using phone, mails and emails for reminders and further information). If the enterprise doesn't want to answer using the website, self-administered mail survey (less than 1% of the respondents, either paper or email PDF).

The server based validation tool by Eurostat is used. We also check for consistency during various stages of the data collection and processing.

Grossing-up procedures

As for the majority of surveys at INSEE, the procedure used is calibration on margins using CALMAR (SAS macro “calage sur marges”).
Margins are the number of enterprises by group of economic activity, staff size and turnover in the frame population.

There is no imputation for unit non-response (treated with reweighing).
The imputation rates for item non-response are attached (file Imputation_rates_2023.ods).

Not applicable

Not applicable

Problems encountered and lessons to be learnt: