Reference metadata describe statistical concepts and methodologies used for the collection and generation of data. They provide information on data quality and, since they are strongly content-oriented, assist users in interpreting the data. Reference metadata, unlike structural metadata, can be decoupled from the data.
Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises.
The legal basis for ICT enterprise statistics for survey year 2024 is Commission Implementing Regulation (EU) 2023/1507 of 20 July 2023 laying down the technical specifications of data requirements for the topic 'ICT usage and e-commerce' for the reference year 2024.Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age.
Furthermore, ICT data facilitate the monitoring of the EU’s digital targets for 2030, set by the Digital Decade Policy Programme. Four of the key performance indicators (KPIs) of the current programme stem from the statistics for which the implementing and delegated acts are enclosed for adoption: Artificial Intelligence, cloud, big data (data analytics) and the digital intensity index for businesses (DII) - a composite indicator reflecting the digital transformation of business. The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.
Name of data collection
In Estonian “Infotehnoloogia ettevõttes”, in English “ICT usage in enterprises”
All economic activities in the scope of Annex of the Commission Regulation are intended to be included in the general survey, covering enterprises with 10 or more employees and self-employed persons. These activities are:
Section C – “Manufacturing”
Section D, E – “Electricity, gas, steam and air conditioning supply”, “Water supply, sewerage, waste management and remediation activities”
Section F – “Construction”
Section G – “Wholesale and retail trade; repair of motor vehicles and motorcycles”
Section H – “Transportation and storage”
Section I – “Accommodation and food service activities”
Section J – “Information and communication”
Section L – “Real estate activities”
Section M – “Professional, scientific and technical activities”
Section N – "Administrative and support service activities"
Group 95.1 – “Repair of computers and communication equipment”.
For micro-enterprises see the sub-concepts below.
3.3.1. Coverage-sector economic activity for micro-enterprises - All NACE Rev. 2 categories are covered
Micro-enterprises are not included in the survey
3.3.2. Coverage sector economic activity for micro-enterprises - If not all activities were covered, which ones were covered?
micro-enterprises are not included in the survey
3.4. Statistical concepts and definitions
The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following topics:
Access to and use of the Internet;
E-commerce and e-business;
ICT specialists and skills;
ICT security;
Artificial Intelligence.
The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey.
3.5. Statistical unit
Enterprise.
3.6. Statistical population
Target Population
As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons are covered by the survey.
For micro-enterprises see the sub-concepts below.
Enterprises with 10 and more employees and self-employed persons are covered by the survey
3.6.1. Coverage of micro-enterprises
No
3.6.2. Breakdown between size classes [0 to 1] and [2 to 9]
No
3.6.3. If for micro-enterprises different size delimitation was used, please indicate it.
Not applicable.
3.7. Reference area
Detailed information on the provision of data on NUTS 2 regional level is available in “Annex I.
Completeness“. All territory of Estonia is covered.
3.8. Coverage - Time
Years 2023 and 2024.
3.9. Base period
Not applicable
Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons, Million euro (for selected indicators in some countries).
The reference period have been followed
6.1. Institutional Mandate - legal acts and other agreements
Complementary national legislation constituting the legal basis for the survey on the use of ICT in enterprises:
There is no complementary national legislation.
6.2. Institutional Mandate - data sharing
Not applicable.
7.1. Confidentiality - policy
Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.
At national level:
The dissemination of data collected for the purpose of producing official statistics is guided by the requirements provided for in § 32, § 34, § 35, § 38 of the Official Statistics Act.
Data are transmitted via eDamis (encrypted) and delivered to a secure environment where they are treated. Flags are added for confidentiality in case results must not be disclosed.
At national level:
The treatment of confidential data is regulated by the Procedure for Protection of Data Collected and Processed by Statistics Estonia (in Estonian). See more details on the website of Statistics Estonia in the section Õigusaktid.
All users have been granted equal access to official statistics: dissemination dates of official statistics are announced in advance and no user category (incl. Eurostat, state authorities and mass media) is provided access to official statistics before other users.
Official statistics are first published in the statistical database. If there is also a news release, it is published simultaneously with data in the statistical database. Official statistics are available on the website at 8:00 a.m. on the date announced in the release calendar.
Results for selected variables collected in the framework of this survey are available for all participating countries on Digital economy and society of Eurostat website.
The European businesses statistics compilers’ manual for ICT usage and e-commerce in enterprises provides guidelines and clarifications for the implementation of the surveys.
There is no national quality management documentation and studies avalable.
11.1. Quality assurance
The European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises provides guidelines and standards for the implementation of the surveys. It is updated every year according to the changed contents of the model questionnaires.
At national level:
To assure the quality of processes and products, Statistics Estonia applies the EFQM Excellence Model, the European Statistics Code of Practice and the Quality Assurance Framework of the European Statistical System (ESS QAF). Statistics Estonia is also guided by the requirements in § 7. “Principles and quality criteria of producing official statistics” of the Official Statistics Act.
11.2. Quality management - assessment
At European level, the recommended use of the annual Eurostat model questionnaire aims at improving comparability of the results among the countries that conduct the survey on ICT usage and e-commerce in enterprises. Moreover, the European businesses statistics compilers’ manual for ICT usage and e-commerce in enterprises provides guidelines and clarifications for the implementation of the surveys.
At national level:
Estonia performs all statistical activities according to an international model (Generic Statistical Business Process Model – GSBPM). According to the GSBPM, the final phase of statistical activities is overall evaluation using information gathered in each phase or sub-process; this information can take many forms, including feedback from users, process metadata, system metrics and suggestions from employees. This information is used to prepare the evaluation report which outlines all the quality problems related to the specific statistical activity and serves as input for improvement actions.
12.1. Relevance - User Needs
Ministry of Economic Affairs and Communications.
12.2. Relevance - User Satisfaction
Since 1996, Statistics Estonia has conducted reputation and user satisfaction surveys. All results are available on the website of Statistics Estonia in the section User surveys.
Detailed information is available in “ Annex I. Completeness “ - related to questionnaire, coverage, additional questions, regional data.
12.3.1. Data completeness - rate
Not requested
13.1. Accuracy - overall
Comments on reliability and representativeness of results and completeness of dataset
These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates).
More detailed information is available in “ Annex II. Accuracy “ - related to European aggregates, comments on reliability and use of flag.
13.2. Sampling error
For calculation of the standard error see 13.2.1.1.
13.2.1. Sampling error - indicators
Standard error (for selected indicators and breakdowns)
Precision measures related to variability due to sampling, unit non-response (the size of the subset of respondents is smaller than the size of the original sample) and other (imputation for item non-response, calibration etc.) are not (yet) required from the Member states for all indicators. Eurostat will make basic assumptions to compute these measures for all indicators produced (e.g. stratified random sampling assuming as strata the crossing of the variables “Number of employees and self-employed persons” and “Economic Activity” as it was defined in the 3 tables of section 18.1).
More detailed information is available in“ Annex III. Sample and standard error tables 2024 “ – worksheets starting with “Standard error".
13.2.1.1. Sampling error indicator calculation
Calculation of the standard error
Various methods can be used for the calculation of the standard error for an estimated proportion. The aim is to incorporate into the standard error the sampling variability but also variability due to unit non-response, item non-response (imputation), calibration etc. In case of census / take-all strata, the aim is to calculate the standard errors comprising the variability due to unit non-response and item non-response.
a) Name and brief description of the applied estimation approach
Standard errors are calculated with the programm R Survey, algoritm of which are based on Taylor linea.
b) Basic formula
Programm R Survey, algoritm of which are based on Taylor linearisation.
c)Main reference in the literature
Model Assisted Survey Sampling (Särndal, Swensson, Wretman, 1991).
d)How has the stratification been taken into account?
Stratification has been taken into account, see formulas in section b.
e)Which strata have been considered?
Sampling design strata have been considered.
13.3. Non-sampling error
See detailed sections below.
13.3.1. Coverage error
See concept 18.1.1. A) Description of frame population.
13.3.1.1. Over-coverage - rate
Out of scope 46 enterprises (1.5 %).
13.3.1.2. Common units - proportion
Not requested
13.3.2. Measurement error
No measurement errors detected.
13.3.3. Non response error
See detailed sections below.
13.3.3.1. Unit non-response - rate
See detailed sub-concepts below.
13.3.3.1.1. Unit response
The following table contains the number of units (i.e. enterprises), by type of response to the survey and by the percentage of these values in relation to the gross sample size.
Type of response
Enterprises
0-9 (or 2-9) employees and self-employed persons
10 or more employees and self-employed persons
Number
%
Number
%
Gross sample size (as in section 3.1 C)
100%
3076
100%
1. Response (questionnaires returned by the enterprise)
2649
86,1
1.1 Used for tabulation and grossing up (Net sample or Final Sample; as in section 3.1 D)
2603
84,6
1.2 Not used for tabulation
46
1,5
1.2.1 Out of scope (deaths, misclassified originally in the target population, etc.)
46
1,5
1.2.2 Other reasons (e.g. unusable questionnaire)
0
0
2. Non-response (e.g. non returned mail, returned mail by post office)
427
13,9
Comments on unit response, if unit response is below 60%
13.3.3.1.2. Methods used for minimizing unit non-response
Automatic reminders: 2 preventive reminders —8 days and 1 day before the deadline, 3 reminders after deadline—3 days, 7 days and 37 days after deadline. Additionally the telephone contacts were made if needed.
13.3.3.1.3. Methods used for unit non-response treatment
1. No treatment for unit non-response
2. Treatment by re-weighting
2.1 Re-weighting by the sampling design strata considering that non-response is ignorable inside each stratum (the naïve model)
x
2.2 Re-weighting by identified response homogeneity groups (created using sample-level information)
2.3 Re-weighting through calibration/post-stratification (performed using population information) by the groups used for calibration/post-stratification
3. Treatment by imputation (done distinctly for each variable/item)
4. Method(s) and the model(s) corresponding to the above or other method(s) used for the treatment of unit non-response. (e.g. Re-weighting using Horvitz-Thompson estimator, ratio estimator or regression estimator, auxiliary variables)
13.3.3.1.4. Assessment of unit non-response bias
No response rate below 60%.
13.3.3.2. Item non-response - rate
There was no item with response rate below 90% in the questionnaire.
13.3.3.2.1. Methods used for item non-response treatment
1. No treatment for item non-response
x
2. Deductive imputation An exact value can be derived as a known function of other characteristics.
3. Deterministic imputation (e.g. mean/median, mean/median by class, ratio-based, regression-based, single donor nearest-neighbour) Deterministic imputation leads to estimators with no random component, that is, if the imputation were to be re-conducted, the outcome would be the same.
4. Random imputation (e.g. hot-deck, cold-deck) Random imputation leads to estimators with a random component, that is, if the imputation were re-conducted, it would have led to a different result.
5. Re-weighting
6. Multiple imputation In multiple imputation each missing value is replaced (instead of a single value) with a set of plausible values that represent the uncertainty of the right value to impute. Multiple imputation methods offer the possibility of deriving variance estimators by taking imputation into account. The incorporation of imputation into the variance can be easily derived based on variability of estimates among the multiply imputed data sets.
7. Method(s) and the model(s) corresponding to the above or other method(s) used for the treatment of item non-response.
13.3.3.2.2. Questions or items with item response rates below 90% and other comments
Other comments relating to the item non-response
Additional issues concerning "item non-response" calculation (e.g. method used in national publications).
Not applicable
Questions and items with low response rates (cut-off value is 90%) and item non-response rate.
There was no need for item non-response treatment.
13.3.4. Processing error
No processing errors identified.
13.3.5. Model assumption error
Not requested
14.1. Timeliness
See detailed section in the Full metadata report.
14.1.1. Time lag - first result
Not applicable
14.1.2. Time lag - final result
Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year e.g. e-commerce).
At national level:
No deviation.
14.2. Punctuality
See detailed section below.
14.2.1. Punctuality - delivery and publication
Data were delivered to Eurostat on 30 September 2024.
15.1. Comparability - geographical
The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data.
Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I. Completeness “ - worksheets related to questionnaire, coverage, additional questions.
Comparability between regions:
Data on NUTS 2 regional level were not delivered
Detailed information on the provision of data on NUTS 2 regional level is available in “Annex I. Completeness“ – worksheets related to regional data.
15.1.1. Asymmetry for mirror flow statistics - coefficient
Not applicable
15.2. Comparability - over time
See detailed section in the Full metadata report.
15.2.1. Length of comparable time series
The length of comparable time series depends on the module and the variable considered within each survey module. Additional information is available in annexes attached to the European metadata.
No changes in the national survey from the previous years.
15.3. Coherence - cross domain
Not applicable
15.3.1. Coherence - sub annual and annual statistics
Not applicable
15.3.2. Coherence - National Accounts
Not applicable
15.4. Coherence - internal
Not applicable
Restricted from publication
17.1. Data revision - policy
The data revision policy and notification of corrections are described in the section Principles of dissemination of official statistics of the website of Statistics Estonia.
The published data may be revised if the methodology is modified, errors are discovered, new or better data become available.
17.2.1. Data revision - average size
Not requested
18.1. Source data
A) Frame population description and distribution
For more information see concept 18.1.1.
B) Sampling design - Sampling method
Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata:
The stratified simple random sampling method was used. The frame was stratified by economic activity (NACE Rev.2 2-digit level) and number of persons employed. By number of persons employed enterprises were divided into following size groups: 10-19, 20-49; 50-99; 100-249; 250+. The Neyman optimal allocation was used for sample allocation and determination of sample size in strata. Sampling is used for enterprises 10 to 49 persons employed, enterprises with 50 and more persons employed are all sampled. Sample was drawn using permanent random numbers. The choice of starting point between 0 and 1 guarantee non-overlap with two large sample surveys: wages survey and SBS survey.
C) Gross sample distribution
More detailed information is available in “ Annex III. Sample and standard error tables 2024 “ (Worksheet: GROSS SAMPLE)
D) Net sample distribution
More detailed information is available in “ Annex III. Sample and standard error tables 2024 “ (Worksheet: NET SAMPLE)
18.1.1. Sampling design & Procedure frame
A) Description of frame population
a) When was the sample for the ICT usage and e-commerce in enterprise survey drawn?
22 November 2023
b) Last update of the Business register that was used for drawing the sample of enterprises for the survey:
The updated statistical profile is compiled in November every year and it is used for producing SBS for the same year and short-term statistics for the next year. All economically active units and all units active during at least a part of the reference period are included in the statistical profile.
c) Indication if the frame population is the same as, or is in some way coordinated with, the one used for the Structural Business Statistics (different snapshots):
For the population described in the ICT-survey the same frame is usedas for the SBS 2023 survey. Diffrently from SBS the enterprises which may start the activity in 2024 are included and enterprises which deceased in 2023 are excluded.
d) Description if different frames are used during different stages of the statistical process (e.g. frame used for sampling vs. frame used for grossing up):
No
e) Indication the shortcomings in terms of timeliness (e.g. time lag between last update of the sampling frame and the moment of the actual sampling), geographical coverage, coverage of different subpopulations, data available etc., and any measures taken to correct it, for this survey.
No shortcomings
B) Frame population distribution
More detailed information is available in “ Annex III. Sample and standard error tables 2024 “ (Worksheet: FRAME POPULATION)
18.2. Frequency of data collection
Annual
18.3. Data collection
See detailed sections below.
18.3.1. Survey period
Survey / Collection
Date of sending out questionnaires
Date of reception of the last questionnaire treated
General survey
February 2024
July 2024
Micro-enterprises
No micro-enterprises were covered
No micro-enterprises were covered
18.3.2. Survey vehicle – general survey
General survey - Stand-alone survey
18.3.3. Survey vehicle – micro-enterprises
Not applicable
18.3.4. Survey type
Online channel for compiling and transmitting reports (eSTAT), available starting January 2023. Enterprises were informed of all surveys in which they participate in December 2022.
Spreadsheet reports transmitted through the web (questionnaires downloaded from the web page).
Paper reports sent by e-mail (questionnaires printed from the web page).
18.3.5. Survey participation
Mandatory
18.4. Data validation
Most errors are already eliminated by submitting eSTAT data in the electronic environment. In addition, the data also undergo a processing check in the VAIS environment. There, a supplementary comparison of the data at enterprise level with the previous period(s) is carried out. In case of major discrepancies, the data are sent back to the processing department, where the data controllers clarify the discrepancies with the enterprise and make corrections where necessary.
Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises.
The legal basis for ICT enterprise statistics for survey year 2024 is Commission Implementing Regulation (EU) 2023/1507 of 20 July 2023 laying down the technical specifications of data requirements for the topic 'ICT usage and e-commerce' for the reference year 2024.Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age.
Furthermore, ICT data facilitate the monitoring of the EU’s digital targets for 2030, set by the Digital Decade Policy Programme. Four of the key performance indicators (KPIs) of the current programme stem from the statistics for which the implementing and delegated acts are enclosed for adoption: Artificial Intelligence, cloud, big data (data analytics) and the digital intensity index for businesses (DII) - a composite indicator reflecting the digital transformation of business. The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.
Name of data collection
In Estonian “Infotehnoloogia ettevõttes”, in English “ICT usage in enterprises”
13 February 2025
The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following topics:
Access to and use of the Internet;
E-commerce and e-business;
ICT specialists and skills;
ICT security;
Artificial Intelligence.
The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey.
Enterprise.
Target Population
As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons are covered by the survey.
For micro-enterprises see the sub-concepts below.
Enterprises with 10 and more employees and self-employed persons are covered by the survey
Detailed information on the provision of data on NUTS 2 regional level is available in “Annex I.
Completeness“. All territory of Estonia is covered.
The reference period have been followed
Comments on reliability and representativeness of results and completeness of dataset
These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates).
More detailed information is available in “ Annex II. Accuracy “ - related to European aggregates, comments on reliability and use of flag.
Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons, Million euro (for selected indicators in some countries).
Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata:
The stratified simple random sampling method was used. The frame was stratified by economic activity (NACE Rev.2 2-digit level) and number of persons employed. By number of persons employed enterprises were divided into following size groups: 10-19, 20-49; 50-99; 100-249; 250+. The Neyman optimal allocation was used for sample allocation and determination of sample size in strata. Sampling is used for enterprises 10 to 49 persons employed, enterprises with 50 and more persons employed are all sampled. Sample was drawn using permanent random numbers. The choice of starting point between 0 and 1 guarantee non-overlap with two large sample surveys: wages survey and SBS survey.
C) Gross sample distribution
More detailed information is available in “ Annex III. Sample and standard error tables 2024 “ (Worksheet: GROSS SAMPLE)
D) Net sample distribution
More detailed information is available in “ Annex III. Sample and standard error tables 2024 “ (Worksheet: NET SAMPLE)
Annual
See detailed section in the Full metadata report.
The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data.
Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I. Completeness “ - worksheets related to questionnaire, coverage, additional questions.
Comparability between regions:
Data on NUTS 2 regional level were not delivered
Detailed information on the provision of data on NUTS 2 regional level is available in “Annex I. Completeness“ – worksheets related to regional data.
