ICT usage in enterprises (isoc_e)

National Reference Metadata in SIMS structure for INFOSOC Enterprises

Compiling agency: Statistics Estonia


Eurostat metadata
Reference metadata
1. Contact
2. Metadata update
3. Statistical presentation
4. Unit of measure
5. Reference Period
6. Institutional Mandate
7. Confidentiality
8. Release policy
9. Frequency of dissemination
10. Accessibility and clarity
11. Quality management
12. Relevance
13. Accuracy
14. Timeliness and punctuality
15. Coherence and comparability
16. Cost and Burden
17. Data revision
18. Statistical processing
19. Comment
Related Metadata
Annexes (including footnotes)



For any question on data and metadata, please contact: Eurostat user support

Download


1. Contact Top
1.1. Contact organisation

Statistics Estonia

1.2. Contact organisation unit

Economic and Environmental Statistics Department

1.5. Contact mail address

Tatari 51, 10134 Tallinn


2. Metadata update Top
2.1. Metadata last certified 07/03/2024
2.2. Metadata last posted 07/03/2024
2.3. Metadata last update 07/03/2024


3. Statistical presentation Top
3.1. Data description

Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises.

Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age. Part of this is the "European strategy for data", envisioning a single market for data to ensure the EU's global competitiveness and data sovereignty, in which context a comprehensive set of new rules for all digital services was proposed: the Digital Services Act and the Digital Markets Act, which are centrepieces of the EU digital strategy. Furthermore, the Commission and the High Representative of the Union for Foreign Affairs and Security Policy presented a new “EU cybersecurity strategy”, which is intended to bolster the EU's collective resilience against cyber threats, safeguard a global and open internet and protect EU values and the fundamental rights of its people. Furthermore, data will allow monitoring the progress towards  A Europe fit for the digital age, one of the six priorities for the period 2019-2024 of the von der Leyen European Commission.

The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.

 In Estonian “Infotehnoloogia ettevõttes”, in English “ICT usage in enterprises”
3.2. Classification system

 NACE Rev.2 2008

3.3. Coverage - sector

All economic activities in the scope of Annex I of the Commission Regulation are intended to be included in the general survey, covering enterprises with 10 or more employees and self-employed persons. These activities are: NACE Rev. 2 sections C, D, E, F, G, H, I, J, L, M and N, division 95.1.

For micro-enterprises see the sub-concepts below.

3.3.1. Coverage-sector economic activity for micro-enterprises - All NACE Rev. 2 categories are covered
3.3.2. Coverage sector economic activity for micro-enterprises - If not all activities were covered, which ones were covered?

Micro-enterprises are not included in the survey

3.4. Statistical concepts and definitions

The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following areas:

-          Access to and use of the Internet

-          E-commerce and e-business

-          Use of cloud computing services

-          Artificial Intelligence

-          Other topics: Data utilisation, sharing, analytics and trading, Invoicing.

The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey.

3.5. Statistical unit

Statistical unit is enterprise

3.6. Statistical population

Target Population

As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons shall be covered by the survey.

For micro-enterprises see the sub-concepts below.

3.6.1. Coverage of micro-enterprises
No
3.6.2. Breakdown between size classes [0 to 1] and [2 to 9]
No
3.6.3. If for micro-enterprises different size delimitation was used, please indicate it.

Not applicable

3.7. Reference area

All territory of Estonia is covered

3.8. Coverage - Time

Years 2022 and 2023.

3.9. Base period

Not applicable


4. Unit of measure Top

Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons, Million euro.


5. Reference Period Top

Yes, we have followed the reference period


6. Institutional Mandate Top
6.1. Institutional Mandate - legal acts and other agreements

Complementary national legislation constituting the legal basis for the survey on the use of ICT in enterprises:

No complementary national legislations

6.2. Institutional Mandate - data sharing

Not applicable


7. Confidentiality Top
7.1. Confidentiality - policy

Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.

At national level : 

The dissemination of data collected for the purpose of producing official statistics is guided by the requirements provided for in § 32, § 34, § 35, § 38 of the Official Statistics Act.



Annexes:
Riikliku statistika seadus (lühend - RStS)
7.2. Confidentiality - data treatment

Data are transmitted via eDamis (encrypted) and delivered to a secure environment where they are treated. Flags are added for confidentiality in case results must not be disclosed.

At national level : 

The treatment of confidential data is regulated by the Procedure for Protection of Data Collected and Processed by Statistics Estonia (in Estonian). See more details on the website of Statistics Estonia in the section Õigusaktid.



Annexes:
Õigusaktid


8. Release policy Top
8.1. Release calendar

Release calendar of Statistics EStonia

8.2. Release calendar access

 



Annexes:
Release calendar of Statistics Estonia
8.3. Release policy - user access

Please complete for the Quality report.All users have been granted equal access to official statistics: dissemination dates of official statistics are announced in advance and no user category (incl. Eurostat, state authorities and mass media) is provided access to official statistics before other users. Official statistics are first published in the statistical database. If there is also a news release, it is published simultaneously with data in the statistical database. Official statistics are available on the website at 8:00 a.m. on the date announced in the release calendar


9. Frequency of dissemination Top

Annual


10. Accessibility and clarity Top
10.1. Dissemination format - News release

The release was published in 15th of September



Annexes:
Release
10.2. Dissemination format - Publications

No publications in paper format.

10.3. Dissemination format - online database

See detailed section 10.3.1.

10.3.1. Data tables - consultations

Results for selected variables collected in the framework of this survey are available for all participating countries on Digital economy and society of Eurostat website.

At national level :

Statistical database



Annexes:
Statistical database
10.4. Dissemination format - microdata access

Not applicable.

10.5. Dissemination format - other

Not requested

10.5.1. Metadata - consultations

Not requested

10.6. Documentation on methodology

National Handbook in national language



Annexes:
Handbook
10.6.1. Metadata completeness - rate

Not requested

10.7. Quality management - documentation

There is no national quality management documentation and studies avalable


11. Quality management Top
11.1. Quality assurance

The European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises provides guidelines and standards for the implementation of the surveys. It is updated every year according to the changed contents of the model questionnaires.

At national level :

To assure the quality of processes and products, Statistics Estonia applies the EFQM Excellence Model, the European Statistics Code of Practice and the Quality Assurance Framework of the European Statistical System (ESS QAF). Statistics Estonia is also guided by the requirements in § 7. “Principles and quality criteria of producing official statistics” of the Official Statistics Act.



Annexes:
Riikliku statistika seadus (lühend - RStS)
11.2. Quality management - assessment

European level :

At European level, the recommended use of the annual Eurostat model questionnaire aims at improving comparability of the results among the countries that conduct the survey on ICT usage and e-commerce in enterprises. Moreover, the Methodological Manual provides guidelines and clarifications for the implementation of the surveys.

National level :

Statistics Estonia performs all statistical activities according to an international model (Generic Statistical Business Process Model – GSBPM). According to the GSBPM, the final phase of statistical activities is overall evaluation using information gathered in each phase or sub-process; this information can take many forms, including feedback from users, process metadata, system metrics and suggestions from employees. This information is used to prepare the evaluation report which outlines all the quality problems related to the specific statistical activity and serves as input for improvement actions.


12. Relevance Top
12.1. Relevance - User Needs

European level : 

At European level, European Commission users (e.g. DG CNECT, DG GROW, DG JUST, DG REGIO, DG JRC) are the principal users of the data on ICT usage and e-commerce in enterprises and contribute in identifying/defining the topics to be covered. Hence, main users are consulted regularly (at hearings, task forces, ad hoc meetings) for their needs and are involved in the process of the development of the model questionnaires at a very early stage.

User needs are considered throughout the whole discussion process of the model questionnaires aiming at providing relevant statistical data for monitoring and benchmarking of European policies.

National level :

Ministry of Economic Affairs and Communications.

12.2. Relevance - User Satisfaction

European level : 

At European level, contacts within the Commission, the OECD and other stakeholders give a clear picture about the key users' satisfaction as to the following data quality aspects: accuracy and reliability of results, timeliness, satisfactory accessibility, clarity and comparability over time and between countries, completeness and relevance. Overall users have evaluated positively (good, very good) the data quality on the ICT usage and e-commerce in enterprises.

National level :

Since 1996, Statistics Estonia has conducted reputation and user satisfaction surveys. All results are available on the website of Statistics Estonia in the section User surveys.



Annexes:
User satisfaction surveys
12.3. Completeness

Detailed information is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

12.3.1. Data completeness - rate

Not requested. 


13. Accuracy Top
13.1. Accuracy - overall

Comments on reliability and representativeness of results and completeness of dataset

These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates).

More detailed information is available in “ Annex II. _ Accuracy “ excel file - related to European aggregates, comments on reliability and use of flag.

13.2. Sampling error

For calculation of the standard error see 13.2.1.1.

13.2.1. Sampling error - indicators

Standard error (for selected indicators and breakdowns)

Precision measures related to variability due to sampling, unit non-response (the size of the subset of respondents is smaller than the size of the original sample) and other (imputation for item non-response, calibration etc.) are not (yet) required from the Member states for all indicators.  Eurostat will make basic assumptions to compute these measures for all indicators produced (e.g. stratified random sampling assuming as strata the crossing of the variables “Number of employees and self-employed persons” and “Economic Activity” as it was defined in the 3 tables of section 18.1).

More detailed information is available in“ Sample and standard error tables 2023 “ excel file – worksheets starting with “Standard error".

13.2.1.1. Sampling error indicator calculation

Calculation of the standard error

Various methods can be used for the calculation of the standard error for an estimated proportion. The aim is to incorporate into the standard error the sampling variability but also variability due to unit non-response, item non-response (imputation), calibration etc. In case of census / take-all strata, the aim is to calculate the standard errors comprising the variability due to unit non-response and item non-response.

a) Name and brief description of the applied estimation approach
 Standard errors are calculated with the programm CLAN, algoritm of which are based on Taylor linea.

 

b) Basic formula
 Programm CLAN, algoritm of which are based on Taylor linearisation.

 

c) Main reference in the literature
 Model Assisted Survey Sampling (Särndal, Swensson, Wretman, 1991).

 

d) How has the stratification been taken into account? 
 Stratification has been taken into account, see formulas in section b.

 

e) Which strata have been considered? 
 Sampling design strata have been considered.
13.3. Non-sampling error

See detailed sections below.

13.3.1. Coverage error

See concept 18.1.1. A) Description of  frame population.

13.3.1.1. Over-coverage - rate

Out of scope 28 enterprises

13.3.1.2. Common units - proportion

Not requested

13.3.2. Measurement error

No measurement errors detected.

13.3.3. Non response error

See detailed sections below.

13.3.3.1. Unit non-response - rate

See detailed sub-concepts below.

13.3.3.1.1. Unit response

The following table contains the number of units (i.e. enterprises), by type of response to the survey and by the percentage of these values in relation to the gross sample size.

 

Type of response Enterprises
0-9 employees and self-employed persons 10 or more employees and self-employed persons
Number % Number %
Gross sample size (as in section 3.1 C)   100%  3067 100%
1. Response (questionnaires returned by the enterprise)     2657 86,6
1.1 Used for tabulation and grossing up (Net sample or Final Sample; as in section 3.1 D)     2629 85,7
1.2 Not used for tabulation     28  0,9
1.2.1 Out of scope (deaths, misclassified originally in the target population, etc.)      28 0,9
1.2.2 Other reasons (e.g. unusable questionnaire)      0  0
2. Non-response (e.g. non returned mail, returned mail by post office)     410 13,4

 

Comments on unit response, if unit response is below 60%
 
13.3.3.1.2. Methods used for minimizing unit non-response

Automatic reminders: 2 preventive reminders —8 days and 1 day before the deadline, 3 reminders after deadline—3 days, 7 days and 37 days after deadline. Additionally the telephone contacts were made if needed.

13.3.3.1.3. Methods used for unit non-response treatment
1. No treatment for unit non-response  
2. Treatment by re-weighting
2.1 Re-weighting by the sampling design strata considering that non-response is ignorable inside each stratum (the naïve model)  x
2.2 Re-weighting by identified response homogeneity groups (created using sample-level information)  
2.3 Re-weighting through calibration/post-stratification (performed using population information) by the groups used for calibration/post-stratification  
3. Treatment by imputation (done distinctly for each variable/item)  
4. Method(s) and the model(s) corresponding to the above or other method(s) used for the treatment of unit non-response. (e.g. Re-weighting using Horvitz-Thompson estimator, ratio estimator or regression estimator, auxiliary variables )
In case there were no data about a nonrespondent, it was assumed that the percentage of active enterprises in the nonresponse group was the same as in the response group
13.3.3.1.4. Assessment of unit non-response bias

No response rate below 60%.

13.3.3.2. Item non-response - rate

There was no item with response rate below 90% in the questionnaire.

13.3.3.2.1. Methods used for item non-response treatment
1. No treatment for item non-response  x
2. Deductive imputation
An exact value can be derived as a known function of other characteristics.
 
3. Deterministic imputation (e.g. mean/median, mean/median by class, ratio-based, regression-based, single donor nearest-neighbour)
Deterministic imputation leads to estimators with no random component, that is, if the imputation were to be re-conducted, the outcome would be the same
 
4. Random imputation (e.g. hot-deck, cold-deck)
Random imputation leads to estimators with a random component, that is, if the imputation were re-conducted, it would have led to a different result
 
5. Re-weighting  
6. Multiple imputation
In multiple imputation each missing value is replaced (instead of a single value) with a set of plausible values that represent the uncertainty of the right value to impute. Multiple imputation methods offer the possibility of deriving variance estimators by taking imputation into account. The incorporation of imputation into the variance can be easily derived based on variability of estimates among the multiply imputed data sets.
 
7. Method(s) and the model(s) corresponding to the above or other method(s) used for the treatment of item non-response.
 There was no need for item non-response treatment. The web questionnaire is structured in such a way that if any mandatory data fields are not filled in, the respondent will receive an error message and will not be able to validate or submit the questionnaire.
13.3.3.2.2. Questions or items with item response rates below 90% and other comments

Other comments relating to the item non-response

Additional issues concerning "non-response" calculation (e.g. method used in national publications).
-

 

Questions and items with low response rates (cut-off value is 90% ) and item non-response rate.
 There was no need for item non-response treatment.
13.3.4. Processing error

No processing erros identified.

13.3.5. Model assumption error

Not requested


14. Timeliness and punctuality Top
14.1. Timeliness

See detailed section below.

14.1.1. Time lag - first result

Not applicable

14.1.2. Time lag - final result

European level : 

Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year e.g. e-commerce).

At national level : 

No deviation.

14.2. Punctuality

 See detailed section below.

14.2.1. Punctuality - delivery and publication

The data were transmitted on time.


15. Coherence and comparability Top
15.1. Comparability - geographical

The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data.

Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

15.1.1. Asymmetry for mirror flow statistics - coefficient

Not applicable

15.2. Comparability - over time

See section below.

15.2.1. Length of comparable time series

The length of comparable time series depends on the module and the variable considered within each survey module. Additional information is available in annexes attached to the European metadata.

Not applicable.

15.3. Coherence - cross domain

We do not use information from other surveys therefore there is no impact on the coherence across domains. The only survey for which we use turnover data is SBS survey and there may be some impact due to different reference periods used.
There may be some impact due to different reference periods used – ICT use preliminary SBS data for turnover variable, as collection period of SBS survey is later and the final data are therefore available just in the end of year

15.3.1. Coherence - sub annual and annual statistics

 Not applicable

15.3.2. Coherence - National Accounts

Not applicable

15.4. Coherence - internal

Not applicable


16. Cost and Burden Top
Restricted from publication


17. Data revision Top
17.1. Data revision - policy

The data revision policy and notification of corrections are described in the section Principles of dissemination of official statistics of the website of Statistics Estonia.

17.2. Data revision - practice

The published data may be revised if the methodology is modified, errors are discovered, new or better data become available.

17.2.1. Data revision - average size

 Not requested


18. Statistical processing Top
18.1. Source data

A) Frame population description and distribution

For more information see concept 18.1.1.

 

B) Sampling design - Sampling method

Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata: 

The stratified simple random sampling method was used. The frame was stratified by economic activity (NACE Rev.2 2-digit level) and number of persons employed. By number of persons employed enterprises were divided into following size groups: 10-19, 20-49; 50-99; 100-249; 250+. The Neyman optimal allocation was used for sample allocation and determination of sample size in strata. Sampling is used for enterprises 10 to 49 persons employed, enterprises with 50 and more persons employed are all sampled. Sample was drawn using permanent random numbers. The choice of starting point between 0 and 1 guarantee non-overlap with two large sample surveys: wages survey and SBS survey.

 

C) Gross sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: GROSS SAMPLE)

 

D) Net sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: NET SAMPLE)

18.1.1. Population frame

A) Description of frame population

a) When was the sample for the ICT usage and e-commerce in enterprise survey drawn?  3.12.2022                      
b) When was the last update of the Business register that was used for drawing the sample of enterprises for the survey? The updated statistical profile is compiled in November every year and it is used for producing SBS for the same year and short-term statistics for the next year. All economically active units and all units active during at least a part of the reference period are included in the statistical profile.
c) Please indicate if the frame population is the same as, or is in some way coordinated with, the one used for the Structural Business Statistics (different snapshots) For the population described in the ICT-survey the same frame is usedas for the SBS 2022 survey. Diffrently from SBS the enterprises which may start the activity in 2023 are included and enterprises which deceased in 2022 are excluded.
d) Please describe if different frames are used during different stages of the statistical process (e.g. frame used for sampling vs. frame used for grossing up):  No
e) Please indicate shortcomings in terms of timeliness (e.g. time lag between last update of the sampling frame and the moment of the actual sampling), geographical coverage, coverage of different subpopulations, data available etc., and any measures taken to correct it, for this survey.  No shortcomings

 

 B) Frame population distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: FRAME POPULATION)

18.2. Frequency of data collection

Annual

18.3. Data collection

See detailed sections below.

18.3.1. Survey period
Survey / Collection Date of sending out questionnaires Date of reception of the last questionnaire treated
General survey  February 2023  July 2023
Micro-enterprises  Not applicable  Not applicable
18.3.2. Survey vehicle – general survey
General survey - Stand-alone survey
18.3.3. Survey vehicle – micro-enterprises
The collection of micro-enterprises was integrated with the general survey
18.3.4. Survey type

1) Online channel for compiling and transmitting reports (eSTAT), available starting January 2023. Enterprises were informed of all surveys in which they participate in December 2022

2) Spreadsheet reports transmitted through the web (questionnaires downloaded from the web page)

3) Paper reports sent by e-mail (questionnaires printed from the web page)

18.3.5. Survey participation
Mandatory
18.4. Data validation

Most errors are already eliminated by submitting eSTAT data in the electronic environment. In addition, the data also undergo a processing check in the VAIS environment. There, a supplementary comparison of the data at enterprise level with the previous period(s) is carried out. In case of major discrepancies, the data are sent back to the processing department, where the data controllers clarify the discrepancies with the enterprise and make corrections where necessary.

18.5. Data compilation

Grossing-up procedures

Grossing-up procedures.



Annexes:
Crossing-up Estonia
18.5.1. Imputation - rate

Imputation was not used

18.6. Adjustment

Not applicable

18.6.1. Seasonal adjustment

Not applicable


19. Comment Top

Problems encountered and lessons to be learnt: 

19.1. Documents
Questionnaire in national language  X
Questionnaire in English (if available)  X
National reports on methodology (if available)  
Analysis of key results, backed up by tables and graphs in English (if available)  
Other Annexes  X (Annex I Completeness 2023 EE; Annex II Accuracy 2023 EE; Standard and sample error tabeles 2023 EE)


Related metadata Top


Annexes Top
Questionnaire 2023 in national language
Questionnaire 2023 in English
Annex II._Accuracy 2023
Annex I._Completeness 2023
Sample and standard error table 2023