NATIONAL INSTITUTE OF STATISTICS

Division of Social Statistics

Bucharest, Romania

The EU survey on the use of ICT in households and by individuals is an annual survey conducted since 2002. In Romania, it has been conducted since 2007.

In 2022, the survey collects data on the access to information and communication technologies (ICT), on the use of the internet, e-government, e-commerce, internet of things, as well as green ICT.

National language:  Ancheta privind accesul la tehnologia informatiilor si comunicatiilor in gospodarii 2022 (TIC)

English: “ICT usage in households and by individuals”

Questionnaire(s) in national language(s) and the translation in English are available in the annexes below.

The following common concepts and definitions apply under the Integrated European Social Statistics (IESS):

• the International Standard Classification of Education (ISCED) 2011 published in the following breakdowns: low (ISCED levels 0-2: no formal education, primary education or lower secondary education), medium (ISCED levels 3-4: upper secondary or post-secondary non-tertiary education) and high (ISCED levels 5-6: tertiary programmes which normally need a successful completion of ISCED 3 or 4, or second-stage tertiary education leading to an advanced research qualification);
• the International Standard Classification for Occupation ISCO-08 at the 2-digit level;
• the Classification of Economic Activities (NACE Rev.2-2008), at section level;
• the Common classification of territorial units for statistics (NUTS 1) – finer granularity of NUTS 2 is provided on optional basis by some Member states;
• the SCL - Geographical code list;
• information about household income is provided at lower level of detail.

Additional classifications used in the national questionnaire:

No additional classifications

The ICT survey in households and by individuals covers those households having at least one member in the age group 16 to 74 years old. Internet access of households refers to the percentage of households that have an internet access, so that anyone in the household could use the internet.

No differences at national level.

The survey is collecting data of internet users, individuals who have used the internet in the three months prior to the survey. Regular internet users are individuals who used the internet, on average, at least once a week in the three months prior to the survey.

This annual survey is used to benchmark ICT-driven developments, both by following developments for core variables over time and by looking in greater depth at other aspects at a specific point in time. While the survey initially concentrated on access and connectivity issues, its scope has subsequently been extended to cover a variety of subjects (for example, the use of e-government and e-commerce) and socioeconomic analysis (such as regional diversity, gender specificity, differences in age, education and the employment situation). The scope of the survey with respect to different technologies is also adapted so as to cover new product groups and means of delivering communication technologies to end-users.

For more details on the methodology applicable in each survey year, please consult the Methodological Manual for the respective year on CIRCABC - Methodological Manual - Information society statistics (europa.eu).

Deviations from standard ICT concepts:  No deviations

Households and Individuals

In the ICT usage survey, the target population for the different statistical units is:

- individuals: all individuals aged 16 to 74;

- households: all (private) households with at least one member aged 16 to 74. 

Target population composed of households and/or individuals:

• Number of households: 7 542 131
• Number of individuals:  14 356 233

Non-compulsory age groups also included in the target population:

The survey covered whole country.

Year 2022

Not applicable

Percentages of ‘Households’ and Percentages of ‘Individuals’

In general, data refer to the first quarter of the reference year and the last 12 months for use of e-Government.

The fieldwork was realized in the period 01 April 2021 – 14 April 2022.

The legal basis for the 2022 EU survey on the use of ICT in households and by individuals is the Regulation (EU) 2019/1700 of the European Parliament and of the Council of 10 October 2019 establishing a common framework for European statistics relating to persons and households, based on data at individual level collected from samples (OJ  L 261 I, 14.10.2019, p. 1), as implemented by the Commission Implementing Regulation (EU) 2021/1223 of 27 July 2021 specifying the technical items of the data set, establishing the technical formats for transmission of information and specifying the detailed arrangements and content of the quality reports on the organisation of a sample survey in the use of information and communication technologies domain for reference year 2022 pursuant to Regulation (EU) 2019/1700 of the European Parliament and of the Council (OJ L 2269, 27.07.2021, pp. 1-45).

Complementary national legislation constituting the legal basis for the survey on the use of ICT in households and by individuals:  

Law on the organization and functioning of official statistics in Romania, with subsequent amendments and completions Legea nr.226/2009.

Not applicable

Confidentiality Policy can be viewed accessing the following link: https://insse.ro/cms/ro/content/norme-de-confiden%C8%9Bialitate

The data collection complies with the provisions of Regulation (EU) 2016/679 on the protection of individuals regarding the processing of personal data and the free movement of such data.

Access to the release calendar information: Statistical Publication and Services

In line with the Community legal framework and the European Statistics Code of Practice Romania disseminates statistics on Romanian’s website www.insse.ro respecting professional independence and in an objective, professional and transparent manner in which all users are treated equitably. The detailed arrangements are governed by the Romania protocol on impartial access to Romania data for users and acces to microdata.

Annual

Annual news release online in December of the survey year. Link: Press release ICT in households and by individuals

Annual publication Accesul populatiei la Tehnologia Informatiei si Comunicatiilor in December of the survey year.

The disseminated data can be accessed free in database of NIS Romania TEMPO online.

TEMPO Database from site of NIS Romania: Tempo ONLINE

Microdata are available for scientific purposes.

Microdata

Not available

The Methodological Manuals used for the survey on ICT usage in households / by individuals are annually compiled by Eurostat in co-operation with Member States.

Metadatabase of site NIS Romania can be accessed on the link: Metadatabase

100%

Quality guidelines for official statistics in Romania Guidelines

The Methodological Manual provides guidelines and standards for the implementation of the surveys in the Member States. It is updated every year according to the changed contents of the model questionnaires.

ICT usage statistics have overall good quality. The surveys are considered as reliable sources applying high standards with regard to the methodology. Like other surveys, the ICT usage surveys are based on a sample of the population. The results are therefore subject to the usual types of errors associated with random sampling.

The Quality Report describe the general and some more specific methodological characteristics related to the various stages of the national survey in households / by individuals (e.g. survey type, statistical units and target population, stratification and sampling design, information on item and unit non-response, grossing-up procedures, standard error calculations, sample sizes, response rates, data collections methods etc).

At national level, the principal users are: Government of Romania , ministries, institutions of public administration, researche institutes, mass media.

At European level, European Commission users (e.g. DG CNECT, DG GROW, DG JUST, DG REGIO, DG JRC) are the principal users of the data on ICT in households and by individuals and contribute in identifying/defining the topics to be covered. Hence, main users are consulted regularly (at hearings, task forces, ad hoc meetings) for their needs and are involved in the process of the development of the model questionnaires at a very early stage.

User needs are considered throughout the whole discussion process of the model questionnaires aiming at providing relevant statistical data for monitoring and benchmarking of European policies.

No information is available on the extent to which indicators meet the needs of users.

All of the variables contained in ICT household transmission format 2022 have been included in the microdata files excluding the variable Region of residence – NUTS 3.

100%

In the survey on the use of ICT in households and by individuals, while computing the ratios, NIS Romania flags as unreliable ratios which denominators represent less than
20 households/individuals and consequently does not publish them.

The sampling error reflects the fact that only a particular sample was surveyed rather than the entire population. It is estimated by the standard error and can be expressed by the square root of the estimate of the sampling variance . The estimation of the sampling variance should ideally take into account the sampling design (e.g. the stratification).

Estimation method for the random variation of an estimator due to sampling: Taylor linearization

Basic formula: Since the proportion estimator is actually an estimator of the mean for an indicator variable, the procedure computes its variance and standard error according to the formula outlined in the section " Variance and Standard Error of the Mean”, chapter SURVEYMEANS procedure in SAS.

References on the estimation method are found in: Deville and Särndal (1992);  Särndal(1992)

For variance estimation, the software used until 2022 round is SAS with Survey means procedure. Starting from 2023 round, we will perform the Taylor linearization method for variance estimation in the package ReGenesees (Zardetto, 2015, 2022) in R (R Core Team, 2022). References on the software:

• R Core Team (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
• Zardetto D (2015). “ReGenesees: an Advanced R System for Calibration, Estimation and Sampling Error Assessment in Complex Sample Surveys.” Journal of Official Statistics, 31(2), 177 - 203. https://sciendo.com:443/article/10.1515/jos-2015-0013.
• Zardetto D (2022). “ReGenesees: R Evolved Generalized Software for Sampling Estimates and Errors in Surveys.” R package version 2.2.

Precision estimates for the question "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Number of respondents (absolute value for ‘Yes’ answers):   6 725

Estimated proportion (in %):   45.73

Standard error (in percentage points):   1.05

Details of the breakdowns are available in the annexes below. 

See more details on non-sampling error below.

Over-coverage rates were estimated on the basis of the survey sample, as ratio between number of not-eligible units (ineligible out-of-scope and other ineligible) and number of sampled units. It is 14.77%.
Under-coverage rate was estimated as the ratio between number of new permanent dwellings, built in the period end of 2011 year (the year of the last census) - end of 2021 year and the number of dwellings at the end of 2021 year. It is 4.33%

14.77%

Not requested in the ICT survey.

1)       Measurement errors:  

The main methods of reducing measurement errors:
- Introductory letter of inquiry
- Regular training (at least once a year)
- Feedback from interviewers (reports, debates, etc.)
- Monitoring direct contact with households
- Remote monitoring via performance indicators
- Online checks (for computer-assisted interviews)

2)       Questionnaire design and testing:  

The questionnaire is designed to ensure the quality of the data collected. The logical control conditions are met by introducing validation conditions in the questionnaire design. The validation rules act simultaneously with the completion of the questionnaire. They provide certain limits and patterns of answers so as to eliminate random answers or wrong manual entries. The deviation from the validation condition is notified by the investigator through the vibration of the tablet. These deviations can be stipulated either as warnings or as errors.

3)       Interviewer training:  

In 2022, at central and at the territorial level (NIS) there were training sessions face-to-face with interviewers and supervisors.
The following documents were sent by email at territorial level:
- the survey manual containing instructions for completing the questionnaire designed according to the Eurostat methodology
- instructions for using the tablet and the CAPI collection application.

4)       Proxy interview rates:  10.55%

Information about non-respondents:  11.44%

The cases of non-response are predominantly in the urban environment. The causes that generated the non-response are given first of all by the fact that the households refused the interview, then by the fact that the households were impossible to contact or were absent. On the other hand, in the rural area, the percentage of unoccupied houses is higher compared to those in the urban area.

The highest non-response rate is in the city of Bucharest, with a preponderance in the "rich" sectors of the capital.

The unit response rate is the ratio of the number of in-scope respondents (= the number of achieved interviews or the net sample size to the number of eligible elements selected from the sampling frame).

Unit non-response rate for

• Households:   11.44%
• Individuals (aged 16-74):   Not applicable

Comments, if any:

1)       Methods used for dealing with unit non-response:

Unit non-responses are adjusted in the weighting procedure by:
• re-weighting with the inverse of the response rate on response homogeneous groups. These groups were built by the combination of the following variables: county and residence area of the household (stratum).
• re-weighting by calibration of the weights.

2)       Methods used for minimizing unit non-response:

The measures taken to reduce the unit non-response are:
- advance notification in the form of a letter containing the main subjects of the survey, showing to the respondents how the data they are providing are being used and ensuring the confidentiality of data according to GDPR;
- establishing by mutual agreement with the respondents the date of interview;
- at least two visits to households which were not found at the first visit.

3)       Substitution permitted:  No

4)       Substitution rate (in %):  0 %

Items with low response rates (observed rates in %):  0 %

Not applicable

Not requested for ICT Survey

The microdata files were be sent to Eurostat in the fourth quarter of the survey year according to the deadline laid down in Regulation (EU) 2019/1700.

Deadline met.

0 days

There are no problems of comparability between the regions of the country.

Not relevant

Possible limitations in the use of data for comparisons over time:

Beginning with year 2014, the data were estimated based on the resident population on 01 January of the survey year and are not comparable with the data series for previous periods.

The length of comparable time series depends on the module and variable considered within each of the modules of the survey.

Not applicable

Not applicable

Not applicable

All statistics are coherent within the dataset.

MANDATORY questions in the Eurostat model questionnaire 2022:

The table in the annexes below lists the questions that do not reflect the coverage of subjects and characteristics of Annex 2 of the Commission Delegated Regulation (EU) 2021/1898 of the 20 July 2021. 

Adoption of OPTIONAL questions and items in the Eurostat model questionnaire 2022:

The table in the annexes below lists the optional questions from the annual Eurostat model questionnaire 2022 included in the national questionnaire and their coverage for age groups beyond the standard scope. 

Additional questions introduced in the national questionnaire:  

No additional questions have been added to Eurostat questionnaire

Effects of deviations from the routing used in the Eurostat model questionnaire:  

All statistics are coherent within the dataset

Not applicable.

There are no revisions to report.

Not relevant

The source of the raw data is described with more details in the paragraphs below.

The sample of ICT 2022 survey is drawn from sample frame named EMZOT i.e. the Multifunctional Sample of Territorial Areas comprising 792 research centres (i.e. primary sampling units), across the counties and sectors of Bucharest municipality (NUTS 3 level). Current sampling frame was carried out based on the data from the Population and Housing Census 2011 round.

The ICT survey is a stand-alone survey and is mandatory, according to national statistical law.

There are no shortcomings in terms of timeliness, geographical coverage or coverage of different subpopulations.

ICT sampling design is founded on a two-stage sampling technique.
In the first stage, a stratified random sample of centres of research, Primary Sampling Units (PSU’s) was designed after the 2011 Population and Housing Census, using as stratification criteria the residence area and county (NUTS-3 level) and selected based on a systematic selection algorithm. The primary sampling unit, corresponding to the selection of the master sample, is a group of census section. The including probabilities from the first stage were proportional calculated with the size, expressed in number of permanent dwellings.
In the second stage, dwellings are systematically selected from the initial sample of PSU’s: 12 from urban PSU’s and 14 from rural PSU’s. The secondary (ultimate) sampling unit, corresponding to the selection of the survey sample, has been the dwelling (all households are included). The final sample consists of 10 188 dwelling units.

Number of individuals interviewed in the household: all members aged 16-74

Annual

1) Methods used to gather data:

Data are collected by the CAPI method.

2) Short description of the survey method:

The information is collected by face-to-face interview at the home of the households under observation, the main role being the statistical operator, who must ensure the proper conduct of the interview (presentation of the purpose and specificity of the survey, appropriate wording of questions, possible explanations in case of misunderstandings etc.). Data collection is performed using statistical questionnaires designed according to the Eurostat methodology.

3) Variables completed from an external source:  Not applicable

The Survey Solution system is used for data collection on CAPI questionnaire. The data processing flow is as follows:

At the level of the interviewer:
- the primary validation of the data is performed when completing the questionnaire on the tablet due to the logical control conditions that ensure: checking the logical flows from the questionnaires, observing the correlations between the answers to different questions, identifying and eliminating illogical answers;
- corrections are made or explanations are given in case of questionnaires with errors / warnings;

At the level of survey's supervisor (regional / county statistical directions):
- the mode of completing the questionnaires is verified (it is rejected the questionnaires to the interviewer or it is validated);
- the variables are coded from the required format (text);
- integrity check is performed and data is validated;

At the central level:
- the data are validated and it is verified the conformity with the sample of ICT survey; following this inventory it is established whether the sample has been fully investigated, whether there are cases of response or non-response;
- the data processing procedure continues with the verification of the variables from a qualitative and quantitative point of view. Is calculated the frequencies of the variables and checks whether the target population has answered the questions.

Not applicable

For the target indicator "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Imputation rate (% of observations): Not applicable

Imputation rate (share of estimate): Not applicable

Methods used to impute item non-response:  Not relevant

Grossing up procedures have been applied to: Households

Description of the weighting procedures:

The weights are calculated in three steps. The first step assigns the inverse of the selection probabilities to each sampled dwelling unit. The second step adjusts for nonresponse at strata level, categorising the responding dwelling units by the following characteristics: county (NUTS 3 level) and urban/rural residency. The third and final steps consists of calibrating the secondary weights to the best latest available population totals by region / urban-rural residency, gender, 6 age groups and the households totals by region (NUTS 2 level), using the SAS macro Calmar.
In the calculation of weighting factors, the totals known for resident population level from current demographic statistics, recalculated on 2011 Census population, available at 01 January survey year are used.
Each person belonging to a respondent household is receiving the household weight.

Not relevant

Not relevant