Statistics Netherlands

Statistical Analysis Department

CBS-weg 11

6412 EX Heerlen, the Netherlands

The EU survey on the use of ICT in households and by individuals is an annual survey conducted since 2002. In the Netherlands, it has been conducted since 2005.

In 2022, the survey collects data on the access to information and communication technologies (ICT), on the use of the internet, e-government, e-commerce, internet of things, as well as green ICT.

National language: 

Onderzoek ICT gebruik bij huishoudens en personen, 2022

English:

Survey on ICT usage in Households and by Individuals, 2022

Questionnaire(s) in national language(s) and the translation in English are available in the annex.

The following common concepts and definitions apply under the Integrated European Social Statistics (IESS):

• the International Standard Classification of Education (ISCED) 2011 published in the following breakdowns: low (ISCED levels 0-2: no formal education, primary education or lower secondary education), medium (ISCED levels 3-4: upper secondary or post-secondary non-tertiary education) and high (ISCED levels 5-6: tertiary programmes which normally need a successful completion of ISCED 3 or 4, or second-stage tertiary education leading to an advanced research qualification);
• the International Standard Classification for Occupation ISCO-08 at the 2-digit level;
• the Classification of Economic Activities (NACE Rev.2-2008), at section level;
• the Common classification of territorial units for statistics (NUTS 1) – finer granularity of NUTS 2 is provided on optional basis by some Member states;
• the SCL - Geographical code list;
• information about household income is provided at lower level of detail. 

Additional classifications used in the national questionnaire:

No additional classification is used

The ICT survey in households and by individuals covers those households having at least one member in the age group 16 to 74 years old. Internet access of households refers to the percentage of households that have an internet access, so that anyone in the household could use the internet.

No differences in scope

The survey is collecting data of internet users, individuals who have used the internet in the three months prior to the survey. Regular internet users are individuals who used the internet, on average, at least once a week in the three months prior to the survey.

This annual survey is used to benchmark ICT-driven developments, both by following developments for core variables over time and by looking in greater depth at other aspects at a specific point in time. While the survey initially concentrated on access and connectivity issues, its scope has subsequently been extended to cover a variety of subjects (for example, the use of e-government and e-commerce) and socio-economic analysis (such as regional diversity, gender specificity, differences in age, education and the employment situation). The scope of the survey with respect to different technologies is also adapted so as to cover new product groups and means of delivering communication technologies to end-users.

For more details on the methodology applicable in each survey year, please consult the Methodological Manual for the respective year on CIRCABC - Methodological Manual - Information society statistics (europa.eu).

Deviations from standard ICT concepts:

No deviation

Households and Individuals

In the ICT usage survey, the target population for the different statistical units is:

- individuals: all individuals aged 16 to 74;

- households: all (private) households with at least one member aged 16 to 74. 

Target population composed of households and/or individuals:

• Number of households:  7.3 million households with at least one member of 16-74 year.
  Date register: 1.4.2022

• Number of individuals: 13 million individuals aged 16-74 years old living in private households.
  Date register: 1.4.2022

Non-compulsory age groups also included in the target population:

The sampling frame is the Municipal Population Register (BRP). This population register contains all individuals who are registered in Dutch municipalities. It does not include homeless people or people living in institutions.

Advantage of using the Municipal Population Register is the actuality of information from the registered individuals. Information about birth, death, new addresses, household size is updated weekly and is incorporated in the mentioned register.

As drawing the sample has to be done 2 months before the data collection period, some deviation (such as moving, death) can occur.

Territorial coverage: The sample covers the total population in the Netherlands, aged 12 years and older, living in private households and registered in the Municipal Population Register. This register is the sampling frame for statistics in the Netherlands.

Year 2022

Not applicable

Percentages of ‘Households’ and Percentages of ‘Individuals’

The main reference period: Last three months before the interview

Survey period: from 18 March 2022 to 30 June 2022

The legal basis for the 2022 EU survey on the use of ICT in households and by individuals is the Regulation (EU) 2019/1700 of the European Parliament and of the Council of 10 October 2019 establishing a common framework for European statistics relating to persons and households, based on data at individual level collected from samples (OJ  L 261 I, 14.10.2019, p. 1), as implemented by the Commission Implementing Regulation (EU) 2021/1223 of 27 July 2021 specifying the technical items of the data set, establishing the technical formats for transmission of information and specifying the detailed arrangements and content of the quality reports on the organisation of a sample survey in the use of information and communication technologies domain for reference year 2022 pursuant to Regulation (EU) 2019/1700 of the European Parliament and of the Council (OJ L 2269, 27.07.2021, pp. 1-45).

Complementary national legislation constituting the legal basis for the survey on the use of ICT in households and by individuals: 

No complementary national [NL] legislation

The microdata of 2022 survey will be not shared with data producing agencies or other agencies. There is no agreement to facilitate data sharing and exchange between data producing agencies within the national statistical system.

Statistics Netherlands is legally bound to apply strict confidentiality rules concerning the dissemination of statistical results. These rules are fully applied to the figures published as a result of this survey on the ICT use.

Statistics Netherlands cannot report any details on the methods used, but assures that no statistical information can be linked to any individual person.

The anonymized micro-dataset of 2022 will be made available to a selected number of national research institutes for possible research in the field of ICT by 2024.

The national policy of Statistics Netherlands regarding statistical confidentiality is applied here. 

No release calendar available at this time about 2022 data.

Two tables about the results of 2022 are published online.

Links: Online table e-commerce and Online table Internet usage and online activities

Not applicable

Not applicable

Annual

Statistics Netherlands publishes the national results on the website of Statistics Netherlands.

In addition, several press releases are written annually. 

Statistics Netherlands publishes the national results on the website of Statistics Netherlands.

In addition, a publication about the main results is written annually. This publication is a chapter in the national publication on ICT usage in the Netherlands.

Also, in the national publication, the results of other EU countries, as published by Eurostat, are frequently used for benchmarking the results of the Netherlands.

Statistics Netherlands publishes the national results on the website of Statistics Netherlands. Two aggregated online tables (e-commerce and activities) are available.

Links: Online table e-commerce and Online table Internet usage and online activities

Not available

The anonymized micro-dataset of 2022 will be made available to a selected number of national research institutes for possible research in the field of ICT by 2024.

No other dissemination

Not available

Links: Online table e-commerce and Online table Internet usage and online activities

All questions are answered

Links: Online table e-commerce and Online table Internet usage and online activities

In order to ensure the quality of the data, the net sample size has been increased. From 2022 onwards Statistics Netherlands (SN) increased the net sample size to 4 800 (also to improve the quality of the breakdowns). 

Some additional actions are also carried out in order to reduce unit non-response: sending sufficient reminders, lengthening the CAWI data collection period, dividing the CAWI fieldwork into three smaller portions instead of one portion, using incentives in the form of iPad lottery. Also, the expended weighting factors partially correct biases caused by unit non-response for target variables. 

The rules of Statistics Netherlands regarding quality assurance was applied for this survey.

An evaluation was conducted (as every year) with the CATI interviewers and with the different departments involved in the survey, and lessons learned was summarized and will be used for next year.

The whole project (data collection, data processing, and data analysing) has two project managers and several statisticians/researchers.

The project can be supported - if necessary - by a senior statistical researcher within the unit and - also if needed - by the methodological or IT department of SN. 

No part of the work was subcontracted.

The data collection on ICT usage is a regular data collection. The possible problems can be:

-           a low response rate: this is diverted by sending sufficient reminders, lengthening the CAWI data collection period, dividing the CAWI fieldwork into smaller portions instead of one portion, using incentives in the form of iPad lottery, and monitoring the fieldwork on the daily base.

-           a misunderstanding by respondents of certain new questions. In the worst case it might be decided that the results of this question(s) will not be published.

-           emergency (sickness, not meeting deadlines etc.): there are complementary resources available.

User of the national datatables, presented at statline tables, are ministries and researchers.

The need is reliable data on ICT usage by individuals for policy needs and for research.

Special requested information, if it is available and reliable, can be given to users (no dataset). 

Not applicable

All mandatory variables are provided to Eurostat

100%

The accuracy of data collected with a sample survey is affected by measurement errors and non-response errors.

Measurement errors may arise if questions can be understood and interpreted in different ways or if the respondents do not give the requested information. The means by which measurement errors are reduced are the careful planning of the questionnaire forms, testing the form and interviewer training.

The survey’s non-response errors are classified into unit non-response and item non-response or partial non-response errors. Unit non-response means that target persons cannot be interviewed at all because they cannot be reached or refuse to be interviewed. Weighting coefficients are used to correct unit non-response.

Item non-response rate was not a problem as refusal to answer was not allowed.  

The sampling error reflects the fact that only a particular sample was surveyed rather than the entire population. It is estimated by the standard error and can be expressed by the square root of the estimate of the sampling variance. The estimation of the sampling variance should ideally take into account the sampling design (e.g. the stratification).
More information on methodology for calculating precision estimates is detailed in the paragraphs below.

Precision estimates for the question "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Number of respondents (absolute value for ‘Yes’ answers): 4 718  

Estimated proportion (in %): 89.1  

Standard error (in percentage points): 0.4  

Details of the breakdowns are available in the Annex below. 

Basic formula: the standard errors are derived using the variance formula for simple random sampling 

= √ p*q

          n  

See more details on non-sampling error below.

The sampling frame for the social statistics surveys is the Dutch Population Register, which is updated every month. For the ICT survey, a two-stage sample is used. 

Not applicable

Not requested in the ICT survey.

1)       Measurement errors:

The sample survey is designed to meet the objectives as defined by the EU: (1) Dissemination of the results at the desired level of detail, (2) Anticipated estimated standard error of the results for the overall population and for the subgroups. The survey design is annually adjusted, based on the response rate of the previous year and the estimated standard error of the target variable.

2)       Questionnaire design and testing:

Statistics Netherlands has a unimode questionnaire design for CAWI and CATI mode. Also the smartphone design was used and tested. At the end of the questionnaire respondents can give comments and their short evaluation about the questionnaire. Before starting fieldwork, the CAWI and CATI mode is tested and evaluated.  

3)       Interviewer training: 

CATI interviewers got instruction about the questionnaire 2022 and followed an online training course about ICT 2022. The data-collection department is responsible for the interviewers. 

4)       Proxy interview rates:

No proxy

Information about non-respondents: Main characteristics of non-respondents:

The weighting procedure corrects for non-response. The weighting model is as follows: Gender(2) x [Age(13) + Age(3) x Marital status(2)] + Marital status(4) + Household size(5) + Ethnicity(3) + Income(4) + Urban density(5) + RegionPlus(16) + NUTS1(4) x Age(3) + Number of households

The unit response rate is the ratio of the number of in-scope respondents (= the number of achieved interviews or the net sample size to the number of eligible elements selected from the sampling frame).

Unit non-response rate for

• Households: Not applicable, see individuals  
  
• Individuals (aged 16-74):  

  Number of ineligible units: no information exists at the selected address or a selected individual has died and people with no phone numbers or phone numbers are not used any more: they cannot be reached: 3 830

  Total number of in-scope: 7 595

  Unit non-response rate of individuals (aged 16-74): 3 830 / 7 595 = 50.4% 
  

Comments: 

Type of unit non-response:

Non-contact: 879

Refusal: 942

Inability to respond: 131

Other: 234

1)       Methods used for dealing with unit non-response:

SN uses calibration/weighting to control for non-response. Weighting procedure individuals: The subgroups for which weighting factors are calculated are based on the demographic variables: gender, age, marital status, urban density and region. These weighting factors partially correct biases caused by unit non-response for target variables, such as the use of internet and e-commerce. The weighting factor for households is the quotient of: the individual (aged 16-74) weighting factor / household size of individuals aged 16-74 in the population.

The weighting models is as follows: Gender(2) x [Age(13) + Age(3) x Marital status(2)] + Marital status(4) + Household size(5) + Etnicity(3) + Income(4) + Urban density(5) + RegionPlus(16) + NUTS1(4) x Age(3) + Number of households

2)       Methods used for minimizing unit non-response:

Data collection modes: A combination of data collection modes is applied. In the first step (CAWI: Computer Assisted Web Interviewing) is used for interviewing. In the second step (CATI: Computer Assisted Telephone Interviewing) is used. For the phone coverage, phone registers are used.

The policy of Statistics Netherlands (SN) is to apply CAWI mode in surveys as much as possible. This is in line with the European standards. However, the response-rate of CAWI is lower than the CAPI/CATI modes. This is also the reason that SN has a follow-up mode in social statistics surveys. In addition, SN can reach also respondents by using CATI who do not (or cannot: not enough skills) to participate online.

Data collection process:  From 2014 onwards, SN introduces the CAWI data collection mode in the survey. People are invited to fill in the questionnaires online (invitation letters are sent with codes to log in). In case of non-response (after two reminders/rappels), people are phoned (CATI), if telephone numbers are available. The phone coverage rate was in 2022 about 60%. In addition, different actions are addressed during the fieldwork in order to reduce non-response, such as lengthening the CAWI period, dividing the CAWI portion into smaller ones and using iPad lottery.  

3)       Substitution permitted: No substitution, no proxy interview

4)       Substitution rate (in %):  No substitution

Items with low response rates (observed rates in %): 

"Don't know" as answer option is not allowed for the survey questions. Only for some background variables. No question/variable has response rate below 95%.

As every year, also in 2022, there are some missing values for some background and breakdown variables:

Country of citizenship (CITIZENSHIP), ISCO2D and NACE1D

It is an essential note for the breakdown variables: if the total is calculated by summing up variables with missing values, there will be always differences between the results of the summing up and the total population without summing up, because of the missing values.  

Data quality control:

Item non-response is very low, and is only allowed for some background variables (every year). Data processing is mainly automated. Data-checks are developed for new modules. Standard error analyses is conducted in order to ensure the sampling remain below the prescribed limits.

Not requested for ICT Survey

At national level: two tables on statline: 21 October 2022: Online table e-commerce and Online table Internet usage and online activities

Target day: 5 October 2022

Final delivery: 22 September 2022

Deadline was 5 October 2022 - final delivery data: 22 September 2022: 13 days in time

Comparability: registered population in the Netherlands

No problem(s) of comparability between regions of the country

Not relevant

Possible limitations in the use of data for comparisons over time: No limitation

The length of comparable time series depends on the module and variable considered within each of the modules of the survey.

Not applicable

Not applicable

Not applicable

All statistics are coherent within the dataset.

MANDATORY questions in the Eurostat model questionnaire 2022:

The table in the annex lists the questions that do not reflect the coverage of subjects and characteristics of Annex 2 of the Commission Delegated Regulation (EU) 2021/1898 of the 20 July 2021. 

Adoption of OPTIONAL questions and items in the Eurostat model questionnaire 2022:

The table in the annex lists the optional questions from the annual Eurostat model questionnaire 2022 included in the national questionnaire and their coverage for age groups beyond the standard scope. 

Additional questions introduced in the national questionnaire: 

Receiver for digital radio

Some internet activities (e.g. communication, free-time activities)

Effects of deviations from the routing used in the Eurostat model questionnaire:  

All statistics are coherent within the dataset.

Not needed

Not applicable

Not relevant

The source of the raw data is described with more details in the paragraphs below.

Name and short description of the sampling frame or register used: 

The sample covers the total population in the Netherlands, aged 12 years and older, living in private households and registered in the Municipal Population Register. (BRP). This population register is the sampling frame for statistics in the Netherlands. 

The sampling frame is the Municipal Population Register (BRP). This population register contains all individuals who are registered in Dutch municipalities. It does not include homeless people or people living in institutions.

Advantage of using the Municipal Population Register is the actuality of information from the registered individuals. Information about birth, death, new addresses, household size is updated weekly and is incorporated in the mentioned register.

As drawing the sample has to be done 2 months before the data collection period, some deviation (such as moving, death) can occur.

The sampling design is a probability design. 

The sampling design is not a complex design and can be seen as SRS. Two stages are included.

In the first stage NUTS3 is used as stratification variable. Then municipalities are selected. Large municipalities being selected with a probability of 1. All the other municipalities are selected at random, taking into account the size of the municipalities. In the second stage the number of individuals, as determined for every municipality, are selected. Individuals from 12 years and older are selected.

Annual

1) Methods used to gather data:

Data collection modes: A combination of data collection modes is applied. In the first step (CAWI: Computer Assisted Web Interviewing) is used for interviewing. In the second step (CATI: Computer Assisted Telephone Interviewing) is used. For the phone coverage, phone registers are used.

The policy of Statistics Netherlands (SN) is to apply CAWI mode in surveys as much as possible. This is in line with the European standards. However, the response-rate of CAWI is lower than the CAPI/CATI modes. This is also the reason that SN use a follow-up mode in social statistics surveys. In addition, we can reach also respondents who do not (or cannot: not enough skills) to participate online.

2) Short description of the survey method:

Data collection process:  From 2014 onwards, Statistics Netherlands (SN) introduces the CAWI data collection mode in the survey. People are invited to fill in the questionnaires online (invitation letters are sent with codes to log in). In case of non-response (after two reminders/rappels), people are phoned (CATI) if telephone numbers are available. The phone coverage rate was in 2022 about 65%. In addition, different actions are addressed during the fieldwork in order to reduce unit non-response, such as lengthening the CAWI period, dividing the CAWI portion into smaller ones and using iPad lottery.

3) Variables completed from an external source: Some background variables as described before

Data processing, evaluation, data analysing and data delivery

-          After closing the fieldwork, data files are checked, information is linked to register data, inconsistencies repaired and plausibility checks are done

-          Calibration/weighting takes place

-          Results are compared (year to year check)

-          Micro-data is prepared to Eurostat

-          Micro-data delivery

-          Evaluation takes place with interviewers and within the organisation

-          Publishing results

Not relevant

For the target indicator "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Imputation rate (% of observations): No imputation

Imputation rate (share of estimate): No imputation

Methods used to impute item non-response: None

Grossing up procedures have been applied to:  The grossing-up procedure for individuals was enclosed in the weighting procedure. All variables used in this procedure are containing the population numbers on 1 April 2022.

Description of the weighting procedures: 

The subgroups for which weighting factors are calculated are based on the demographic variables and socio-economic variables: gender, age, marital status, ethnicity, income, size of household, urban density and region.

These weighting factors partially correct biases caused by unit non-response for target variables, such as the use of internet and e-commerce.

The weighting factor for households is the quotient of: the individual (aged 16-74) weighting factor / household size of individuals aged 16-74 in the population.

The weighting model is as follows: Gender(2) x [Age(13) + Age(3) x Marital status(2)] + Marital status(4) + Household size(5) + Ethnicity(3) + Income(4) + Urban density(5) + RegionPlus(16) + NUTS1(4) x Age(3) + Number of households.

The weighting factor for households is the quotient of: the individual weighting factor / household size of individuals aged 16-74 in the population.

Not relevant

Not relevant

As every year, also in 2022, there are some missing values for some background and breakdown variables:

It is an essential note for the breakdown variables: if the total is calculated by summing up variables with missing values, there will be always differences between the results of the summing up and the total population without summing up, because of the missing values.