Statistical Office of Montenegro (MONSTAT)

e-mail: contact@monstat.org

tel: +382(0)20230811

Statistical Office of Montenegro (MONSTAT)

e-mail: contact@monstat.org

tel: +382(0)20230811

IV Proleterska 2 81000 Podgorica, Montenegro

The EU survey on the use of ICT in households and by individuals is an annual survey conducted since 2002. In Montenegro, it has been conducted since  2011.

In 2022, the survey collects data on the access to information and communication technologies (ICT), on the use of the internet, e-government, e-commerce, internet of things, as well as green ICT.

National language:  Upotreba informaciono komunikacionih tehngologija za domacinstva i lica.

Questionnaire in national language is available in the Annexes.

The following common concepts and definitions apply under the Integrated European Social Statistics (IESS):

• the International Standard Classification of Education (ISCED) 2011 published in the following breakdowns: low (ISCED levels 0-2: no formal education, primary education or lower secondary education), medium (ISCED levels 3-4: upper secondary or post-secondary non-tertiary education) and high (ISCED levels 5-6: tertiary programmes which normally need a successful completion of ISCED 3 or 4, or second-stage tertiary education leading to an advanced research qualification);
• the International Standard Classification for Occupation ISCO-08 at the 2-digit level;
• the Classification of Economic Activities (NACE Rev.2-2008), at section level;
• the Common classification of territorial units for statistics (NUTS 1) – finer granularity of NUTS 2 is provided on optional basis by some Member states;
• the SCL - Geographical code list;
• information about household income is provided at lower level of detail. 

Additional classifications used in the national questionnaire: No additional classifications

The ICT survey in households and by individuals covers those households having at least one member in the age group 16 to 74 years old. Internet access of households refers to the percentage of households that have an internet access, so that anyone in the household could use the internet.

There is no differences in scope at national level from the main Eurostat scope.

The survey is collecting data of internet users, individuals who have used the internet in the three months prior to the survey. Regular internet users are individuals who used the internet, on average, at least once a week in the three months prior to the survey.

This annual survey is used to benchmark ICT-driven developments, both by following developments for core variables over time and by looking in greater depth at other aspects at a specific point in time. While the survey initially concentrated on access and connectivity issues, its scope has subsequently been extended to cover a variety of subjects (for example, the use of e-government and e-commerce) and socio-economic analysis (such as regional diversity, gender specificity, differences in age, education and the employment situation). The scope of the survey with respect to different technologies is also adapted so as to cover new product groups and means of delivering communication technologies to end-users.

For more details on the methodology applicable in each survey year, please consult the Methodological Manual for the respective year on CIRCABC - Methodological Manual - Information society statistics (europa.eu).

Deviations from standard ICT concepts: No deviations from standard ICT concepts

Households and Individuals

In the ICT usage survey, the target population for the different statistical units is:

- individuals: all individuals aged 16 to 74;

- households: all (private) households with at least one member aged 16 to 74. 

Target population composed of households and/or individuals:

• Number of households: 164 995
  
• Number of individuals: 579 860

Non-compulsory age groups also included in the target population:

The survey covers the whole territory of Montenegro.

Year 2022

Not applicable

Percentages of ‘Households’ and Percentages of ‘Individuals’

The main reference period for the ICT background variables is moment of data collection. For the group of variables reference period is last three months before the interview. For set of the question reference period is last year.

1 - 15 April

The legal basis for the 2022 EU survey on the use of ICT in households and by individuals is the Regulation (EU) 2019/1700 of the European Parliament and of the Council of 10 October 2019 establishing a common framework for European statistics relating to persons and households, based on data at individual level collected from samples (OJ  L 261 I, 14.10.2019, p. 1), as implemented by the Commission Implementing Regulation (EU) 2021/1223 of 27 July 2021 specifying the technical items of the data set, establishing the technical formats for transmission of information and specifying the detailed arrangements and content of the quality reports on the organisation of a sample survey in the use of information and communication technologies domain for reference year 2022 pursuant to Regulation (EU) 2019/1700 of the European Parliament and of the Council (OJ L 2269, 27.07.2021, pp. 1-45).

Complementary national legislation constituting the legal basis for the survey on the use of ICT in households and by individuals:

The Law on Official Statistics and Official Statistical System (Official Gazette of Montenegro No 18/12 and 47/19) defines provisions for collection, processing, and dissemination of data.

Not applicable

Confidentiality and protection of statistical data are regulated by the Law on Statistics and Statistical System of Montenegro (''Official Gazette of Montenegro '' 18/12)

One of the fundamental principles the Law is based on is the principle of statistical confidentiality and use of personal data exclusively for statistical purposes.

Based on the Law on Statistics and Statistical System of Montenegro  individual data on the natural or legal persons are confidential and represent an official secret. Data is confidential when allow direct or indirect identification of natural or legal persons.

In addition, regarding of quality of estimated indicators we calculate sampling errors.

Depending on the level of Sampling error (CV) and number of units data are published/not published at the different breakdown levels.

According to Statistical Release Calendar 2022. 31 October 2022.

Calendar of publishing statistical data  is document which is published in Internet web page of Statistical Office  as statistical producer. It is published latest to 20 December of current year for next year. All producers are obliged to make and maintain Calendar so this is unique document which integrate all statistical producers in Montenegro (which are determined by the Law on statics) and who publish their statistical data. http://monstat.org/eng/page.php?id=12&pageid=12

According to the statistical procedures all releases should be published at 11 am.

Annual

http://monstat.org/eng/page.php?id=1666&pageid=1663

http://www.monstat.org/eng/novosti.php?id=3429

Not available

Not available

Statistical Office of Montenegro provides microdata without identifiers to the scientific researches.

Social networks (Twitter)

Not applicable

• Methodology.
• Methodological guidelines for interviewers.
• Eurostat model questionnaire.
• Eurostat Methodological Manual.

80.2%

Quality management, in general terms, includes the quality of the management of the statistical system and the production process, and in the narrow sense it guarantees the quality of the statistical result. Compliance of production processes throughout the institution form the ground for increasing productivity and for the permanent promotion of the quality of the statistical result itself. The Quality Management System of the Statistical Office relies on the European Statistics Code of Practice and the principles of Total Quality Management (TQM), which symbolize a common framework for the quality of the European Statistical System. 

http://www.monstat.org/eng/page.php?id=1425&pageid=1425 

The focus of the Statistical Office of Montenegro metadata base is on reference metadata, which according to the various international metadata frameworks, describe and define the content of the data. Reference metadata covered by this system are located into the following modules:

• Surveys and data collections,
• Concepts and definitions.

http://www.monstat.org/eng/page.php?id=1001&pageid=1001#MDS

By introducing a quality management system, the Statistical Office will enhance the quality of statistical processes, final results and user satisfaction. Activities concerning permanent enhancement within a coherent and regulated system will lead to better efficiency of the production process and increase the quality of the statistical results themselves. 

Output/Product Quality Criteria In line with the last five ES Code of Practice Principles, output quality in the ESS is assessed in terms of the following quality criteria: 

1.       Relevance: outputs, meet the needs of users. 

2.       Accuracy and Reliability: outputs accurately and reliably portray reality. 

3.       Timeliness and Punctuality: outputs are released in a timely and punctual manner.  

4.       Coherence and Comparability: outputs are consistent internally, over time and comparable between regions and countries; it is possible to combine and make joint use of related data from different sources. 

5.       Accessibility and Clarity: outputs are presented in a clear and understandable form, released in a suitable and convenient manner, available and accessible on an impartial basis with supporting metadata and guidance. 

European Statistics Code of Practice: http://www.monstat.org/eng/page.php?id=1498&pageid=1498

Commitment on Confidence: http://www.monstat.org/eng/page.php?id=1461&pageid=1461

Quality Declaration: http://www.monstat.org/eng/page.php?id=1500&pageid=1500

Quality Policy: http://www.monstat.org/eng/page.php?id=1501&pageid=1501

The Quality Management Strategy: http://www.monstat.org/eng/page.php?id=1422&pageid=1422

A Guidebook to the Implementation of a Quality Strategy: http://www.monstat.org/eng/page.php?id=1423&pageid=1423

Overall assessment of data quality, based on standard quality criteria are based on national quality reports related to the survey. 

In accordance with the principles of official statistics of Montenegro, producers of official statistics regularly and systematically monitor user satisfaction, so that the Statistical Office, as the coordinator of the statistical system.

International users: 

• Eurostat;
• World Bank;
• UN organizations;
• International Monetary Fund 

National users: 

• Ministries and other public administration bodies; 
• Local government, and  other local government bodies;
• Central bank;
• Non-governmental organizations; 
• Students;
• Researchers;
• Media.

The Statistical Office has adopted the Quality Management Strategy, the Guidebook to the Implementation of the Quality Management Strategy, as well as the Plan for the Implementation of the Quality Policy.  In order to measure the degree to which fulfils obligations towards users and within the new quality policy, the Statistical Office conducted User satisfaction survey. Data collection was realized through a web survey, in the period from September 1 to October 20, 2017.

The results of the survey are available on the Statistical Office website, link: http://monstat.org/uploads/files/2.%20Izvjestaj%20o%20zadovoljstvu%20korisnika%20ENG%20(Autosaved).pdf

Not applicable

97.4%

In ICT usage survey results are based on the sample of population they are subject to the usual types of errors associated with sampling techniques and interviews, such as sampling errors, non-sampling errors, measurement errors, processing errors, and non-response.

The sampling error reflects the fact that only a particular sample was surveyed rather than the entire population. It is estimated by the standard error and can be expressed by the square root of the estimate of the sampling variance.

The estimation of the sampling variance should ideally take into account the sampling design (e.g. the stratification).

Analytic method and Taylor linearization are estimation method(s) used for the random variation of an estimator due to sampling. 

Sampling error – formula:

Standard Error = √p̂(1-p̂) / n

• p̂: The estimate of proportion of  individuals in the sample with a certain characteristic.
• n: The total number of individuals in the sample

Tools used to estimate sampling errors: CLAN

The method used to assess the standard errors takes into account the following specific effects:

• Unit non-response Variance estimation was calculated using final sample size of respondents, which therefore allow taking into account the loss of sample units due to unit non-response,
• Coverage errors (over-coverage, multiple listings) The sample frame is the Population Census 2011 and overcoverage is possible to estimate with design weights, at the level of Montenegro),
• Calibration The effect of calibration on variance is used, by taking into account the responding units as the sample size assuming MAR mechanism and by considering the final weights (in surveymeans procedure). Effects of re-weighting for non-response and effects of calibration was also reflected at final weights and used at the stage of variance estimation and sampling error estimation.

Precision estimates for the question "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Number of respondents (absolute value for ‘Yes’ answers): 287

Estimated proportion (in %): 27.6

Standard error (in percentage points): 0.015

Details of the breakdowns are available in the document INFOSOC_HHNSI_A_2022_ME stored in the Annexes. 

See more details on non-sampling error below.

Over-coverage occur due to the inclusion of non-existent or uninhabited houses or the population that no longer lives in the country. Under-coverage is a problem that arises due to under-coverage or non-eligibility of the sample selection framework (e.g. non-inclusion of newly built flats that are settled, as well as non-inclusion of persons who arrive at a place with the intention to remain there for a year and longer). The under-coverage rate is difficult to estimate because it is not possible to know which units are not included in the target population.

4.6%

Not requested in the ICT survey.

1)       Measurement errors: Not applicable

2)       Questionnaire design and testing: Not applicable

3)       Interviewer training:  

MONSTAT have training for interviewers every year before survey. Interviewers are very well trained by responsible statisticians.

For interviewers are provided detailed technical guideline for CAPI system functions and detailed methodological instructions.

4)       Proxy interview rates: Not applicable

Information about non-respondents: Not getting an answer - it is often unavoidable to refuse or not contact. In this case, there is a difference between the data obtained from the collected data (usually part of the planned sample) and those that would calculate that the complete sample was realized.

The unit response rate is the ratio of the number of in-scope respondents (= the number of achieved interviews or the net sample size to the number of eligible elements selected from the sampling frame).

Unit non-response rate for

• Households: 31.8
  
• Individuals (aged 16-74): 31.8
  

Comments, if any:

1)       Methods used for dealing with unit non-response: 

Method which was used for dealing with unit non-response was correction factor in the weighting procedure.

2)       Methods used for minimizing unit non-response:  

The Statistical Office of Montenegro introduce the fieldwork control in order to reduce the unit non-response.  The control is very important during the fieldwork because the main aim is to find households and persuade them to participate in survey.  The control is primarily done by responsible statisticians, and one of their responsibilities is to try to find different way how to convince households to participate, if households refused to participate.

3)       Substitution permitted: No

4)       Substitution rate (in %): Not applicable.

Items with low response rates (observed rates in %): Not applicable.

Not applicable

Not requested for ICT Survey

The final data are published 7 months after the end of the reference period. Timeliness of final data: T + 7 months after the end of the reference period. The data are published in accordance with Statistical Release Calendar 31/10/2022 (7 months after the end of the reference period).

Accuracy indicator represents the time difference between Actual date of the effective provision of the statistics and Scheduled date of the effective provision of the statistics. Deadlines of dissemination of the ICT data at the website are defined in the Statistical Release Calendar. Indicator TP3 (punctuality) is 0, there is no difference between the planned and the actual publication. That means that the Release is published in accordance with Statistical Release Calendar.

Indicator TP3 (punctuality) is 0, there is no difference between the planned and the actual publication. That means that the Release is published in accordance with Statistical Release Calendar.

The data at the national level are comparable with countries that carry out the survey on the ICT usage according to the Eurostat methodology, implementing IESS regulation framework (EC) 2019/1700 and EU Regulation which are changed in accordance on the year of survey.

Not relevant

Possible limitations in the use of data for comparisons over time: 

The data at the national level are comparable with countries that carry out the survey on the ICT usage according to the Eurostat methodology, implementing IESS regulation framework (EC) 2019/1700 and EU Regulation which are changed in accordance on the year of survey.

The length of comparable time series depends on the module and variable considered within each of the modules of the survey.

Not applicable

Not applicable

Not applicable

Not applicable

MANDATORY questions in the Eurostat model questionnaire 2022: 

The table in the annexes below lists the questions that do not reflect the coverage of subjects and characteristics of Annex 2 of the Commission Delegated Regulation (EU) 2021/1898 of the 20 July 2021. 

There have been no deviations to the Eurostat questions in the national questionnaire.

Adoption of OPTIONAL questions and items in the Eurostat model questionnaire 2022: 

Some optional questions are included in national questionnaire.

Table 15.4.2. of the document INFOSOC_HHNSI_A_2022_ME stored in the Annexes lists the optional questions from the annual Eurostat model questionnaire 2022 included in the national questionnaire and their coverage for age groups beyond the standard scope. 

Additional questions introduced in the national questionnaire: 

Additional questions are in the annexed document.

Effects of deviations from the routing used in the Eurostat model questionnaire: All statistics are coherent within the dataset.

Statistical Office has adopted the revision policy and it is available on the website: http://www.monstat.org/eng/page.php?id=1411&pageid=3

Published data are considered final except in the case of methodological changes and the introduction of new classifications, as a result which are subject to revision.

Not relevant

The source of the raw data is described with more details in the paragraphs below.

Sampling frame for ICT survey in households is base of Census of population, households and dwellings 2011 with data about settlement type, age, sex, address, name and surname of head of household.

Type of source: Face to face interviews

Survey vehicle: Stand-alone survey

Survey participation: Voluntary

Shortcomings: Census of population, households and dwellings 2011 was conducted in April 2011 and moment of sampling and conducting ICT survey was April 2021.

Because the data base for the frame is not updated regularly this effects to results as under or over coverage.

The sampling design is a probability design.

The survey is based on a two stage stratified random sample. Stratification is done using 4 regions and urban/rural.

Enumeration areas are the sampling units at the first stage (PSU). The sampling unit at the second stage is household.

The sampling unit at the ultimate stage are individuals.

Number of individuals interviewed in the household: One

Annual

1) Methods used to gather data: CAPI 

2) Short description of the survey method: Face to face interview.

3) Variables completed from an external source: No variables have been completed from an external source.

Logical controls, validation rules and standards in place at Eurostat.

Not applicable

For the target indicator "Individuals having ordered goods or services for private use over the internet in the last 12 months" (individuals who ticked 'Within the last 3 months' or 'Between 3 months and a year ago' in question D1 of the 2022 model questionnaire):

Imputation rate (% of observations): 0%

Imputation rate (share of estimate): 0%

Methods used to impute item non-response: None

Grossing up procedures have been applied to: Households

Description of the weighting procedures: 

Weights are used to compensate unequal chances of different persons to be included in the sample. Calculation of weights is made in several successive steps. At first, so-called design weights are calculated. Since sampling of PSU is made with probabilities proportional to number of households, we will have that the inclusion probability at the first stage. At the second stage within each selected PSU households are sampled by simple random sampling procedure. Therefore, we have inclusion probability of household at the second stage. The design weight of a household is calculated as the inverse of its inclusion probabilities at first and second stage. The design weights are further adjusted according to the actual response level.

Not relevant

Not relevant