|
For any question on data and metadata, please contact: Eurostat user support |
|
|||
1.1. Contact organisation | Statistical Office of Montenegro e-mail: contact@monstat.org tel: +382(0)20230811 |
||
1.2. Contact organisation unit | Statistics of Innovation, Household Consumption and ICT Survey Department tel: +382 (0) 20 230 791 |
||
1.5. Contact mail address | IV Proleterska 2 81000 Podgorica, Montenegro |
|
|||
2.1. Metadata last certified | 05/06/2024 | ||
2.2. Metadata last posted | 05/06/2024 | ||
2.3. Metadata last update | 05/06/2024 |
|
|||
3.1. Data description | |||
Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises. Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age. Part of this is the "European strategy for data", envisioning a single market for data to ensure the EU's global competitiveness and data sovereignty, in which context a comprehensive set of new rules for all digital services was proposed: the Digital Services Act and the Digital Markets Act, which are centrepieces of the EU digital strategy. Furthermore, the Commission and the High Representative of the Union for Foreign Affairs and Security Policy presented a new “EU cybersecurity strategy”, which is intended to bolster the EU's collective resilience against cyber threats, safeguard a global and open internet and protect EU values and the fundamental rights of its people. Furthermore, data will allow monitoring the progress towards A Europe fit for the digital age, one of the six priorities for the period 2019-2024 of the von der Leyen European Commission. The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.
|
|||
3.2. Classification system | |||
3.3. Coverage - sector | |||
All economic activities in the scope of Annex I of the Commission Regulation are intended to be included in the general survey, covering enterprises with 10 or more employees and self-employed persons. These activities are: NACE Rev. 2 sections C, D, E, F, G, H, I, J, L, M and N, division 95.1. For micro-enterprises see the sub-concepts below. |
|||
3.3.1. Coverage-sector economic activity for micro-enterprises - All NACE Rev. 2 categories are covered | |||
3.3.2. Coverage sector economic activity for micro-enterprises - If not all activities were covered, which ones were covered? | |||
Micro-enterprises are not covered in the survey. |
|||
3.4. Statistical concepts and definitions | |||
The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following areas: - Access to and use of the Internet - E-commerce and e-business - Use of cloud computing services - Artificial Intelligence - Other topics: Data utilisation, sharing, analytics and trading, Invoicing. The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey. |
|||
3.5. Statistical unit | |||
Enterprise |
|||
3.6. Statistical population | |||
Target Population As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons shall be covered by the survey. For micro-enterprises see the sub-concepts below. |
|||
3.6.1. Coverage of micro-enterprises | |||
No | |||
3.6.2. Breakdown between size classes [0 to 1] and [2 to 9] | |||
No | |||
3.6.3. If for micro-enterprises different size delimitation was used, please indicate it. | |||
Not applicable. |
|||
3.7. Reference area | |||
The whole territory of the country was included. |
|||
3.8. Coverage - Time | |||
Years 2022 and 2023. |
|||
3.9. Base period | |||
Not applicable |
|
|||
Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons. |
|
|||
As in Eurostat model questionnaire. |
|
|||
6.1. Institutional Mandate - legal acts and other agreements | |||
Complementary national legislation constituting the legal basis for the survey on the use of ICT in enterprises: Law on Official Statistics (https://www.monstat.org/eng/page.php?id=4&pageid=4) Programme of Official Statistics (https://www.monstat.org/eng/page.php?id=1617&pageid=1617) |
|||
6.2. Institutional Mandate - data sharing | |||
Monstat transmit the data with EUROSTAT for the topic ‘ICT usage and e-commerce’, according to Regulation (EU) 2019/2152, for the reference year 2023. |
|
|||
7.1. Confidentiality - policy | |||
Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society. At national level : We publish data on section and higher level. Aggregates can be compiled for the total population or for the different subpopulations defined by the background variables.
|
|||
7.2. Confidentiality - data treatment | |||
Data are transmitted via eDamis (encrypted) and delivered to a secure environment where they are treated. Flags are added for confidentiality in case results must not be disclosed. At national level : Not available |
|
|||
8.1. Release calendar | |||
Release calendar for the statistical outputs from the process is reported, and it is publicly accessible on 31 October, 2023 https://www.monstat.org/uploads/files/O%20NAMA/Kalendar_2024_130524_eng.pdf |
|||
8.2. Release calendar access | |||
https://www.monstat.org/uploads/files/O%20NAMA/Kalendar_2024_130524_eng.pdf |
|||
8.3. Release policy - user access | |||
All users are informed for the dissemination of statistical data at the same time, release calendar is available on this link https://monstat.org/uploads/files/Kalendar%20objavljivanja%20za%202023%20-%20%20ENG.pdf The latest statistical data are published in press releases every workday at 11:00 on the date announced in advance in the Release Calendar. |
|
|||
Annual |
|
|||
10.1. Dissemination format - News release | |||
National dissemination of results Dissemination of results are published in publications, which are in pdf format.
http://www.monstat.org/eng/page.php?id=1667&pageid=1663
|
|||
10.2. Dissemination format - Publications | |||
National dissemination of results
Dissemination of results are published in publications, which are in pdf format.
http://www.monstat.org/eng/page.php?id=1667&pageid=1663
|
|||
10.3. Dissemination format - online database | |||
See detailed section 10.3.1. |
|||
10.3.1. Data tables - consultations | |||
Results for selected variables collected in the framework of this survey are available for all participating countries on Digital economy and society of Eurostat website. At national level : Results for ICT usage survey in enterprises is available on the following link.
http://www.monstat.org/eng/page.php?id=1667&pageid=1663
|
|||
10.4. Dissemination format - microdata access | |||
Not available |
|||
10.5. Dissemination format - other | |||
Not requested |
|||
10.5.1. Metadata - consultations | |||
Not requested |
|||
10.6. Documentation on methodology | |||
Metadata information are available on this link http://www.monstat.org/eng/prikazi_metapodatke.php?id=1001&pageid=1001&name=Use%20of%20information-communication%20technology%20in%20enterprises |
|||
10.6.1. Metadata completeness - rate | |||
Not requested |
|||
10.7. Quality management - documentation | |||
National quality management is available on the following link https://www.monstat.org/eng/page.php?id=1425&pageid=1425 |
|
|||
11.1. Quality assurance | |||
The European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises provides guidelines and standards for the implementation of the surveys. It is updated every year according to the changed contents of the model questionnaires. At national level : The Quality Management System of the Statistical Office relies on the European Statistics Code of Practice and the principles of Total Quality Management (TQM), which symbolize a common framework for the quality of the European Statistical System. |
|||
11.2. Quality management - assessment | |||
European level : At European level, the recommended use of the annual Eurostat model questionnaire aims at improving comparability of the results among the countries that conduct the survey on ICT usage and e-commerce in enterprises. Moreover, the Methodological Manual provides guidelines and clarifications for the implementation of the surveys. National level : Statistical Office of Montenegro use the annual Eurostat model questionnaire and the Methodological Manual on ICT usage and e-commerce in enterprises. |
|
|||
12.1. Relevance - User Needs | |||
European level : At European level, European Commission users (e.g. DG CNECT, DG GROW, DG JUST, DG REGIO, DG JRC) are the principal users of the data on ICT usage and e-commerce in enterprises and contribute in identifying/defining the topics to be covered. Hence, main users are consulted regularly (at hearings, task forces, ad hoc meetings) for their needs and are involved in the process of the development of the model questionnaires at a very early stage. User needs are considered throughout the whole discussion process of the model questionnaires aiming at providing relevant statistical data for monitoring and benchmarking of European policies. National level : The users of the data on ICT usage and e-commerce in enterprises are Ministry of Public Administration, the scientific research institution, journalists. |
|||
12.2. Relevance - User Satisfaction | |||
European level : At European level, contacts within the Commission, the OECD and other stakeholders give a clear picture about the key users' satisfaction as to the following data quality aspects: accuracy and reliability of results, timeliness, satisfactory accessibility, clarity and comparability over time and between countries, completeness and relevance. Overall users have evaluated positively (good, very good) the data quality on the ICT usage and e-commerce in enterprises. National level : The Statistical Office has adopted the Quality Management Strategy, the Guidebook to the Implementation of the Quality Management Strategy, as well as the Plan for the Implementation of the Quality Policy. In order to measure the degree to which fulfils obligations towards users and within the new quality policy, the Statistical Office conducted User satisfaction survey. Data collection was realized through a web survey. https://www.monstat.org/eng/page.php?id=1502&pageid=1
|
|||
12.3. Completeness | |||
Detailed information is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions. |
|||
12.3.1. Data completeness - rate | |||
Not requested. |
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.1. Accuracy - overall | ||||||||||||||||||||||||||||||||||||||||||||||||||
Comments on reliability and representativeness of results and completeness of dataset These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates). More detailed information is available in “ Annex II. _ Accuracy “ excel file - related to European aggregates, comments on reliability and use of flag. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.2. Sampling error | ||||||||||||||||||||||||||||||||||||||||||||||||||
For calculation of the standard error see 13.2.1.1. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.2.1. Sampling error - indicators | ||||||||||||||||||||||||||||||||||||||||||||||||||
Standard error (for selected indicators and breakdowns) Precision measures related to variability due to sampling, unit non-response (the size of the subset of respondents is smaller than the size of the original sample) and other (imputation for item non-response, calibration etc.) are not (yet) required from the Member states for all indicators. Eurostat will make basic assumptions to compute these measures for all indicators produced (e.g. stratified random sampling assuming as strata the crossing of the variables “Number of employees and self-employed persons” and “Economic Activity” as it was defined in the 3 tables of section 18.1). More detailed information is available in“ Sample and standard error tables 2023 “ excel file – worksheets starting with “Standard error". |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.2.1.1. Sampling error indicator calculation | ||||||||||||||||||||||||||||||||||||||||||||||||||
Calculation of the standard error Various methods can be used for the calculation of the standard error for an estimated proportion. The aim is to incorporate into the standard error the sampling variability but also variability due to unit non-response, item non-response (imputation), calibration etc. In case of census / take-all strata, the aim is to calculate the standard errors comprising the variability due to unit non-response and item non-response.
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3. Non-sampling error | ||||||||||||||||||||||||||||||||||||||||||||||||||
See detailed sections below. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.1. Coverage error | ||||||||||||||||||||||||||||||||||||||||||||||||||
See concept 18.1.1. A) Description of frame population. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.1.1. Over-coverage - rate | ||||||||||||||||||||||||||||||||||||||||||||||||||
It is not possible to calculate over-coverage rate. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.1.2. Common units - proportion | ||||||||||||||||||||||||||||||||||||||||||||||||||
Not requested |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.2. Measurement error | ||||||||||||||||||||||||||||||||||||||||||||||||||
No measurement errors |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3. Non response error | ||||||||||||||||||||||||||||||||||||||||||||||||||
See detailed sections below. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.1. Unit non-response - rate | ||||||||||||||||||||||||||||||||||||||||||||||||||
See detailed sub-concepts below. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.1.1. Unit response | ||||||||||||||||||||||||||||||||||||||||||||||||||
The following table contains the number of units (i.e. enterprises), by type of response to the survey and by the percentage of these values in relation to the gross sample size.
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.1.2. Methods used for minimizing unit non-response | ||||||||||||||||||||||||||||||||||||||||||||||||||
Unit non-response is generally handled by adjusting the weight of the enterprises that responded to the survey to compensate for those that did not respond. |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.1.3. Methods used for unit non-response treatment | ||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.1.4. Assessment of unit non-response bias | ||||||||||||||||||||||||||||||||||||||||||||||||||
Not available |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.2. Item non-response - rate | ||||||||||||||||||||||||||||||||||||||||||||||||||
Not available |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.2.1. Methods used for item non-response treatment | ||||||||||||||||||||||||||||||||||||||||||||||||||
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.3.2.2. Questions or items with item response rates below 90% and other comments | ||||||||||||||||||||||||||||||||||||||||||||||||||
Other comments relating to the item non-response
|
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.4. Processing error | ||||||||||||||||||||||||||||||||||||||||||||||||||
No processing errors |
||||||||||||||||||||||||||||||||||||||||||||||||||
13.3.5. Model assumption error | ||||||||||||||||||||||||||||||||||||||||||||||||||
Not requested |
|
|||
14.1. Timeliness | |||
See detailed section below. |
|||
14.1.1. Time lag - first result | |||
Not applicable |
|||
14.1.2. Time lag - final result | |||
European level : Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year e.g. e-commerce). At national level : Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+10 months for other indicators referring to the previous year e.g. e-commerce). At national level data are published on 31 October 2023, T+7 months
|
|||
14.2. Punctuality | |||
See detailed section below. |
|||
14.2.1. Punctuality - delivery and publication | |||
The data were sent on 05 October 2023. |
|
|||
15.1. Comparability - geographical | |||
The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data. Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions. |
|||
15.1.1. Asymmetry for mirror flow statistics - coefficient | |||
Not applicable |
|||
15.2. Comparability - over time | |||
See section below. |
|||
15.2.1. Length of comparable time series | |||
The length of comparable time series depends on the module and the variable considered within each survey module. Additional information is available in annexes attached to the European metadata. MONSTAT is conducting survey on ICT usage in Montenegro from 2011 year.
From that year every change which was added to the next new survey are added according to the Eurostat questionnaire.
|
|||
15.3. Coherence - cross domain | |||
Not applicable |
|||
15.3.1. Coherence - sub annual and annual statistics | |||
Not applicable |
|||
15.3.2. Coherence - National Accounts | |||
Not applicable |
|||
15.4. Coherence - internal | |||
Not applicable |
|
|||
Restricted from publication |
|
|||
17.1. Data revision - policy | |||
Statistical Office has adopted the revision policy and it is available on the website:
http://www.monstat.org/eng/page.php?id=1411&pageid=3
|
|||
17.2. Data revision - practice | |||
Published data are considered final except in the case of methodological changes and the introduction of new classifications, as a result which are subject to revision. |
|||
17.2.1. Data revision - average size | |||
Not requested |
|
||||||||||
18.1. Source data | ||||||||||
A) Frame population description and distribution For more information see concept 18.1.1.
B) Sampling design - Sampling method Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata: The frame population consists of all economic active enterprises with 10 or more employees existing in the Statistical Business Register and responding to the defined by Eurostat main activity groups by NACE rev.2 The frame population was updated regularly The same frame population is used for the sampling, weighting and grossing up procedures. The stratified simple random sampling method is used. The sample is stratified by economic activity and by number of persons employed. The enterprises were divided by number of persons employed into following size groups: 10-49, 50-249; 250+. The Neyman optimal allocation was used for sample allocation and determination of sample size. By number of persons employed, the survey includes all enterprises with 50 and more persons employed. Stratified simple random sampling is used for enterprises 10 to 49 persons employed.
C) Gross sample distribution More detailed information is available in “ Sample and standard error tables 2023 “ excel file (Worksheet: GROSS SAMPLE)
D) Net sample distribution More detailed information is available in “ Sample and standard error tables 2023 “ excel file (Worksheet: NET SAMPLE) |
||||||||||
18.1.1. Population frame | ||||||||||
A) Description of frame population
B) Frame population distribution More detailed information is available in “ Sample and standard error tables 2023 “ excel file (Worksheet: FRAME POPULATION) |
||||||||||
18.2. Frequency of data collection | ||||||||||
Annual |
||||||||||
18.3. Data collection | ||||||||||
See detailed sections below. |
||||||||||
18.3.1. Survey period | ||||||||||
|
||||||||||
18.3.2. Survey vehicle – general survey | ||||||||||
General survey - Stand-alone survey | ||||||||||
18.3.3. Survey vehicle – micro-enterprises | ||||||||||
The collection of micro-enterprises was integrated with the general survey | ||||||||||
18.3.4. Survey type | ||||||||||
Telephone interview. |
||||||||||
18.3.5. Survey participation | ||||||||||
Voluntary | ||||||||||
18.4. Data validation | ||||||||||
Data has been validated by server based EDIT validation. |
||||||||||
18.5. Data compilation | ||||||||||
Grossing-up procedures The weighting factors are calculated taking into account in particular the probability of selection of each unit in the sample. Design weights are adjusted for unit non-response by each stratum.
The principal method for unit non-response adjustment is weighting. Most strategies for weighting for non-response involve dividing the respondents into a strata. A weight is then applied to each strata and each enterprise i in strata h has the following weight:Whi=Nh/nh.
The grossing-up factor was multiplied by the non-response adjustment factor.
We did not used different weighting factors for persons employed or turnover.
|
||||||||||
18.5.1. Imputation - rate | ||||||||||
Not applicable |
||||||||||
18.6. Adjustment | ||||||||||
Not applicable |
||||||||||
18.6.1. Seasonal adjustment | ||||||||||
Not applicable |
|
||||||||||
Problems encountered and lessons to be learnt: |
||||||||||
19.1. Documents | ||||||||||
|
|
|||
|
|||
Annex I._Completeness 2023 Annex II._ Accuracy 2023 Sample and standard error tables 2023 |