National Statistics Office

Labour Market and Information Society Statistics Unit

National Statistics Office

Lascaris

Valletta

VLT 2000

Data on the Information and Communication Technologies (ICT) usage and e-commerce in enterprises are survey data. They are collected by the National Statistical Institutes or Ministries and are in principle based on Eurostat's annual model questionnaires on ICT usage and e-commerce in enterprises.

Large part of the data collected is used to measure the progress in the implementation of one of the main political priorities of the European Commission for 2019 to 2024 – A Europe fit for the digital age. Part of this is the "European strategy for data", envisioning a single market for data to ensure the EU's global competitiveness and data sovereignty, in which context a comprehensive set of new rules for all digital services was proposed: the Digital Services Act and the Digital Markets Act, which are centrepieces of the EU digital strategy. Furthermore, the Commission and the High Representative of the Union for Foreign Affairs and Security Policy presented a new “EU cybersecurity strategy”, which is intended to bolster the EU's collective resilience against cyber threats, safeguard a global and open internet and protect EU values and the fundamental rights of its people. Furthermore, data will allow monitoring the progress towards  A Europe fit for the digital age, one of the six priorities for the period 2019-2024 of the von der Leyen European Commission.

The aim of the European survey on ICT usage and e-commerce in enterprises is to collect and disseminate harmonised and comparable information at European level.

 NACE Rev.2 2008

All economic activities in the scope of Annex I of the Commission Regulation are intended to be included in the general survey, covering enterprises with 10 or more employees and self-employed persons. These activities are: NACE Rev. 2 sections C, D, E, F, G, H, I, J, L, M and N, division 95.1.

For micro-enterprises see the sub-concepts below.

Microenterprises (1 to 9) are not surveyed

The model questionnaire on ICT usage and e-commerce in enterprises provides a large variety of variables covering among others the following areas:

-          Access to and use of the Internet

-          E-commerce and e-business

-          Use of cloud computing services

-          Artificial Intelligence

-          Other topics: Data utilisation, sharing, analytics and trading, Invoicing.

The annual model questionnaires and the European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises comprise definitions and explanations regarding the topics of the survey.

The Enterprise concept was used in this survey. This is defined as: ‘The enterprise is the smallest combination of legal units, that is an organisational unit producing goods or services, which benefits from a certain degree of autonomy in decision-making, especially for the allocation of its current resources. An enterprise carries out one or more activities at one or more locations. An enterprise may be a sole legal unit.’

Target Population

As required by Annex of the Commission Implementing Regulation, enterprises with 10 or more employees and self-employed persons shall be covered by the survey.

For micro-enterprises see the sub-concepts below.

Microenterprises (1 to 9) are not surveyed

The survey had total geographical coverage of the Maltese Islands (NUTS 2 level)

Years 2022 and 2023.

Not applicable

Percentages of enterprises, Percentages of turnover, Percentages of employees and self-employed persons, Million euro.

The reference period corresponds to that in the model questionnaire

The National Statistics Office uses the Malta Statistics Authority Act as a legal foundation for its data collection exercise. This is a legally binding document empowering the National Statistics Office to collected the required data from individuals and enterprises alike.

Complementary national legislation constituting the legal basis for the survey on the use of ICT in enterprises:

https://msa.gov.mt/wp-content/uploads/2023/04/Malta_Statistics_Authority_Act.pdf

https://nso.gov.mt/en/Services/Microdata/Pages/Access-to-Microdata.aspx

https://nso.gov.mt/commitment-on-confidence/

Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4)) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.

At national level : 

Confidentiality is one of the major principles guiding the activities of the NSO.

Article 40 of the MSA Act stipulates the restrictions on the use of information and in Article 41, the prohibition of disclosure of information. Furthermore, Section IX of the Act (Offences and Penalties) lays down the measures to be taken in case of unlawful exercise of any officer of statistics regarding confidentiality of data. No cases of breaches in the law have been recorded to date.

Since its inception, the NSO has always operated within a culture of strict confidentiality to which it is also bound by the provisions of the Data Protection Act. This Act, which came fully into effect on July 15, 2003, seeks to protect individuals against the violation of their privacy by the processing of personal data.

Further information on access to microdata is available on the NSO's website through: https://nso.gov.mt/en/Services/Microdata/Pages/Access-to-Microdata.aspx

During 2009, the NSO has set up a Statistical Disclosure Committee to ensure that statistical confidentiality is observed, especially when requests for microdata are received by the NSO.

Upon employment, NSO employees are informed of the rules and duties pertaining to confidential information and its treatment. According to the MSA Act, before commencing work, every employee is required to take an oath of secrecy whose text is included in the Act.

At European level: Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20(4) of 11 March 2009 (OJ L 87, p. 164), stipulates the need to establish common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data with due account for technical developments and the requirements of users in a democratic society.

Data are transmitted via eDamis (encrypted) and delivered to a secure environment where they are treated. Flags are added for confidentiality in case results must not be disclosed.

At national level : 

Microdata is not made available outside NSO, even in anonymised form.  In addition, strata based on less than 3 readings are not published.

An annual news release is published usually in quarter one following the end of the reference year: thus this year's news release is scheduled to be issued circa January 2024.

A news release for the ICT in Enterprises Survey is usually published as scheduled by the official NSO release calendar, which is publicly available on https://nso.gov.mt/calendars/

https://nso.gov.mt/calendars/

The NSO publishes around 230 News Releases a year. All releases are published and disseminated at 1100 hrs as scheduled in the Advance Release Calendar. The calendar is published on the NSO website and includes a three-month advance notice (the current month and the forthcoming two months). It should be noted that the calendar is subject to changes.

News releases are scheduled in such a way so as to have only one release per working day. In exceptional cases, more than one release my be published on one particular day.​

Annual

Nationally, the News Release for the 2023 survey will be published in January 2024.

https://nso.gov.mt/ict-usage-and-e-commerce-in-enterprises-2023/

No Publications for the ICT in enterprises survey are foreseen.

See detailed section 10.3.1.

Results for selected variables collected in the framework of this survey are available for all participating countries on Digital economy and society of Eurostat website.

At national level :

No databases are available at national level, but selective variables (including yearly ad-hoc and main indicators) are published in the news release mentioned in point 10.1

Not applicable

Not requested

Not requested

National Metadata files are currently being published on : https://nso.gov.mt/themes_sources___met/ict-usage-by-enterprises

Not requested

None

The European businesses statistics compliers’ manual for ICT usage and e-commerce in enterprises provides guidelines and standards for the implementation of the surveys. It is updated every year according to the changed contents of the model questionnaires.

At national level :

All key variables are checked with their respective timeseries in order to assure consistency over time. Other variables, such as turnover are compared with other internal sources.  One is to point out that enterprises are being asked to provide information on turnover well before the figure for this variable is finalised.  As a result, this information may be of inferior quality.

European level :

At European level, the recommended use of the annual Eurostat model questionnaire aims at improving comparability of the results among the countries that conduct the survey on ICT usage and e-commerce in enterprises. Moreover, the Methodological Manual provides guidelines and clarifications for the implementation of the surveys.

National level :

All enterprises fulfilling the defined NACE and size criteria are selected. This population is extracted from the Business Register which is held and maintained by NSO. Sources used to back the Business Register include the Job Vacancies Survey and the Short Term Business Statistics.

European level : 

At European level, European Commission users (e.g. DG CNECT, DG GROW, DG JUST, DG REGIO, DG JRC) are the principal users of the data on ICT usage and e-commerce in enterprises and contribute in identifying/defining the topics to be covered. Hence, main users are consulted regularly (at hearings, task forces, ad hoc meetings) for their needs and are involved in the process of the development of the model questionnaires at a very early stage.

User needs are considered throughout the whole discussion process of the model questionnaires aiming at providing relevant statistical data for monitoring and benchmarking of European policies.

National level :

The main users of the data on ICT usage and e-commerce in enterprises are:

1) International organizations (such as UNESCO, OECD and EU)

2) Public Entities (such as ministries, authorities)

3) Private entities (research organizations, unions, businesses)

4) Individuals

ICT Enterprises statistics are mainly used for Policy making, market research, dissertations and business making.

European level : 

At European level, contacts within the Commission, the OECD and other stakeholders give a clear picture about the key users' satisfaction as to the following data quality aspects: accuracy and reliability of results, timeliness, satisfactory accessibility, clarity and comparability over time and between countries, completeness and relevance. Overall users have evaluated positively (good, very good) the data quality on the ICT usage and e-commerce in enterprises.

National level :

A user satisfaction survey was carried out by the NSO to measure the degree with which obligations towards its users are met.  The survey was last held in 2014, and results for the total statistical output for the Education and Information Society Statistics Unit, not specifically for ICT statistics, were as follows:

News Releases:

• Quality – 62.9 % high/good
• Timeliness – 77 % timely
• Usefulness – 80.3 % useful

Requested data:

• Quality – 54.8 % high/good
• Frequency – 5.4 % regular
• Timeliness –73.1 % timely

A dedicated news release outlines main results from this survey, and can be accessed through: 

https://nso.gov.mt/wp-content/uploads/News2014_089.pdf

Detailed information is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

Not requested. 

Comments on reliability and representativeness of results and completeness of dataset

These comments reflect overall standard errors reported for the indicators and breakdowns in section 13.2.1 (Sampling error - indicators) and the rest of the breakdowns for national and European aggregates, as well as other accuracy measurements. The estimated standard error should not exceed 2pp for the overall proportions and should not exceed 5pp for the proportions related to the different subgroups of the population (for those NACE aggregates for the calculation and dissemination of national aggregates). If problems were found, these could have implications for future surveys (e.g. need to improve sampling design, to increase sample sizes, to increase the response rates).

More detailed information is available in “ Annex II. _ Accuracy “ excel file - related to European aggregates, comments on reliability and use of flag.

For calculation of the standard error see 13.2.1.1.

Standard error (for selected indicators and breakdowns)

Precision measures related to variability due to sampling, unit non-response (the size of the subset of respondents is smaller than the size of the original sample) and other (imputation for item non-response, calibration etc.) are not (yet) required from the Member states for all indicators.  Eurostat will make basic assumptions to compute these measures for all indicators produced (e.g. stratified random sampling assuming as strata the crossing of the variables “Number of employees and self-employed persons” and “Economic Activity” as it was defined in the 3 tables of section 18.1).

More detailed information is available in“ Sample and standard error tables 2023 “ excel file – worksheets starting with “Standard error".

Calculation of the standard error

Various methods can be used for the calculation of the standard error for an estimated proportion. The aim is to incorporate into the standard error the sampling variability but also variability due to unit non-response, item non-response (imputation), calibration etc. In case of census / take-all strata, the aim is to calculate the standard errors comprising the variability due to unit non-response and item non-response.

See detailed sections below.

See concept 18.1.1. A) Description of  frame population.

A census of enterprises was carried out.

Not requested

A census of enterprises was carried out.

See detailed sections below.

See detailed sub-concepts below.

The following table contains the number of units (i.e. enterprises), by type of response to the survey and by the percentage of these values in relation to the gross sample size.

Participating in this survey is made compulsory under Maltese Law, MSA ACT (XXIV) of 2004. We allowed the enterprises to submit their completed questionnaire via email, or through a provided postage paid self addressed envelope. Around 30% of enterprises opted for these options. The remaining where allocated to interviewers to personally contacted their enterprises and assisted them in filing in the survey. Those refusing any of the options provided where consequently chased legally by our lawyers under the terms of the said act. 

None

The item non-response rate is negligable, as interviewers chase enterprises to obtain a complete response.

Other comments relating to the item non-response

No processing errors were detected.

Not requested

See detailed section below.

Not applicable

European level : 

Data are to be delivered to Eurostat in the fourth quarter of the reference year (due date for the finalised dataset is 5th October). European results are released before the end of the survey year or in the beginning of the year following the survey year (T=reference year, T+0 for indicators referring to the current year, T+12 months for other indicators referring to the previous year e.g. e-commerce).

At national level : 

Data is finalized and submitted to Eurostat by the 5th October.
National results are released in the beginning of the year following the survey year

 See detailed section below.

Data was submitted and validated on 29/9/2023.

The model questionnaire is generally used by the countries that conduct the survey on ICT usage and e-commerce in enterprises. Due to (small) differences in translation, in the used survey vehicle, in non-response treatment or different routing through the questionnaire, some results for some countries may be of reduced comparability. In these cases, notes are added in the data.

Detailed information on differences in the wording of the questions in the national questionnaires is available in “ Annex I _ Completeness “ excel file - related to questionnaire, coverage, additional questions.

Not applicable

See section below.

The length of comparable time series depends on the module and the variable considered within each survey module. Additional information is available in annexes attached to the European metadata.

The main benchmarking indicators for the digital agenda have been collected since 2005 and are consistently comparable over time.

Not applicable

 Not applicable

Not applicable

Not applicable

 Data is not normally subject to revisions.

Not available

 Not requested

A) Frame population description and distribution

For more information see concept 18.1.1.

B) Sampling design - Sampling method

Description of the sampling method used (e.g. stratified random sample, quota sampling, cluster sampling; one-stage or two-stage sampling) and information which variables were used to stratify, the categories of those variables, in particular for the NACE Rev. 2 categories related to the "possible calculation of European aggregates", and the final number of strata: 

Due to the limited number of enterprises in the local economy, a census of all in scope enterprises has been carried out for this survey.

C) Gross sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: GROSS SAMPLE)

D) Net sample distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: NET SAMPLE)

A) Description of frame population

 B) Frame population distribution

More detailed information is available in “ Sample and standard error tables 2023  “ excel file (Worksheet: FRAME POPULATION)

Annual

See detailed sections below.

Surveys to all enterprises employing 10 or more employees were sent by email in excel format, for enterprises who's email address was not available, surveys were sent by post.

Enterprises can return the filled in questionnaire by email, always in excel format, which is later uploaded directly into our data entry program. The questionnaires can also be returned by post, these will need to be manually inputted into our data entry program. 

On average, about 98% of responses are submitted via email.

Interviewers are also utilised to solicit response and assist the respondents in filling in the questionnaire. Interviewers are only engaged for enterprises who didn't submit a reply during the first round of data collection.

An internal validation program is used during the inputting stage.

Grossing-up procedures

Total number of enterprises, employees and total turnover are weighted separately. Total Population and turnover estimates are based on the business register held by the NSO.

Both grossing up weights are based on the size class and NACE category of the enterprise.

Given that a census of all eligible enterprises is carried out, resulting weights tend to be relatively small.

Minimal

Not applicable

Not applicable

Problems encountered and lessons to be learnt: