Statistics Norway

Division for Education Statistics

Oterveien 23

2211 Kongsvinger

Norway

The Continuing Vocational Training Survey (CVTS) collects information on enterprises’ investment in the continuing vocational training of their staff. Continuing vocational training (CVT) refers to education or training measures or activities which are financed in total or at least partly by the enterprise (directly or indirectly). Part financing could include the use of work-time for the training activity as well as financing of training equipment.

Information available from the CVTS is grouped around the following topics:

- Provision of CVT courses and other forms of CVT (training/non-training enterprises)

- CVT strategies

- Participants in CVT courses

- Costs of CVT courses

- Time spent in CVT courses

- Characteristics of CVT courses

- Assessment of CVT activities

The CVTS also collects some information on initial vocational training (IVT).

For further information see the CVTS 6 legislation (http://ec.europa.eu/eurostat/web/education-and-training/legislation) and the CVTS 6 implementation manual (http://ec.europa.eu/eurostat/web/education-and-training/methodology).

The main groupings for enterprises are by economic activity (NACE), size group and training/non-training enterprises.

CVTS 6 covers economic activities defined in sections B to N and R to S of NACE Rev. 2. 

Definitions as well as the list of variables covered are available in the CVTS 6 implementation manual (http://ec.europa.eu/eurostat/web/education-and-training/methodology).

The statistical unit for CVTS 6 is the enterprise.

Enterprise definition is compliant with Council Regulation (EEC) No 696/93.

CVTS 6 covers enterprises with 10 or more persons employed belonging to certain NACE categories (see 3.3).

The total population covers 27 228 enterprises.

Variable A2tot (persons employed) refers to 31 December 2020.

Enterprises from the entirety of Norway, with the exception of Svalbard, are included in the survey.

1999, 2005, 2010, 2015, 2020

Not applicable.

Number, EUR.

The reference year for CVTS 6 is the calendar year 2020.

At European level

Basic legal act: Regulation (EC) No 1552/2005 of the European Parliament and the Council

Implementing act: Commission Regulation (EU) No 1153/2014, amending Commission Regulation (EC) No 198/2006

At national level:

The Statistics Law (LOV-2019-06-21-32) §1, §10.

Not applicable.

The data transmitted to Eurostat are de-identified in line with the regulations for CVTS 6. 

The data transmitted to Eurostat are de-identified in line with the regulations for CVTS 6. Only aggregated data are made accessible to the public.

All releases of statistical data from Statistics Norway must be announced in its release calendar three months before the planned release date.

https://www.ssb.no/en/kommende-publiseringer 

The released data is made available to the public on Statistics Norway's web page. The dissemination follows the European Statistics Code of Practice, principle 6 on impartiality. As such, no pre-releases were given, and the release of the data was announced publicly three months prior to the data release. 

Every 5 years.

There were no press releases linked to the data set.

An article written in Norwegian titled 'Auke i etterspørsel etter IT-kompetanse' was published concurrently with the publishing of results to the national database. Link to article: https://www.ssb.no/utdanning/voksenopplaering/statistikk/opplaering-i-bedrifter/artikler/auke-i-ettersporsel-etter-it-kompetanse

We also published two new articles, one comparing the international CVTS-results and the other one focusing on Covid-19:

https://www.ssb.no/utdanning/voksenopplaering/statistikk/opplaering-i-bedrifter/artikler/redusert-opplaeringstilbud-hos-foretak-i-norge-og-eu-i-2020

https://www.ssb.no/utdanning/voksenopplaering/statistikk/opplaering-i-bedrifter/artikler/covid-19-forte-til-mindre-opplaering-i-norske-foretak

Data on the national level are accessible via a national database at: https://www.ssb.no/en/utdanning/voksenopplaering/statistikk/opplaering-i-bedrifter

Not applicable.

Dissemination of microdata via Eurostat.

Microdata for the survey are primarily available via Eurostat.

Not applicable.

For each wave of the CVTS a detailed implementation manual is available which contains definitions and additional methodological explanations, a European standard questionnaire and the code book.
The implementation manual for CVTS 6 is available in CIRCABC.

Additional notes on the national implementation and results are available in the About the statistics-section of Statistics Norway's web page for the survey.

Not applicable.

This quality report as well as the material listed in 10.6.

Several automatic checks were implemented in the web-questionnaire to prevent erroneous answers. The questionnaire was tested several times in order to assure that these checks and all filters work correctly. Plausibility checks of the variables A4, A5 and C3 by calculation of mean values per employee and per hour. Mean imputation was used to impute key variables and data were validated with the EDAMIS control program.

Overall assessment: CVTS is the only source of internationally comparable data on CVT. Norwegian results are of sufficiently high quality to be used in such comparisons and Norway has a high response rate. However, the survey is demanding for both the respondents and in terms of data editing. The survey is time consuming for the respondents and answering the quantitative variables requires demand a high level of consistency and memory from the respondents.

Problems encountered and lessons to be learnt: completing the survey is challenging for some enterprises, especially for small enterprises. Not all enterprises have good systems for collecting information on participation in CVT and costs related to participation, and some enterprises responded that if they had known that they were to participate before the reference year, they could have collected the data simultaneously as they gave CVT to their persons employed.

Key users of the statistic are the national government ministries for labour and education, employers' organisations and trade unions.

Consultation meetings were held with these key users. The purpose of these meetings were to uncover common needs for these users, especially related to the scope and content of the national database. These users were particularly interested in indicators related to future skill needs, CVT strategies as well as the cost of CVT.

Several of these key users voiced concerns with the lack of data at a regional level as they had an unmet need for comparisons of CVT between regions.

No user satisfaction surveys were conducted.

No enterprises with more than 250 persons employed in the category NACE 3 registered. Furthermore, the dataset does not contain enterprises with size 3 in the NACE-categories 5, 6 and 19. These had to be coded as unit-non-response as there were few respondents and because key variables could not be imputed since rules for imputation within this NACE Rev2./size cell were not met.

No enterprises with 250 employees or more in the category NACE 3 were registered. 

Coefficients of variation were calculated in SAS Enterprise Guide. It is important to note that the estimation method used calculates coefficients of variations based on the assumption that the sample is a simple random sample, whereas Norway used stratification when drawing the sample.

Coefficients of variation reveal that the level of accuracy varies between different size groups and NACE categories. Especially among the smallest enterprises, estimates have high coefficients of variation. One should also bear in mind that answering the quantitative variables was very demanding for the enterprises and that implausible entries were imputed when assessing the accuracy of the estimates. See also table 18.5.1 "Imputation - rate" in annex "NO - QR tables CVTS 2020 (excel)".

The sampling method used was stratified random sampling and the sample size was calculated based on the anticipated proportion training enterprises (q) and the anticipated response rate (r). Proportion and response were set for each of the three size categories for all enterprises, before sample size calculation. 

It was sampled from the register applying a stratified random sample procedure. The population consists of 27228 enterprises, of which 3127 were selected in the gross sample. The calculation of gross sample sizes was based on assumptions about the proportion of training enterprises (q) and the response rate among training enterprises (r) within each stratum. Size was used when calculating gross sample size based on assumptions. 

10-49 employees: q=0.7; r=0.35

50-249 employees: q=0.9; r=0.35

250 or more employees: q=1.0; r=0.5

When the sample size was calculated to be more than 80 percent of the stratum, then all enterprises in the sampling frame stratum were included in the gross sample stratum. When no enterprise was present in the sample frame stratum the gross sample stratum size was set to zero enterprises. Gross sample size was calculated from the formula:

= 1/((q*0.2**2 + 1/NSTRA_SP)*r)

This can be read as: Gross sample for each stratum = 1 /((proportion of training enterprises*0.2**2+1/Number of enterprises in the stratum defined by number of enterprises in the industry and the size group of the enterprise)*response rate among training enterprises. 

See table 13.2.1 "Sampling errors - indicators" in annex "NO - QR tables CVTS 2020 (excel)".

See items 13.3.1 - 13.3.5.

The sampling frame was the Norwegian Business Register. The register is of good quality and both over- and under-coverage are usually fairly small. However, there are changes especially among the smallest enterprises, which are less stable. Small enterprises more often close down than the large ones and they are also more prone to be taken over by others than large local units. Accordingly, we must expect some movement between different size groups from the point of time when the sample was drawn to the time of interview.

See table 13.3.1 "Coverage error" in annex "NO - QR tables CVTS 2020 (excel)".

See table 13.3.1.1 "Over-coverage - rate" in annex "NO - QR tables CVTS 2020 (excel)". 

Not applicable.

Several automatic checks were implemented in the web-questionnaire to prevent erroneous answers. The web-questionnaire was tested by experts in order to control whether these checks and the filters work correctly, as well as it was checked whether all concepts and definitions are understandable.

The overall unit non-response rate is 23.1%, but there are differences between different size-groups and NACE-categories. The highest level of unit non-response is among enterprises with more than 250 employees, with 33.2%, whereas only 15.3% of the enterprises in size-group 1 are unit non-responses. As for NACE-categories, the level of unit non-response ranges from 12.8% in NACE-category 18 to 37.4% in category 1. The majority of unit non-responses is due to refusal of the enterprise to participate in the survey, whereas only 64 questionnaires had to be rejected due to a too high level of item non-response. CAWI - Computer aided web interviewing was the data collection method used. All participating enterprises got a letter with an identity number and password to log into a webpage. Technical and professional assistance were available by phone and e-mail. A follow-up survey was conducted in the period 01.11.2021-23.11.2021.

Variables with a high level of item non-response are first and foremost those concerning the number of CVT participants, working hours spent on CVT courses and costs of such courses in enterprises that provided CVT courses.

Unit non-response was adjusted for by weighting, see 13.3.3.

See table 13.3.3.1 "Unit non-response - rate" in annex "NO - QR tables CVTS 2020 (excel)".

See table 13.3.3.2 "Item non-response - rate" in annex "NO - QR tables CVTS 2020 (excel)".

SAS Enterprise Guide was used in order to code the raw-data according to the codebook. Data were validated using the struval/conval control programmes embedded in Edamis before submission to Eurostat. Data were adjusted for non-response using weighting. Weights were calculated in a multi-stage process. First, initial weights were calculated based on the number of firms in the net sample compared to the known number of firms within each of the 60 strata used in the sampling. These weights were then adjusted through calibration using known population totals for number of firms in three size groups and 20 NACE categories and known population totals for number of persons employed in three size groups and 20 NACE categories. Weights < 1.0 were rounded up to 1.0. The resulting weights, when used in estimating population totals for the number of firms and persons employed in the three size groups and 20 NACE categories, yield results equal to the true population totals at the time of sampling. It is, however, important to note that the estimated population totals within the 20 NACE by three size groups will vary from the true population totals.

Not applicable.

T + 14 months.

The first results from the survey were published 18 months after the end of the reference period.

The final results from the survey were published 18 months after the end of the reference period.

Data were transmitted to Eurostat 14 months after the end of the reference year.

See table 14.2 "Project phases - dates" in annex "NO - QR tables CVTS 2020 (excel)".

Not applicable.

No deviations from European concepts.

See table 15.1 "Comparability - geographical" in annex "NO - QR tables CVTS 2020 (excel)".

Some additional variables/information related to COVID-19 were collected, see table 15.1. 

Not applicable.

There were no major changes to the questionnaire for CVTS 6 and as such there should be neither a break in the time series nor differing definitions from CVTS 5.

An alternate approach to imputation for certain strata allowed us to keep observations in strata which were absent due to item-non-response in CVTS 5. These strata together amounted to 19 enterprises. For further details see table 18.5.1 "Imputation - rate" in annex "NO - QR tables CVTS 2020 (excel)".

There was a slight change in the sampling frame for NACE 18 where enterprises belonging to the institutional sector for banks have been included. Still, the total number of enterprises in NACE 18 in the sampling frame for CVTS 6 at 190 enterprises is lower than for CVTS 5 at 193 enterprises. Neither of these changes were considered severe enough to qualify as a break in the time series.

In the Norwegian CVTS 3, the statistical units were local units, not enterprises.

See also table 15.2 "Comparability - over time" in annex "NO - QR tables CVTS 2020 (excel)".

Not applicable.

See table 15.3 "Coherence - cross-domain" in annex "NO - QR tables CVTS 2020 (excel)".

Not applicable.

Not applicable.

CVTS results for a given reference year are based on the same microdata and results are calculated using the same estimation methods, therefore the data are internally coherent.

CAWI was used as a method for data collection. Using a web-questionnaire requires less resources than conducting CATI-interviews, but may also be more prone to misunderstandings and errors committed by the responding enterprises. Thus, enterprises responding to the survey were given the possibility to take contact with Statistics Norway if they had any questions on the survey.

The survey is regarded as burdensome both for the responding enterprises and in terms of editing of the data. Completing the survey is challenging for some enterprises, especially for small enterprises, and because the questionnaire contains a lot of questions. Not all enterprises have good systems for collecting information on participation in CVT, and some enterprises responded that if they had known that they were to participate before the reference year, they could have collected the data simultaneously as they gave CVT to their persons employed. When editing of the raw data is concerned, a lot of resources have to be spent on checking the plausibility of the data and on imputing missing values in order to assure that data transmitted to Eurostat are of high quality.

Not applicable.

Not applicable.

Not applicable.

See table 18.1 "Source data and data collection" in annex "NO - QR tables CVTS 2020 (excel)".

Every 5 years.

See also table 18.1 "Source data and data collection" in annex "NO - QR tables CVTS 2020 (excel)".

Several automatic checks were implemented in the web-questionnaire to prevent erroneous answers. Data editing and coding of the data according to the codebook using SAS Enterprise Guide. Data were validated with the EDAMIS control program in order to conduct field level and record level checks. Field level checks control whether valid codes and ranges are used and check for the coherence between a variable entry and allowed entries, whereas record level checks test the consistency between variables for a single enterprise record.

The results from the survey are compiled and subjected to controls for internal consistency and item non-response before moving on to imputing missing values.

Mean-imputation using the mean for the responding enterprises in the same strata was utilized for imputing missing values on key variables in order to keep observations with partial item non-response on key variables. In strata where there was not sufficient basis for imputation the mean was calculated of the basis of all valid observations within the same NACE section and the same size group. This affected the strata with size group 3 and Nace groups 5, 6 and 19. For further details, see table 18.5.1 "Imputation - rate" in annex "NO - QR tables CVTS 2020 (excel)".

Weights were calculated in a multi-stage process. First, initial weights were calculated based on the number of firms in the net sample compared to the known number of firms within each of the 60 strata used in the sampling. These weights were then adjusted through calibration using known population totals for number of firms in three size groups and 20 NACE categories and known population totals for number of persons employed in three size groups and 20 NACE categories. Weights < 1.0 were rounded up to 1.0.

See table 18.5.1 "Imputation - rate" in annex "NO - QR tables CVTS 2020 (excel)".

Not applicable.

Not applicable.

No further comments.