Community innovation survey 2018 (CIS2018) (inn_cis11)

National Reference Metadata in Single Integrated Metadata Structure (SIMS)

Compiling agency: Statistical office of the Republic of Slovenia


Eurostat metadata
Reference metadata
1. Contact
2. Metadata update
3. Statistical presentation
4. Unit of measure
5. Reference Period
6. Institutional Mandate
7. Confidentiality
8. Release policy
9. Frequency of dissemination
10. Accessibility and clarity
11. Quality management
12. Relevance
13. Accuracy
14. Timeliness and punctuality
15. Coherence and comparability
16. Cost and Burden
17. Data revision
18. Statistical processing
19. Comment
Related Metadata
Annexes (including footnotes)
 



For any question on data and metadata, please contact: Eurostat user support

Download


1. Contact Top
1.1. Contact organisation

Statistical office of the Republic of Slovenia

1.2. Contact organisation unit

Social services statistics section

1.5. Contact mail address

Statistični urad Republike Slovenije
Litostrojska cesta 54
1000 Ljubljana
Slovenija


2. Metadata update Top
2.1. Metadata last certified 01/07/2021
2.2. Metadata last posted 01/07/2021
2.3. Metadata last update 01/07/2021


3. Statistical presentation Top
3.1. Data description

The Community Innovation Survey (CIS) is a survey about innovation activities in enterprises. The survey is designed to collect the information on different types of innovation, various aspects of the development of an innovation, objectives of innovation activities, sources of information, public funding or expenditure on innovation. It is aim is to measure the innovativeness of sectors and enable the analysis of the factors of innovation.

The CIS provides statistics by type of innovators, economic activities and size class of enterprises. The survey is currently carried out every two years across the EU Member States, EFTA countries and EU candidate countries.

In order to ensure comparability across countries, Eurostat together with the countries developed a Harmonised Data Collection (HDC) questionnaire accompanied by a set of definitions and methodological recommendations.

CIS 2018 concepts and its underlying methodology are based on the Oslo Manual (2018) 4th Edition

 

New review of the CIS2018  aims to meet several objectives :

1: Reduce subjectivity and biases in the main CIS indicators

2: Improve reporting about innovation activities and capabilities in the firm

3: Ensure international comparability (including compliance with the OM4)

4: Broaden the basis CIS information on enterprise management

5: Take better account the diversity of enterprises in the EU

6: Improve reporting about external drivers and enablers of innovation

7: Improve timeliness

8: Ensure the feasibility of data collection

9: Ensure continuity with the CIS 2016

10: Improve reporting about the output and impact of innovation

 

CIS2018 is conducted under Commission Regulation No 995/2012. This Regulation defines the mandatory target population of the survey referring to enterprises in the Core NACE economic sectors (see section 3.3.) with at least 10 employees. Further activities may be covered on a voluntary basis in national datasets. Most statistics are based on the 3-year reference period (t, t-1, t-2), but some use only one calendar year (t or t-2).

Please consider CIS t to be the survey that refers to the same year of the quality report and CIS t-2 to be the previous survey e.g.: CIS  2018= CIS t then, CIS t-2=CIS 2016

3.2. Classification system

Indicators related to the enterprises are classified by country, economic activity (NACE Rev. 2), size class of enterprises and type of innovation.

The main typology of classification of enterprises in reference to innovation is the distinction between innovation-active enterprises (INN) and not innovation-active enterprises (NINN).

The enterprise is considered as innovative (INN) if during the reference period it successfully introduced a product or business process innovation, had ongoing innovation activities, abandoned innovation activities or was engaged in in-house R&D or R&D contracted out. Non-innovative (NINN) enterprises had no innovation activity mentioned above whatsoever during the reference period.

3.3. Coverage - sector

CIS covers main economic sectors according to NACE Rev.2 broken down by size class of enterprises and type of innovation activity.

3.3.1. Main economic sectors covered - NACE Rev.2

In accordance with Commission Regulation 995/2012 on innovation statistics, the following industries and services are included in the core target population. Results are made available with these following breakdowns :

All NACE – Core NACE (NACE Rev. 2  sections & divisions B-C-D-E-46-H-J-K-71-72-73 )

 

CORE INDUSTRY (excluding construction) (NACE Rev. 2 SECTIONS B_C_D_E)

10-12: Manufacture of food products, beverages and tobacco

13-15: Manufacture of textiles, wearing apparel, leather and related products

16-18: Manufacture of wood, paper, printing and reproduction

20: Manufacture of chemicals and chemical products

21: Manufacture of basic pharmaceutical products and pharmaceutical preparations

19-22: Manufacture of petroleum, chemical, pharmaceutical, rubber and plastic products

23: Manufacture of other non-metallic mineral products

24: Manufacture of basic metals

25: Manufacture of fabricated metal products, except machinery and equipment

26: Manufacture of computer, electronic and optical products

25-30: Manufacture of fabricated metal products (except machinery and equipment), computer, electronic and optical products, electrical equipment, motor vehicles and other transport equipment

31-33: Manufacture of furniture; jewellery, musical instruments, toys; repair and installation of machinery and equipment

 

D: ELECTRICITY, GAS, STEAM AND AIR CONDITIONING SUPPLY

 

E: WATER SUPPLY; SEWERAGE, WASTE MANAGEMENT AND REMEDIATION ACTIVITIES

36: Water collection, treatment and supply

37-39: Sewerage, waste management, remediation activities

 

CORE SERVICES (NACE Rev. 2 sections & divisions 46-H-J-K-71-72-73)(NACE code in the tables = G46-M73_INN)

46: Wholesale trade, except of motor vehicles and motorcycles

 

H: TRANSPORTATION AND STORAGE

49-51: Land transport and transport via pipelines, water transport and air transport

52-53: Warehousing and support activities for transportation and postal and courier activities

 

J: INFORMATION AND COMMUNICATION

58: Publishing activities

61: Telecommunications

62: Computer programming, consultancy and related activities

63: Information service activities

 

K: FINANCIAL AND INSURANCE ACTIVITIES

64: Financial service activities, except insurance and pension funding

65: Insurance, reinsurance and pension funding, except compulsory social security

66: Activities auxiliary to financial services and insurance activities

 

M: PROFESSIONAL, SCIENTIFIC AND TECHNICAL ACTIVITIES

71: Architectural and engineering activities; technical testing and analysis

72: Scientific research and development

73: Advertising and market research

71-73: Architectural and engineering activities; technical testing and analysis; Scientific research and development; Advertising and market research

 

3.3.1.1. Main economic sectors covered - NACE Rev.2 - national particularities

No deviations;  all of the above NACE activities were included in core target population and form the brakedowns as defined above.

3.3.2. Sector coverage - size class

In accordance with Commission Regulation 995/2012 on innovation statistics, the following size classes of enterprises according to number of employees are included in the core target population of the CIS:

  • 10 - 49 employees
  • 50 - 249 employees
  • 250 or more employees
3.3.2.1. Sector coverage - size class - national particularities

No deviations.

3.4. Statistical concepts and definitions

The description of concepts, definitions and main statistical variables is available in CIS 2018 European metadata file (ESMS) Results of the community innovation survey 2018 (CIS2018) (inn_cis11) in Eurostat database.

3.5. Statistical unit

Statistical unit is legal unit (LeU) from Statistical Business Register.

3.6. Statistical population

Core target population are legal units (LeU) from Statistical Business Register in CORE NACE activities (see 3.3.1) with 10 or more employees.

3.7. Reference area

The level of the reference area is the country of Slovenia (SI0).

Regional dimension is not available.

3.8. Coverage - Time

Several rounds of Community Innovation Survey have been conducted so far at two-year interval since end of 90’s.

3.8.1. Participation in the CIS waves

 

CIS wave Reference period Participation Comment (deviation from reference period)
CIS2 1994-1996  Yes  
CIS3 1998-2000  Yes   
CIS light 2002-2003*  Yes  
CIS4 2002-2004  Yes  
CIS2006 2004-2006  Yes  
CIS2008 2006-2008  Yes  
CIS2010 2008-2010  Yes  
CIS2012 2010-2012  Yes  
CIS2014 2012-2014  Yes  
CIS2016 2014-2016  Yes  
CIS2018 2016-2018  Yes  

*two reference periods can be distinguished for CIS light: 2000-2002 and 2001-2003

3.9. Base period

Not relevant.


4. Unit of measure Top

CIS indicators are available according to 3 units of measure:

NR: Number for number of enterprises and number of persons employed.

THS_EUR: Thousands of euros. All financial variables are provided in thousands of euros, i.e. Turnover or Innovation expenditure.

PC: Percentage. The percentage is the ratio between the selected combinations of indicators.


5. Reference Period Top

For CIS 2018, the time covered by the survey is the 3-year period from the beginning of 2016 to the end of 2018.

Some questions and indicators refer to one year — 2018.

The list of indicators covering the 3-year period and referring to one year according to the HDC is available in the Annex section of the European metadata (ESMS). 


6. Institutional Mandate Top
6.1. Institutional Mandate - legal acts and other agreements

CIS surveys are based on the Commission Regulation No 995/2012, implementing Decision No 1608/2003/EC of the European Parliament and of the Council on the production and development of Community statistics on science and technology.

This Regulation establishes innovation statistics on a statutory basis and makes the delivery of certain variables compulsory e.g. innovation activities, cooperation, development, expenditures and turnover (see the Regulation). Each survey wave may additionally include further variables. 

In addition, the Regulation defines the obligatory cross-coverage of economic sectors and size class of enterprises.

6.1.1. National legislation
6.2. Institutional Mandate - data sharing

Not requested.


7. Confidentiality Top

CIS data are transmitted to Eurostat via EDAMIS using the secured transmission system.

7.1. Confidentiality - policy

Regulation (EC) No 223/2009 on European statistics (recital 24 and Article 20 (4)) of 11 March 2009 (OJ L 87,p.164), stipulates the need to establishe common principles and guidelines ensuring the confidentiality of data used for the production of European statistics and the access to those confidential data. All data collected and published by the Statistical Office are governed by the National Statistical Act (OJ) RS No. 45/95 and No. 9/01.

7.2. Confidentiality - data treatment

Cell suppression is used for protection of sensitive cells.


8. Release policy Top
8.1. Release calendar

The release calendar with advanced release dates for all months of the reference year is published at the beginnig of the year on a website of the Statistical Office of the RS. The release calendar is publicly accessible.

8.2. Release calendar access

Link to release calendar: https://www.stat.si/StatWeb/en/ReleaseCal

8.3. Release policy - user access

The most important information channel for data publication is the website https://www.stat.si/StatWeb/en. The Office publishes electronic and printed publications. The Office publishes several types of serial publications, different series and other publications which are according to the content intended for different users (e.g. general public, professional public, statistical experts). Statistical data and information are always published at 10.30. All releases are announced at the Office’s website https://www.stat.si/StatWeb/en/ReleaseCal in Release calendar. None of the usres have a prior access to the data on other services. The simultaneous issue of the First Release is ensured. Same release policy applied to national release is applied to transmission to Eurostat.


9. Frequency of dissemination Top

No deviations. CIS is conducted and disseminated at two-year interval in pair years.


10. Accessibility and clarity Top

Accessibility and clarity refer to the simplicity and ease for users to access statistics using simple and user-friendly procedure, obtaining them in an expected form and within an acceptable time period, with the appropriate user information and assistance: a global context which finally enables them to make optimum use of the statistics.

10.1. Dissemination format - News release

See below.

10.1.1. Availability of the releases
Dissemination and access Availability Comments, links, ...
Press release X

First Release is published on website 16 months after the end of the reference period.

Final data (detailed data published in database) are available 21 months after the end of the reference period.

Access to public free of charge   X Data are available on website free of charge.
Access to public restricted (membership/password/part of data provided, etc)    
10.2. Dissemination format - Publications

-              Online database (containing all/most results) : SiStat Database, thems Development and Technology

-              Analytical publication (referring to all/most results) : /

-              Analytical publication (referring to specific results, e.g. only for one sector or one specific aspect) : /

10.3. Dissemination format - online database

SiSTAT Database, themes Development and technology

SiSTAT data portal provides a modern way of preparing and exporting data for selected categories.

 

10.3.1. Data tables - consultations

Not requested.

10.4. Dissemination format - microdata access

In Slovenia, the entities entitled to obtain the statistically protected microdata include the registered researchers. Basic instructions concerning the access and the use of statistically protected microdata are available on the website: http://www.stat.si/StatWeb/en/StaticPages/Index/For-Researchers.

10.4.1. Dissemination of microdata
Mean of dissemination Availability of microdata Comments, links, ...
Eurostat SAFE centre    
National SAFE centre  X Data are available under special conditions. More instructions are available on http://www.stat.si/StatWeb/en/StaticPages/Index/For-Researchers
Eurostat: partially anonymised data (SUF)    
National : partially anonymised data    
10.5. Dissemination format - other

The CIS data are transmited to Eurostat according to legislation in order to compile EU aggregates and for the dissemination of national data in Eurostat's dissemination database.

10.5.1. Metadata - consultations

Not requested.

10.6. Documentation on methodology

Methodological explanations for innovation statistics are available on the website: https://www.stat.si/statweb/en/Methods/QuestionnairesMethodologicalExplanationsQualityReports Theme: Development and Technology, Sub-theme: Researc, Development and Innovation. There is an automatic link to the methodological explanations, quality report and questionnaire.

10.6.1. Metadata completeness - rate

Not requested.

10.7. Quality management - documentation

Quality reports for innovation statistics are available on the website: https://www.stat.si/statweb/en/Methods/QuestionnairesMethodologicalExplanationsQualityReports Theme: Development and Technology, Sub-theme: Researc, Development and Innovation. There is an automatic link to the methodological explanations, quality report and questionnaire.


11. Quality management Top
11.1. Quality assurance

Quality documentation can be reached on SURS website: https://www.stat.si/statWeb/en/Methods/QuestionnairesMethodologicalExplanationsQualityReports

11.2. Quality management - assessment

CIS is produced in compliance with methodological requirements and standards.

The survey type was a combination of on-line survey and self-administered mail survey (postal survey). Majority of questionnaires was filled out in electronic form.

We also trained staff that can offer assistence to enterprises in completing the questionnaire through telephobe and e-mail.

Data controls are implemented at both micro and macro levels.

First controls are implemented already during the data collection phase and are included in the electronic questionnaire. These controls warn the respondent about inconsistent or illogical data he filled in.

In the second phase, when the data are transferred to a different environment, additional logical controls of microdata are implemented, namely controls of variables for which we did not receive an answer (item non-response), inconsistency between tables, and controls on financial data that stand out (outliers). We contact key enterprises (those with more than 50 employees) by phone and check the data again and, if necessary, we correct or adjust  the data with their approval.

In the third phase, we also check item non-response and consistency between tables. These are mainly data corrections for units that we have not been able to contact, so we perform system corrections and imputations of the values ​​of missing variables. We used the Hot Deck Imputation Methods and Nearest-Neighbour Imputation.

In the last phase, controls prepared by Eurostat are included and, where appropriate, we also compare aggregate statistics with the previous period.

 

 


12. Relevance Top
12.1. Relevance - User Needs

The users of the data are public sector, business entities whose activities are observed, national and foreign researches and students.

Communication with individual reporting units and users of our statistical data is carried out directly by telephone, fax or e-mail, by interested persons visiting  the consultant at SURS, and also through the SURS Information Centre within the User Relations Section.

The most important part of communicating with users is done through the Statistical Advisory Committee for R&D and Technology. The Statistical Advisory Committee is a consultative body that enables the exchange of information and good practices, perceives the needs of domestic users of data and information in the fields of science, technology and innovation, and complements the surveys conducted both on the bases of EU legislation and the needs of domestic users (see 12.1.1.).

 

12.1.1. Needs at national level
User group Short description of user group Main needs for CIS data of the user group Users’ needs
1. Institutions: European level DG ENTR  Statistics
1. Institutions: International organisations OECD  Statistics 
1. Institutions: National level Institute of Macroeconomic Analysis and Development, Ministry of Economic Development and Technology Analyses, figures, comments, statistics 
2. Social actors  Chamber of Commerce of Slovenia Analyses, figures, comments, statistics
4. Researches and students Universities, researches, students Analyses, figures, comments, statistics, ad-hoc services, access to microdata
5. Enterprises or businesses Businesses from individual activities Analyses, figures, comments, statistics

 

The most important part of communicating with users is done through the Statistical Advisory Committee for R&D and Technology. The Statistical Advisory Committee is a consultative body that enables the exchange of information and good practices, perceives the needs of domestic users of data and information in the fields of science, technology and innovation, and complements the surveys conducted both on the bases of EU legislation and the needs of domestic users. Members of the Statistical Advisory Committee are the most important users of R&D and innovation statistics coming from the field of science and research from the public sector and persons from the Statistical Office dealing with this area. Occasionally, depending on the topic discussed at the Statistical Advisory Committee, guests from various institutions are also invited.

The Statistical Advisory Committee meets once per year. For more about the work of the committee see https://www.stat.si/StatWeb/en/NationalStatistics/AdvCommittees

Communication with individual reporting units and users of our data is carried out directly by telephone, fax or e-mail, by visiting interested persons at the consultant, and also through the Information Centre of the Statistical Office within User Relations Section.

12.2. Relevance - User Satisfaction

SURS measured general user satisfaction for the last time in 2018. Respondents assessed general satisfaction with SURS with the average score of 7.5 (on a scale from 1 – disagree completely to 10 – agree completely).

Based on users’ feedback, we estimate that they are satisfied with the data on innovation activity (both with the amount of published data and the way they are published).

12.3. Completeness

All statistics that are required by current Regulation are available.

12.3.1. Data completeness - rate

Not requested.


13. Accuracy Top
13.1. Accuracy - overall

Accuracy in the statistical sense denotes the closeness of computations or estimates to the exact or true values. Statistics are not equal with the true values because of variability (the statistics change from implementation to implementation of the survey due to random effects) and bias (the average of the possible values of the statistics from implementation to implementation is not equal to the true value due to systematic effects).

13.2. Sampling error

That part of the difference between a population value and an estimate thereof, derived from a random sample, which is due to the fact that only a subset of the population is enumerated.

13.2.1. Sampling error - indicators

The main indicator used to measure sampling errors for CIS data is the coefficient of variation (CV).

 

Coefficient of Variation= (Square root of the estimate of the sampling variance) / (Estimated value)

Formula:

 

where

13.2.1.1. Coefficient of variations for key variables

Coefficient of variation (%) for key variables by NACE categories and for enterprises with 10 and more employees

NACE

Size class

(1)

(2)

(3)

Core NACE (B-C-D-E-46-H-J-K-71-72-73)

Total

1.68

 5.16

 2.51

Core industry (B_C_D_E - excluding construction)

Total

2.14 

6.08 

 3.15

Core Services (46-H-J-K-71-72-73)

Total

2.68 

7.08 

 4.05

 

[1] = Coefficient of variation for the percentage of innovative enterprises (INN) in the total population of enterprises (ENT18)
[2] = Coefficient of variation for the turnover of product innovative enterprises with new or improved products (TUR_PRD_NEW_MKT), as a percentage of total turnover of product innovative enterprises [TUR18,INNO_PRD].
[3] = Coefficient of variation for percentage of product and/or process innovative enterprises (incl. enterprises with abandoned and or on-going activities) involved in any innovation co-operation arrangement [COOP_ALL,INN], as a percentage of innovative enterprises (INN).

13.2.1.2. Variance estimation method

SAS procedure PROC SURVEYMEANS was used, where stratified sampling design and overall weights (product of sampling weights and weights due to non-response) were taken into account. 

13.3. Non-sampling error

Non-sampling errors occur in all phases of a survey. They add to the sampling errors (if present) and contribute to decreasing overall accuracy. It is important to assess their relative weight in the total error and devote appropriate resources for their control and assessment.

13.3.1. Coverage error

Coverage errors (or frame errors) are due to divergences between the target population and the frame population. The frame population is the set of target population members that has a chance to be selected into the survey sample. It is a listing of all items in the population from which the sample is drawn that contains contact details as well as sufficient information to perform stratification and sampling.

13.3.1.1. Over-coverage - rate

Not requested.

13.3.1.2. Common units - proportion

Not requested.

13.3.1.3. Under covered groups of the target population

There is no information available about under-coverage.

13.3.1.4. Coverage errors in coefficient variation

The overcoverage rate was 0.42%. The number of units representing over-coverage can be separated into units that are ineligible, since they were included in the frame due to lack of information and do not belong in the frame, and units that were eligible at the time of inclusion in the frame and became ineligible during the year (ceased to operate, changed activity).

13.3.2. Measurement error

Measurement errors occur during data collection and generate bias by recording values different than the true ones. The survey questionnaire used for data collection may have led to the recording of wrong values, or there may be respondent or interviewer bias.

13.3.2.1. Measures for reducing measurement errors

The survey type was a combination of on-line survey and self-administered mail survey (postal survey). The preparation of the paper and online versions of the CIS 2018 questionnaire also included the translation of the CIS questionnaire and guidelines for reporting units into the national language, and cooperation with experts at the national level and testing the understanding of questions and instructions with some reporting units. With the translation of the questionnaire and guidelines for reporting units into the national language, we also prepared the methodological notes.

Enterprises were asked to fill out electronic version of the questionnaire in the eSTAT application. Paper questionnaire was sent out to enterprises, which did not have the possibility to fill in the electronic questionnaire, due to any reason (lack of resources or knowledge required to register in the eSTAT application…). Majority of questionnaires was filled out in electronic form. 

If the erroneous data are significant then we detect them through the logical controls, otherwise we detect them by coincidence. The electronic questionnaire included some basic controls, which alerted respondents in case of inconsistent or illogical answers. The intention of the controls was to increase the quality of provided data. Fundamentally there is no interviewer impact in the CIS survey since the data are gathered on electronic or paper questionnaires. 

Some of the data for the CIS survey are taken over from administrative sources. Data on turnover and the number of employees are taken over from the database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES). AJPES collects data on the basis of the Companies Act (ZGD). Data on the share of tertiary educated personnel in the enterprise are taken over from the Statistical Register of Employment (SRDAP) kept by SURS.

13.3.3. Non response error

Non response occurs when a survey fails to collect data on all survey variables from all the population units designated for data collection in a sample or complete enumeration.                                                                                                                                                                                              

There are two types of non-response:                                                                                                                                                                                      

1) Unit non-response, which occurs when no data (or so little as to be unusable) are collected about a population unit designated for data collection.                                                                                                                                                                      

a) Un-weighted unit non-response rate (%) = 100*(Number of units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample)                                                                                                         

b) Weighted unit non-response rate (%) = 100*(Number of weighted units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample)                                                                                                            

2) Item non-response, which occurs when only data on some, but not all survey data items are collected about a population unit designated for data collection.                                       

a) Un-weighted item non-response rate (%) = 100*(Number of units with no response at all for the item) / (Total number of eligible, for the item, units in the sample i.e. filters have to be taken into account) 

 

Unit non-response for CIS 2018 is 16.6% for un-weighted data and 11.7% for weighted data. To increase the response rate and limit unit non-response, enterprises that had not answered the questionnaire were cautioned a couple of days before the deadline via e-mail of the approaching deadline for reporting. Then two reminders were sent out after the deadline expired. If the questionnaire was not filled in despite the reminders additional telephone calls were made to key respondents.

Item non-response rate for Turnover is 0% and consequently there is no imputation. Data are taken from administrative sources from the database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES).

Item non-response rate for new questions is the highes (1.1%) for question 2.7 Used patents and IPRs, following question 2.10 Using information channels (0.6%).

13.3.3.1. Unit non-response - rate

See below.

13.3.3.1.1. Un-weighted and weighted unit non-response rate by NACE categories and for enterprises with 10 or more employees

Un-weighted and weighted unit non-response rate by NACE categories and for enterprises with 10 or more employees

NACE Number of eligible units with no response  Total number of eligible units in the sample Un-weighted unit non-response rate (%) Weighted unit non-response rate (%)
Core NACE (B-C-D-E-46-H-J-K-71-72-73)  463  2787

 16.6

 11.7
Core industry (B_C_D_E - excluding construction)  233  1508 15.4  9.61 
Core Services (46-H-J-K-71-72-73) 230  1279  18.0  15.8 

The number of eligible units is the number of sample units, which indeed belong to the target population.

13.3.3.1.2. Maximum number of recalls/reminders before coding

To increase the response rate and limit unit non-response, enterprises that had not answered yet were cautioned a couple of days before the deadline via e-mail of the approaching deadline for reporting. Two reminders were sent out after the deadline expired to all enterprises that have not yet filled out the questionnaire. If the questionnaire was not filled in despite the reminders additional telephone calls were made to key respondents. Key respondents are medium-sized and large enterprises (enterprises with more than 50 employees). 

13.3.3.2. Item non-response - rate

See below.

13.3.3.2.1. Item non-response rate for Turnover (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees)

Item non-response rate for Turnover (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees).

  Item non-response rate (un-weighted)  Imputation If imputed, describe method used, mentioning which auxiliary information or stratification is used
Turnover  0 No   

Data on turnover are taken from administrative sources from the database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES). 

13.3.3.2.2. Item non response rate for new questions

Item non-response rate for new questions in CIS t (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees)
 

NEW QUESTIONS IN CIS 2018 Inclusion in national questionnaire  Item non response rate (un-weighted) Comments
2.2         Customisation, Co-creation  Yes  0.4  
2.3         Partners in Customisation, Co-creation  Yes  0  
2.4         Turnover from Customisation, Co-creation  Yes  0  
2.7         Used patents and IRPs  Yes  1.1  
2.8         Buying technical services  Yes  0.3  
2.9         Innovative Purchases  Yes  0  
2.10       Using information channels  Yes  0.6  
2.11       Organising work  Yes  0.5  
3.5         Expectations met (product innovation)  Yes  0  
3.8         Expectations met (business process innovation)  Yes  0  
4.8         Enterprise group: inflows and outflows  Yes  0  
4.6         Total expenditure  Yes  0  
13.3.4. Processing error

As in previous survey, innovation data was collected through electronic questionnaire. Reporting units were informed about the eSTAT application and about the open web innovation questionnaire. They were asked to fulfil the questionnaire. To reduce the phase of cleaning data some additional controls were included in the questionnaire. With the second reminder we sent the paper questionnaire to all enterprises from which we did not receive the response. Data from the enterprises who had answered the questionnaire via eSTAT application were takeover in Bleise program, those who answered  via paper questionnaire data has gone through the entry programme manually.

13.3.5. Model assumption error

Not requested.


14. Timeliness and punctuality Top

Timeliness and punctuality refer to time and dates, but in a different manner.

14.1. Timeliness

The timeliness of statistics reflects the length of time between data availability and the event or phenomenon they describe.

14.1.1. Time lag - first result

Timeliness of national data – date of first release of national level : First Release was published on 24 April 2020.

First data are issued with a notice called First Release (Innovation activity in industry and selected services) at 10:30 a.m. on SURS website. First Release is available within 16 months after the end of the reference period.

Final data (detailed data published in database) are available 21 months after the end of the reference period.

 

The publication schedule is fixed and announced in advance. The First Release is published 16 months after the end of the reference year. Data are published as provisional data. In accordance with the announced publishing date (21 months after the reference year), the final detailed data were loaded into the SiSTAT database on a website of the Statistical Office of the Republic of Slovenia, created for user friendly free of charge data munipulation. 

14.1.2. Time lag - final result

Not requested.

14.2. Punctuality

Punctuality refers to the time lag between the release date of data and the target date on which they were scheduled for release as announced officially.

14.2.1. Punctuality - delivery and publication

Date of transmission of complete and validated data to Eurostat (Number of days between that data and 30 June 2020) :3 July 2020


15. Coherence and comparability Top

Comparability aims at measuring the impact of differences in applied statistical concepts and definitions on the comparison of statistics between geographical areas, non-geographical domains, or over time.

The coherence of statistical outputs refers to the degree to which the statistical processes by which they were generated used the same concepts (classifications, definitions, and target populations) and harmonised methods. Coherent statistical outputs have the potential to be validly combined and used jointly.

15.1. Comparability - geographical

Survey results are based on the requirements of the Regulation, which is in use in all EU Member States. This ensures a good comparability between national data in good-quality aggregates.

15.1.1. Asymmetry for mirror flow statistics - coefficient

Not requested.

15.1.2. National questionnaire – compliance with Eurostat model questionnaire

Methodological deviations from the CIS Harmonised Data Collection (HDC)

Questions not included in national questionnaire compared to HDC Comment
 All mandatory and optional variables were collected.  
   

 

Changes in the filtering compared to HDC Comment
 No  
   
15.1.3. National questionnaire – additional questions

Methodological deviations from the CIS Harmonised Data Collection (HDC)

Additional questions in national questionnaire (not included in HDC) Comment
No  
   
15.2. Comparability - over time

Due to important methodological changes in CIS 2018 driven by Oslo Manual 2018, the data 2018 cannot be directly compared with previous CIS waves.

15.2.1. Length of comparable time series

Not requested.

15.3. Coherence - cross domain

See the comparison between SBS and CIS data in the section 15.3.3 below.

15.3.1. Coherence - sub annual and annual statistics

Not requested.

15.3.2. Coherence - National Accounts

Not requested.

15.3.3. Coherence – Structural Business Statistics (SBS)

This part compares key variables for aggregated CIS data with SBS data
Definition of relative difference between CIS and SBS data: DIFF = (SBS/CIS)*100

Comparison between SBS and CIS data (relative difference) by NACE categories and for enterprises with 10 or more employees

NACE Size class Number of enterprises (SBS/CIS)* Number of employees (SBS/CIS)* Total Turnover (SBS/CIS)*
Core NACE (B-C-D-E-46-H-J-K-71-72-73) Total 99.8 93.4 100.6
Core industry (B_C_D_E - excluding construction) Total 102.4  99.1  109.6 
Core Services (46-H-J-K-71-72-73) Total 97.0  82.5   86.7

* Numbers are to be provided for the last year of the reference period (t)

15.4. Coherence - internal

Not requested.


16. Cost and Burden Top

Confidential information on the production cost of the CIS.


17. Data revision Top
17.1. Data revision - policy

Not requested.

17.2. Data revision - practice

Not requested.

17.2.1. Data revision - average size

Not requested.


18. Statistical processing Top
18.1. Source data

See below:

18.1.1. Sampling frame (or census frame)

The sampling frame was made by using national business register.

18.1.2. Sampling design

The observation unit is selected on the basis of the threshold (cut-off sampling). We select enterprises with at least 10 employees, registered on the territory of the Republic of Slovenia and in one of the activities of the Standard Classification of Activities SKD 2008 (i.e. NACE Rev. 2) from sections:

  • Mining and quarrying (B: 05-09)
  • Manufacturing (C: 10-33)
  • Electricity, gas steam and air conditioning supply (D: 35)
  • Water supply; sewerage, waste management and remediation activities (E: 36-39)
  • Wholesale trade, except of motor vehicles and motorcycles (G: 46)
  • Transportation and storage (H: 49-53)
  • Information and communication (J: 58-63)
  • Financial and insurance activities (K: 64-66)
  • Architectural and engineering activities; technical testing and analysis (M: 71)
  • Scientific research and development (M: 72)
  • Advertising and market research (M: 73)

Data were collected through combination of a census and sample survey. All units were divided into strata defined by 2 digit NACE activities and by size classes. Units with at least 250 employees were in class 1, units with employees ranges from 50 - 250 were in class 2 and units with employees ranges from 10 - 49 were in class 3. All units from classes 1 and 2 were selected with certainty (census), units from class 3 were selected by sampling (coordinating sampling). Allocation was proportional, taking into account that in each strata were selected at least min {number of units in strata,8} The table below shows number of units in each stratum in the sample, number of units in each stratum in the sampling frame and sampling rates. Total number of strata is 30*3=90.

18.1.3. Target population and sample size
Sample/census indicator Number of enterprises
Target population  4889
Sample  2800
In case of combination sample/census:
Sampled units 1729 
Enumerated units/census 1071 
Overall sample rate (overall sample/target population) 57%
18.1.4. Data source for pre-filled variables

Variables and indicators filled or prefilled from other sources.

The part of data for the section ''Basic information on your enterprise'' is taken from administrative sources. Data on turnover and the number of employees are taken from the database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES). AJPES collects data on the basis of the Companies Act Data on the share of tertiary educated personnel in the enterprise are taken from the Statistical Register of Employment kept by SURS.

Variables/Indicators Source Reference year
 EMP Database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES)  2016, 2018
EMPUD Statistical Register of Employment 2018
TUR Database of accounts kept by the Agency of the Republic of Slovenia for Public Legal Records and Related Services (AJPES) 2016, 2018
ENTE Statistical Business Register 2018
18.1.5. Data source and variables used for derivation and weighting
Item Response
Data source used for deriving population totals  Statistical Business Register
Variables used for weighting  -
18.2. Frequency of data collection

According to the Commission Regulation (UE) 995/2012, the innovation statistics shall be provided to Eurostat every two years in each even year. The data collection takes place every second year in year t-2 preceding the data provision.

18.3. Data collection

Data are collected every odd year for the previous three-year period. Data are collected with the web questionnaire with the survey “Innovation Activity in Industry and Selected Services” (INOV). The reporting units (enterprises) receive the INOV questionnaire and they complete it according to their available records. We also send a printed questionnaire to the reporting units that did not complete the online questionnaire for any reason. There were about 5% of such units.

Some of the data for the INOV survey are taken over from administrative sources (see section 18. 1.).

18.3.1. Survey participation

The survey is mandatory.

18.3.2. Survey type

Data were collected through combination of a census and sample survey.

18.3.3. Combination of sample survey and census data

Units from sampling frame were divided into strata defined by 2 digit NACE activity and by size classes. Units with at least 250 employees were in class 1, units with employees ranges from 50-249 were in class 2 and units with employees ranges from 10-49 were in class 3.  All units from classes 1 and 2 were  selected with certainty (census), units from class 3 were selected by sample (coordinating sampling).

18.3.4. Census criteria

The observation units are selected on the basis of the threshold (cut-off sampling). We select enterprises with at least 10 persons employed, registered on the territory of the Republic of Slovenia and in one of the Core NACE  activities. The coverage of the observed units is a combination of a census (large and medium-sized enterprises) and a sample (small enterprises); this means that the census covers all enterprises in the Core NACE activities employing between 50 and 249 (medium-sized enterprises) and more than 249 persons (large enterprises), and a sample of enterprises employing between 10 and 49 persons (they are selected on the basis of a random sample).

18.3.5. Data collection method

Data collection method

Survey method Yes/No Comment
Face-to-face interview  No  
Telephone interview No   
Postal questionnaire Yes  To improve the response rate and to comply with the enterprise’s needs questionnaires in paper form were sent out to enterprises,

which didn’t have the possibility to fill out the electronic questionnaire, due to any reason.

Electronic questionnaire (format Word or PDF to send back by email) No   
Web survey (online survey available on the platform via URL) Yes   
Other  No  
18.4. Data validation

Not requested.

18.5. Data compilation

Operations performed on data to derive new information according to a given set of rules.

18.5.1. Imputation - rate

Imputation is the method of creating plausible (but artificial) substitute values for all those missing.

Definition of imputation rate:

Imputation rate (for the variable x) (%) = 100*(Number of replaced values) / (Total number of values for a given variable)

Definition of weighted imputation rate:

Weighted imputation rate= 100*(Number of total weighted replaced values) / (Total number of weighted values for a given variable)

18.5.1.1. Imputation rate for metric variables

Imputation rate for metric variables by NACE categories and for enterprises with 10 or more employees:

NACE Size class Total Turnover (1) Turnover from products new to the market (2) R&D expenditure in-house (3)
Unweighted Weighted Unweighted Weighted Unweighted Weighted
Core NACE (B-C-D-E-46-H-J-K-71-72-73) Total 0.0% 0.0%  0.09% 0.42%

0.17%

0.48%
Core industry (B_C_D_E - excluding construction) Total 0.0% 0.0% 0.00% 0.00%  0.24% 0.28% 
Core Services (46-H-J-K-71-72-73) Total 0.0%  0.0%  0.19%  1.06%  0.10%  1.08%

 

(1) = Total turnover in the last year of the reference period (t) (TUR)

(2) = Share of the turnover in the last year of the reference period (t) due to new or improved product new to the market in the total turnover for product innovative enterprises TUR_PRD_NEW_MKT/TUR(INNO_PRD)

(3) = R&D expenditure performed in-house (EXP_INNO_RND_IH)

18.5.2. Weights calculation

Weights calculation method for sample surveys

Method Selected applied method  Comments
Inverse sampling fraction Yes  
Non-respondent adjustments Yes   
Other No   
18.6. Adjustment

Not used.

18.6.1. Seasonal adjustment

Not requested.


19. Comment Top


Related metadata Top


Annexes Top