Community innovation survey 2020 (CIS2020) (inn_cis12)

National Reference Metadata in Single Integrated Metadata Structure (SIMS)

Compiling agency: National Documentation Centre (EKT)


Eurostat metadata
Reference metadata
1. Contact
2. Metadata update
3. Statistical presentation
4. Unit of measure
5. Reference Period
6. Institutional Mandate
7. Confidentiality
8. Release policy
9. Frequency of dissemination
10. Accessibility and clarity
11. Quality management
12. Relevance
13. Accuracy
14. Timeliness and punctuality
15. Coherence and comparability
16. Cost and Burden
17. Data revision
18. Statistical processing
19. Comment
Related Metadata
Annexes (including footnotes)
 



For any question on data and metadata, please contact: Eurostat user support

Download


1. Contact Top
1.1. Contact organisation

National Documentation Centre (EKT)

1.2. Contact organisation unit

Registers, Indicators and Services for Research & Innovation

1.5. Contact mail address

56 Zefyrou str., GR-17564 Palaio Faliro, Greece


2. Metadata update Top
2.1. Metadata last certified 02/11/2022
2.2. Metadata last posted 02/11/2022
2.3. Metadata last update 02/11/2022


3. Statistical presentation Top
3.1. Data description

The Community Innovation Survey (CIS) is a survey about innovation activities in enterprises. The survey is designed to collect the information on types of innovation, processes of development of innovation like cooperation patterns, financing and expenditure, objectives of innovation activities or barriers for initiating or implementing innovation.

The CIS provides statistics by type of innovators, economic activity and size class of enterprises. The survey is currently carried out every two years across the EU Member States, EFTA countries and EU candidate countries.

In order to ensure comparability across countries, Eurostat together with the countries develops a Harmonised Data Collection (HDC) questionnaire and drafts the methodological recommendations for implementation of each survey round.

CIS 2020 is a second in a row to implement concepts and methodology of the Oslo Manual 4th Edition revised in 2018. The changes in the CIS driven by the revision of the manual and their impact on collected indicators are described in the Statistics Explained article: Community Innovation Survey – new features.

The legal framework for CIS since 2012, including the present round CIS 2020, is the Commission Regulation No 995/2012 that establishes the quality conditions for the data collection and transmission and identifies the obligatory cross-coverage of economic sectors, size class of enterprises and innovation indicators. The target population are enterprises with at least 10 employees classified in the core NACE economic sectors (see 3.3).

Further activities may be covered on a voluntary basis in national datasets. Most statistics are based on the 3-year reference period (t, t-1, t-2), but some use only one calendar year (t or t-2). Please refer to the Annex section of the European metadata (ESMS) for details of the time coverage of collected indicators.

3.2. Classification system

Indicators related to the enterprises are classified by country, economic activity (NACE Rev. 2), size class of enterprises and type of innovation.

The main typology of classification of enterprises in reference to innovation is the distinction between innovation-active enterprises (INN) and not innovation-active enterprises (NINN).

The enterprise is considered as innovative (INN) if during the reference period it successfully introduced a a) product or b) business process innovation, c) completed but not yet implemented the innovation, d) had ongoing innovation activities, e) abandoned innovation activities or was f) engaged in in-house R&D or R&D contracted out. Non-innovative (NINN) enterprises had no innovation activity mentioned above whatsoever during the reference period.

3.3. Coverage - sector

CIS covers main economic sectors according to NACE Rev.2 broken down by size class of enterprises and type of innovation activity.

3.3.1. Main economic sectors covered - NACE Rev.2

In accordance with Commission Regulation 995/2012 on innovation statistics, the following industries and services are included in the core target population. Results are made available with these following breakdowns :

All NACE – Core NACE (NACE Rev. 2  sections & divisions B-C-D-E-46-H-J-K-71-72-73 )

 

CORE INDUSTRY (excluding construction) (NACE Rev. 2 SECTIONS B_C_D_E)

10-12: Manufacture of food products, beverages and tobacco

13-15: Manufacture of textiles, wearing apparel, leather and related products

16-18: Manufacture of wood, paper, printing and reproduction

20: Manufacture of chemicals and chemical products

21: Manufacture of basic pharmaceutical products and pharmaceutical preparations

19-22: Manufacture of petroleum, chemical, pharmaceutical, rubber and plastic products

23: Manufacture of other non-metallic mineral products

24: Manufacture of basic metals

25: Manufacture of fabricated metal products, except machinery and equipment

26: Manufacture of computer, electronic and optical products

25-30: Manufacture of fabricated metal products (except machinery and equipment), computer, electronic and optical products, electrical equipment, motor vehicles and other transport equipment

31-33: Manufacture of furniture; jewellery, musical instruments, toys; repair and installation of machinery and equipment

 

D: ELECTRICITY, GAS, STEAM AND AIR CONDITIONING SUPPLY

 

E: WATER SUPPLY; SEWERAGE, WASTE MANAGEMENT AND REMEDIATION ACTIVITIES

36: Water collection, treatment and supply

37-39: Sewerage, waste management, remediation activities

 

CORE SERVICES (NACE Rev. 2 sections & divisions 46-H-J-K-71-72-73)(NACE code in the tables = G46-M73_INN)

46: Wholesale trade, except of motor vehicles and motorcycles

 

H: TRANSPORTATION AND STORAGE

49-51: Land transport and transport via pipelines, water transport and air transport

52-53: Warehousing and support activities for transportation and postal and courier activities

 

J: INFORMATION AND COMMUNICATION

58: Publishing activities

61: Telecommunications

62: Computer programming, consultancy and related activities

63: Information service activities

 

K: FINANCIAL AND INSURANCE ACTIVITIES

64: Financial service activities, except insurance and pension funding

65: Insurance, reinsurance and pension funding, except compulsory social security

66: Activities auxiliary to financial services and insurance activities

 

M: PROFESSIONAL, SCIENTIFIC AND TECHNICAL ACTIVITIES

71: Architectural and engineering activities; technical testing and analysis

72: Scientific research and development

73: Advertising and market research

71-73: Architectural and engineering activities; technical testing and analysis; Scientific research and development; Advertising and market research

3.3.1.1. Main economic sectors covered - NACE Rev.2 - national particularities

All core NACE 2020 sections and divisions have been covered with no deviations from the Commission Regulation 995/2012.

3.3.2. Sector coverage - size class

In accordance with Commission Regulation 995/2012 on innovation statistics, the following size classes of enterprises according to number of employees are included in the core target population of the CIS:

  • 10 - 49 employees
  • 50 - 249 employees
  • 250 or more employees
3.3.2.1. Sector coverage - size class - national particularities

No deviations from the size classes defined in the Commission Regulation 995/2012.

3.4. Statistical concepts and definitions

The description of concepts, definitions and main statistical variables is available in CIS 2020 European metadata file (ESMS) Results of the community innovation survey 2020 (CIS2020) (inn_cis12) in Eurostat database.

3.5. Statistical unit

In accordance with EC Regulation 995/2012, the statistical unit for CIS survey is the enterprise, as defined in the Council Regulation 696/1993.

3.6. Statistical population

Core target population is all enterprises in CORE NACE activities (see 3.3.1) with 10 or more employees.

3.7. Reference area

The reference area for the national CIS survey is Greece, covering all 13 regions at NUTS-2 level. CIS data are collected for all NUTS-2 regions and selected indicators of the CIS survey are calculated and provided at regional NUTS-2 level, following the request for the Regional Innovation Scoreboard. 

 

3.8. Coverage - Time

Several rounds of Community Innovation Survey have been conducted so far at two-year interval since end of 90’s.

3.8.1. Participation in the CIS waves
CIS wave Reference period Participation Comment (deviation from reference period)
CIS2 1994-1996    
CIS3 1998-2000  x   
CIS light 2002-2003*    
CIS4 2002-2004  x  
CIS2006 2004-2006  x  
CIS2008 2006-2008    
CIS2010 2008-2010    
CIS2012 2010-2012  x  
CIS2014 2012-2014  x  
CIS2016 2014-2016  x  
CIS2018 2016-2018  x  
CIS2020 2018-2020  x  

*two reference periods can be distinguished for CIS light: 2000-2002 and 2001-2003

3.9. Base period

Not relevant.


4. Unit of measure Top

CIS indicators are available according to 3 units of measure:

 

NR: Number for number of enterprises and number of persons employed.

THS_EUR: Thousands of euros. All financial variables are provided in thousands of euros, i.e. Turnover or Innovation expenditure.

PC: Percentage. The percentage is the ratio between the selected combinations of indicators.


5. Reference Period Top

For CIS 2020, the time covered by the survey is the 3-year period from the beginning of 2018 to the end of 2020.

Some questions and indicators refer to one year - 2020.

The list of indicators covering the 3-year period and those referring to one year, according to the HDC, is available in the Annex section of the European metadata (ESMS).


6. Institutional Mandate Top
6.1. Institutional Mandate - legal acts and other agreements

CIS surveys are based on the Commission Regulation No 995/2012, implementing Decision No 1608/2003/EC of the European Parliament and of the Council on the production and development of Community statistics on science and technology.

This Regulation establishes innovation statistics on a statutory basis and makes the delivery of certain variables compulsory e.g. innovation activities, cooperation, development, expenditures and turnover (see the Regulation). Each survey wave may additionally include further variables. 

In addition, the Regulation defines the obligatory cross-coverage of economic sectors and size class of enterprises.

6.1.1. National legislation

The following legal acts are in force for the conduction of the CIS survey in Greece:

6.2. Institutional Mandate - data sharing

Not requested.


7. Confidentiality Top

CIS data are transmitted to Eurostat via EDAMIS using the secured transmission system.

7.1. Confidentiality - policy

The National Documentation Centre (EKT), as a National Authority of the Hellenic Statistical System, is fully committed and compliant with the provisions on statistical confidentiality, as defined by the Articles 7, 8 and 9 of the national law 3832/2010 and by the Articles 5, 8, 10 and 11(2) of the regulation of statistical obligations of the bodies of the Hellenic Statistical System. The dissemination of statistics is carried out in compliance with the principles of the European Statistics Code of Practice and the principles of statistical confidentiality and data protection are clearly stated at EKT’s Statistical Confidentiality Policy, publicly available at:  

https://metrics.ekt.gr/sites/metrics-ekt/files/pages-pdf/EKT_Policy_Statistical_Confidentiality_1.1_en.pdf

7.2. Confidentiality - data treatment

Data cells have been protected for confidentiality according to the following rules:

1) Primary protection: all cells referring to three enterprises or fewer (≤3).

2) Secondary protection:

  • In case of 2-classes aggregation (e.g. NACE classes) A = B + C, if cell B is suppressed, then cell C is also suppressed.
  • In case of 3-classes aggregation A = B + C + D, if one of B, C, or D is suppressed, then one more cell is suppressed.
  • In case of 3-classes aggregation A = B + C + D, if two of B, C, or D are suppressed, then the third one is also suppressed.


8. Release policy Top
8.1. Release calendar

The release calendar for all statistical data is published online at the end of each calendar year on the dedicated website for RDI statistics.

The Data Release Calendar announces the months of the following year on which the statistical results are expected to be disseminated.

8.2. Release calendar access

The Data Release Calendar is publicly accessible at: https://metrics.ekt.gr/en/statistics-announcements.

8.3. Release policy - user access

As stated in its Quality Policy, publicly available at: https://metrics.ekt.gr/sites/metrics-ekt/files/pages-pdf/EKT_Policy_Quality_1.1_en.pdf, EKT provides simultaneous and equal access to the statistics it produces, through transparent procedures and for all users, as required by the principle of impartiality. A dissemination policy is also in place, publicly available at: https://metrics.ekt.gr/sites/metrics-ekt/files/pages-pdf/EKT_Policy_Dissemination_1.1_en.pdf. Dissemination of CIS statistics is performed strictly following the confidentiality rules and principles provided in the Greek Statistical legal framework and the European Statistics Code of Practice, as stated in EKT’s Statistical Confidentiality Policy publicly available at: https://metrics.ekt.gr/sites/metrics-ekt/files/pages-pdf/EKT_Policy_Statistical_Confidentiality_1.1_en.pdf.

The main source of information for users of statistics on research, development and innovation is the dedicated website http://metrics.ekt.gr/, which can be accessed by all users, without restrictions. RDI statistics are published on the website in the form of Tables, as well as in relevant publications and additional documentation studies. In addition, the results of the statistical surveys and other relevant work on national statistics are transmitted to Eurostat for inclusion in its relevant database (http://ec.europa.eu/eurostat/data/database).


9. Frequency of dissemination Top

CIS is conducted and disseminated at two-year interval in pair years.


10. Accessibility and clarity Top

Accessibility and clarity refer to the simplicity and ease for users to access statistics using simple and user-friendly procedure, obtaining them in an expected form and within an acceptable time period, with the appropriate user information and assistance: a global context which finally enables them to make optimum use of the statistics.

10.1. Dissemination format - News release

EKT announces the outputs of each statistical survey through Press Releases, which are accompanied by summary statistical reports.  These Releases are communicated to the press via online and offline media channels. The republications and comments appearing in the online and printed media are monitored to capture the interest raised among the different user communities as well as to identify any misuses of the statistics. Further analyses, statistics and indicators are presented in subsequent detailed statistical publications. 

10.1.1. Availability of the releases
Dissemination and access Availability Comments, links, ...
Press release X

Publicly available, free of charge: 

https://metrics.ekt.gr/en/innovation/articles

Access to public free of charge  X
Access to public restricted (membership/password/part of data provided, etc.)    
10.2. Dissemination format - Publications
10.3. Dissemination format - online database

Publicly available, free of charge at: https://metrics.ekt.gr/innovation/datatables

10.3.1. Data tables - consultations

Not requested.

10.4. Dissemination format - microdata access

Submitted to Eurostat to be accessed by researchers at the Safe Centre and/or via CD-ROM.

10.4.1. Dissemination of microdata
Mean of dissemination Availability of microdata Comments, links, ...
Eurostat SAFE centre  X  
National SAFE centre    
Eurostat: partially anonymised data (SUF)  X  
National : partially anonymised data    
10.5. Dissemination format - other

Not available.

10.5.1. Metadata - consultations

Not requested.

10.6. Documentation on methodology

At EKT’s RDI statistics website, https://metrics.ekt.gr/, a dedicated space is available for each RDI statistic subdomain, which presents the data and metadata related to each survey accompanied by the necessary supplementary material for statistical information purposes. The standard structure of each subdomain includes:

  • About: short information on the scope of the survey, the main indicators produced and their importance, the legal framework, and the methodological manuals.
  • Publications: EKT’s statistical publications and EKT’s broader studies/reports related to each subdomain.
  • Data-tables: statistical data and indicators.
  • Interactive maps: data interactive representation for the 13 Greek regions (NUTS2).
  • News: statistical releases and EKT’s short articles.
  • Questionnaires: questionnaires (in pdf format) for each survey round.
  • Quality reports: user-oriented metadata reports (SIMS v2.0).
  • Glossary: most common RDI terms and definitions.

In particular, the webspace dedicated to Innovation/CIS (https://metrics.ekt.gr/innovation) hosts a brief presentation of the main results of the latest survey round, through a short documentary together with relevant infographics. Reference material for the survey is also available online with links to the relevant regulations, the Oslo Manual, the NACE classification and the survey questionnaire (https://metrics.ekt.gr/innovation/about). A specific link is also provided to the recent CIS ‘Living Library’ launched by Eurostat at https://ec.europa.eu/eurostat/cache/website/cis/library.html.

Data-tables are also available, including indicators for all CIS survey rounds conducted by EKT (https://metrics.ekt.gr/innovation/datatables). These tables are downloadable in excel (file) format, while the survey’s results are also available in the form of interactive maps (https://metrics.ekt.gr/innovation/maps). Relevant statistical publications and studies carried out by EKT, after each survey round, are available (https://metrics.ekt.gr/innovation/publications). Εach publication of the survey results is accompanied by a short methodological note, including information on the target population, the NACE sections and size classes covered, the sampling method and the mode of data collection. Additional documentation on the CIS methodology is provided to users through user-oriented metadata reports (SIMS v2.0) (https://metrics.ekt.gr/innovation/quality-reports), the necessary glossary of terms (https://metrics.ekt.gr/lexicon), the questionnaires (https://metrics.ekt.gr/innovation/questionnaires), as well as a section dedicated to relevant press releases, announcements, and articles (https://metrics.ekt.gr/innovation/articles).

Lastly, EKT initiated and recently completed the translation of the 2018 Oslo Manual in Greek, aiming to strengthen statistical dissemination and to launch a substantive dialogue on policy making related to research and innovation. The manual is a guide and source of inspiration for policy makers, senior public administration executives, especially those involved in the design and implementation of relevant public funding initiatives, business and management executives, the academic and research community, and business and industry associations. The Oslo manual is publicly available at EKT’s website (https://metrics.ekt.gr/publications/552) and in a restricted number of hard copies. The publication was accompanied by a press release (https://www.ekt.gr/el/press-releases/27520).

10.6.1. Metadata completeness - rate

Not requested.

10.7. Quality management - documentation

User-oriented metadata reports (SIMS v2.0) are publicly available online at: https://metrics.ekt.gr/innovation/quality-reports


11. Quality management Top
11.1. Quality assurance

The quality of CIS at national level is assessed via the quality indicators and concepts, as described in the present quality report. These indicators are monitored on a regular basis, during data collection and data processing, to ensure high quality of CIS results. In addition to the quality report, the National Documentation Centre has been developing a Documentation Manual with specific guidelines and indicators, that serves in monitoring the quality of the survey and documenting the procedures followed each time. The Documentation Manual for the national CIS is organised following the GSBPM structure and according to the relevant guidelines of the Hellenic Statistical Authority (ELSTAT).

11.2. Quality management - assessment

As specified in the Memoranda of Cooperation between EKT and ELSTAT, the CIS frame population is formulated on the basis of the national Statistical Business Register maintained by ELSTAT. CIS data are collected by census for enterprises with more than 500 persons employed as well as for enterprises that are systematically active in Research and Development (based on the national survey on BES R&D). The remaining enterprises of the target population are surveyed in a sample provided by ELSTAT from the Statistical Business Register, applying single-stage stratified sampling in strata determined by the region (NUTS-2 level), the 2-digit sector of economic activity and the size class (based on the number of persons employed). The sample of enterprises is determined following the specifications and precision requirements proposed by Eurostat in the survey methodological guidelines.

Data were collected via an online survey tool that allowed the introduction of filters and validation rules on the questionnaire. This feature improved measurement and processing errors, eliminated unit non response and had a positive impact on the quality of the data collected by the enterprises. The collection was supported by an online help-desk and more than 230 well-trained statistical correspondents responsible for the follow up and the assistance to enterprises during the completion of the questionnaire. A new addition to the collection process is the production of a weekly report (provided, also, to statistical correspondents) for the purpose of highlighting enterprises that belong to strata with a zero response or a high non-response rate. The report contained, additionally, information about the statistical correspondents’ performance (e.g., unit response rates). It is important to note that the participation of the statistical correspondents was implemented under the framework of EKT’s cooperation with ELSTAT, for the needs of the CIS survey.


12. Relevance Top

Relevance is the degree to which statistics meet current and potential users’ needs. It includes the production of all needed statistics and the extent to which concepts used (definitions, classifications etc.) reflect user needs. The aim is to describe the extent to which the statistics are useful to, and used by, the broadest array of users. For this purpose, statisticians need to compile information, firstly about their users and their needs.

The CIS is based on a common questionnaire and a common survey methodology in order to achieve comparable, harmonised and high quality results for EU Member States, EFTA countries, Candidates and Associated countries.

12.1. Relevance - User Needs

The questionnaire is finalised by taking into consideration the feedback received from key stakeholders and the Hellenic Statistical Authority. Comments received by enterprises, during the completion of the previous CIS questionnaire, as well as during the interviews for cognitive testing of the CIS 2020 questionnaire, are also considered for the improvement of the survey questionnaire and the accompanied material provided to respondents (instructions for the completion of the questionnaire, examples & clarifications of the survey concepts).

12.1.1. Needs at national level
User group Short description of user group Main needs for CIS data of the user group Users’ needs
1. Institution - European level The European Commission European Innovation Scoreboard, Regional Innovation Scoreboard 
1. Institution - European level Eurostat Dissemination in Eurobase and in publications
1. Institution - International organisations Other international organisations (e.g. OECD, UNU-MERIT) Publications, data comparisons, policy-making reviews, innovation profiles
1. Institution - National level General Secretariat for Research & Innovation / General Secretariat for Industry / Regional Authorities Policy making at national, sectoral and regional level, monitoring of indicators for assessment of the Framework Programmes and the strategic planning of funding
1. Institution - National level ESPA monitoring services Key innovation indicators are used for the monitoring of the Regional Smart Specialisation strategies (RIS3) at both national and regional level
2. Social actors Business associations / Innovation clusters Performance of enterprises in specific NACE sections, comparisons with other countries
3. Media National media Country performance in relation to other European countries, interest on the publication of CIS results
4. Researchers Researchers and students Analysis of CIS indicators for specific studies and research purposes
5. Enterprises and businesses Private enterprises in the business sector Sectoral reviews, market analysis, and benchmarking with enterprises at same NACE/Size class
12.2. Relevance - User Satisfaction

Users’ satisfaction is monitored through three main mechanisms:

1) User feedback is received from regular meetings with key stakeholders and personal interviews with significant R&D and innovation performers, providing valuable information on the needs for innovation statistics. To this extent, it is important to note that a great interest in analysing indicators at the regional and at the sectoral level was expressed.

2) A critical source of information in the form of users’ feedback is hosted at a dedicated space at EKT’s statistics website. Therein, users have the option to submit their feedback and the level of their satisfaction, and to make suggestions for the improvement of the statistical process. The collected information includes: i) the type of the user (e.g., academic, researcher, student, etc.), ii) the RDI statistics category (e.g., R&D, Innovation, etc.), and iii) an evaluation of the usefulness of the information and the data provided. If required, responses and feedback to users are provided by the corresponding survey manager.

3) Users’ satisfaction with respect to the survey questionnaire and the data collection methods is also monitored via the online questionnaire (through a dedicated Section at the end). Results of this assessment showed a high satisfaction with the structure of the questionnaire, its development on the online platform, and the support provided by the statistical correspondents (provided by ELSTAT) and EKT’s staff during the completion.

12.3. Completeness

CIS 2020 results cover all mandatory variables, following the EC Regulation 995/2012. In addition, the great majority of voluntary variables and the respective non-mandatory tabulations are also provided in the requested NACE and Size breakdowns.

12.3.1. Data completeness - rate

Not requested.


13. Accuracy Top
13.1. Accuracy - overall

Accuracy in the statistical sense denotes the closeness of computations or estimates to the exact or true values. Statistics are not equal with the true values because of variability (the statistics change from implementation to implementation of the survey due to random effects) and bias (the average of the possible values of the statistics from implementation to implementation is not equal to the true value due to systematic effects).

13.2. Sampling error

That part of the difference between a population value and an estimate thereof, derived from a random sample, which is due to the fact that only a subset of the population is enumerated.

13.2.1. Sampling error - indicators

The main indicator used to measure sampling errors for CIS data is the coefficient of variation (CV).

Coefficient of Variation= (Square root of the estimate of the sampling variance) / (Estimated value)

Formula:

 

where

and

The above calculations are adjusted for stratified sampling from finite populations.

13.2.1.1. Coefficient of variations for key variables

Coefficient of variation (%) for key variables by NACE categories and for enterprises with 10 and more employees

NACE

Size class

(1)

(2)

(3)

Core NACE (B-C-D-E-46-H-J-K-71-72-73)

Total

 1.08

 5.59

 2.73

Core industry (B_C_D_E - excluding construction)

Total

 1.52

 1.47

 3.89

Core Services (46-H-J-K-71-72-73)

Total

 1.53

 9.81

 3.75

[1] = Coefficient of variation for the percentage of innovative enterprises (INN) in the total population of enterprises (ENT20)

[2] = Coefficient of variation for the turnover of product innovative enterprises with new or improved products (TUR_PRD_NEW_MKT), as a percentage of total turnover of product innovative enterprises [TUR20,INNO_PRD].

[3] = Coefficient of variation for percentage of product and/or process innovative enterprises (incl. enterprises with abandoned and or on-going activities) involved in any innovation co-operation arrangement [COOP_ALL,INN], as a percentage of innovative enterprises (INN).

13.2.1.2. Variance estimation method

The variance and the coefficients of variation were calculated using the appropriate formulas for ratio estimators, also provided in previous CIS instructions/templates. The application provided in SPSS for complex samples was used for these calculations.

13.3. Non-sampling error

Non-sampling errors occur in all phases of a survey. They add to the sampling errors (if present) and contribute to decreasing overall accuracy. It is important to assess their relative weight in the total error and devote appropriate resources for their control and assessment.

13.3.1. Coverage error

Coverage errors (or frame errors) are due to divergences between the target population and the frame population. The frame population is the set of target population members that has a chance to be selected into the survey sample. It is a listing of all items in the population from which the sample is drawn that contains contact details as well as sufficient information to perform stratification and sampling.

13.3.1.1. Over-coverage - rate

Not requested.

13.3.1.2. Common units - proportion

Not requested.

13.3.1.3. Under covered groups of the target population

No undercoverage reported in any of the groups of the target population.

13.3.1.4. Coverage errors in coefficient variation

Not relevant - no coverage issues reported.

13.3.2. Measurement error

Measurement errors occur during data collection and generate bias by recording values different than the true ones. The survey questionnaire used for data collection may have led to the recording of wrong values, or there may be respondent or interviewer bias.

13.3.2.1. Measures for reducing measurement errors

The survey questionnaire was the model questionnaire proposed by Eurostat and the Member States for CIS 2020, translated in Greek. The questionnaire was developed online using the Lime Survey software and, therefore, the data collection process was implemented electronically. The software allowed for the introduction of filters to questions/sections of the questionnaire and, most importantly, it supported the use of control rules and checks for the reported values. The latter improved the quality of the collected data, allowing for real-time validation (i.e., validation while respondents were answering the questions). The system also offered the option of saving and previewing the answers, in any part of the completion process and before the final submission. All operations were thoroughly tested before running the survey. In addition to the questionnaire, a glossary of terms and examples related to the survey concepts and an online helpdesk were offered to respondents for further assistance.

All respondents (either selected in the sample or covered by census) were contacted by email for participating in the survey. In particular, they received their identical credentials for connecting to the online questionnaire and a copy of the questionnaire in pdf for quick preview. The collection was supported by ~230 experienced statistical correspondents (interviewers), provided by the Hellenic Statistical Authority (ELSTAT), the national authority responsible for maintaining the register of statistical correspondents  for official statistical surveys. The statistical correspondents were responsible for telephone follow-ups and for any other kind of needed assistance.

A special training was held for the statistical correspondents and a handbook was offered to them explaining the survey and the data collection process. The training was conducted in live streaming to facilitate the understanding and to allow for statistical correspondents, across all regions, to watch and ask questions. The whole operation was constantly monitored by EKT’s staff and the regional statistical offices of ELSTAT for validating the progress of the work and the quality of the collected data.

13.3.3. Non response error

Non response occurs when a survey fails to collect data on all survey variables from all the population units designated for data collection in a sample or complete enumeration.                                                                                                                                                                                              

There are two types of non-response:                                                                                                                                                                                      

1) Unit non-response, which occurs when no data (or so little as to be unusable) are collected about a population unit designated for data collection:                                                         

a) Un-weighted unit non-response rate (%) = 100*(Number of units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample).                                                                         

b) Weighted unit non-response rate (%) = 100*(Number of weighted units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample).      

2) Item non-response, which occurs when only data on some, but not all survey data items are collected about a population unit designated for data collection:                                      

a) Un-weighted item non-response rate (%) = 100*(Number of units with no response at all for the item) / (Total number of eligible, for the item, units in the sample i.e. filters have to be taken into account). 

13.3.3.1. Unit non-response - rate

See below.

13.3.3.1.1. Un-weighted and weighted unit non-response rate by NACE categories and for enterprises with 10 or more employees

Un-weighted and weighted unit non-response rate by NACE categories and for enterprises with 10 or more employees

NACE Number of eligible units with no response  Total number of eligible units in the sample Un-weighted unit non-response rate (%) Weighted unit non-response rate (%)
Core NACE (B-C-D-E-46-H-J-K-71-72-73) 4163 8427 49.40

53.83

Core industry (B_C_D_E - excluding construction)  2093 4194 49.90 54.38
Core Services (46-H-J-K-71-72-73)  2070 4233 48.90 53.44

The number of eligible units is the number of sample units, which indeed belong to the target population.

13.3.3.1.2. Maximum number of recalls/reminders before coding

Before coding an enterprise as non-responding, multiple (and in a regular basis) e-mail reminders are sent, followed by telephone contacts, personal e-mails and close follow-up procedures implemented by the statistical correspondents. However, it is to be noted that despite all efforts taken, enterprises were not very keen on responding due to the problems they faced because of COVID-19 pandemic crisis. This, in combination with the increased sample rate that aimed to increased accuracy in small Greek regions (see 18.1.3.), resulted in a non - response rate about 50%. 

13.3.3.2. Item non-response - rate

See below.

13.3.3.2.1. Item non-response rate for Turnover (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees)

Item non-response rate for Turnover (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees).

  Item non-response rate (un-weighted)  Imputation If imputed, describe method used, mentioning which auxiliary information or stratification is used
Turnover  5.25 Y Imputation was based on information from balance sheets and administrative data, only for those enterprises that did not provide the missing figures during follow-up.
13.3.3.2.2. Item non response rate for new questions

Item non-response rate for new questions in CIS t (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees)
 

NEW QUESTIONS IN CIS 2020 Inclusion in national questionnaire  Item non response rate (un-weighted) Comments
2.2   Market conditions faced by enterprise  X   0% The online questionnaire tool (Lime Survey) ensures (through real time completion rules) that all items are filled by the respondent.
2.8   Factors related to climate change  X   0% The online questionnaire tool (Lime Survey) ensures (through real time completion rules) that all items are filled by the respondent.
3.16  Innovations with environmental benefits  X   0% The online questionnaire tool (Lime Survey) ensures (through real time completion rules) that all items are filled by the respondent.
3.17  Factors driving environmental innovations  X   0% The online questionnaire tool (Lime Survey) ensures (through real time completion rules) that all items are filled by the respondent.
13.3.4. Processing error

All responses were collected via the online questionnaire. In few exceptions, where enterprises submitted their questionnaire via fax/mail, data were filled in the system by EKT’s experienced staff. In both cases there were no errors encountered.

13.3.5. Model assumption error

Not requested.


14. Timeliness and punctuality Top

Timeliness and punctuality refer to time and dates, but in a different manner.

14.1. Timeliness

The timeliness of statistics reflects the length of time between data availability and the event or phenomenon they describe.

14.1.1. Time lag - first result

Timeliness of national data – date of first release of national level: 30/6/2022

14.1.2. Time lag - final result

Not requested.

14.2. Punctuality

Punctuality refers to the time lag between the release date of data and the target date on which they were scheduled for release as announced officially.

14.2.1. Punctuality - delivery and publication

Date of transmission of complete and validated data to Eurostat (Number of days between that date and 30 June 2022): Data were transmitted on 30/6/2022. Additional voluntary data were submitted on 29/07/2022. Finally, EKT participated in the fast track data transmission round launched by Eurostat and sent the relevant data on 31.03.2022.


15. Coherence and comparability Top

Comparability aims at measuring the impact of differences in applied statistical concepts and definitions on the comparison of statistics between geographical areas, non-geographical domains, or over time.

The coherence of statistical outputs refers to the degree to which the statistical processes by which they were generated used the same concepts (classifications, definitions, and target populations) and harmonised methods. Coherent statistical outputs have the potential to be validly combined and used jointly.

15.1. Comparability - geographical

The harmonised model questionnaire was fully adopted and translated in the national language, following all international standards and the concepts and definitions in line with the Oslo Manual and Eurostat's guidelines. The same questionnaire was used over the entire territory, resulting in full comparability between all Greek regions.

15.1.1. Asymmetry for mirror flow statistics - coefficient

Not requested.

15.1.2. National questionnaire – compliance with Eurostat model questionnaire

Methodological deviations from the CIS Harmonised Data Collection (HDC)

Questions not included in national questionnaire compared to HDC Comment
 3.8_breakdown of other innovation expenditures in the three optional sub-categories for (a) Own personnel, (b) Services, materials, etc. (c) Capital goods  
 4.8 (inflows/outflows from/to other enterprises in the same group) and 4.9 (intra-group loans)  

 

Changes in the filtering compared to HDC Comment
 no changes applied  
15.1.3. National questionnaire – additional questions

  Methodological deviations from the CIS Harmonised Data Collection (HDC)

Additional questions in national questionnaire (not included in HDC) Comment
Assesment of the level of importance of digital transformation to the development of the enterprise  q2.2 of the national questionnaire
Assesment of the level of importance of a given list of strategies related to the digital advancement of the enterprise  q2.3 of the national questionnaire
Assesment of the level of importance of a given list of methods of organization related to the workplace organization of the enterprise  q2.4 of the national questionnaire

Strategies adopted during the COVID-19 pandemic

 q2.5 of the national questionnaire

E-commerce sales for innovative and other products (YES/NO for each type of product)

 q3.5 of the national questionnaire

Use of digital technologies for the development of innovative business processes for a list of business processes (YES In-house/YES Outsourced/NO for each business process)

 q3.8 of the national questionnaire
Use of digital technologies for the development of innovative products and/or business processes from a given list (YES for innovative products/YES for innovative business processes/NO)  q3.9 of the national questionnaire
Relation of cooperation with other organizations for innovation activities for a list of digital technologies? (YES/NO) q4.8 of the national questionnaire
Selection of the area in which the enterprise’s innovation activities contributed the most, based on a given list of areas/fields of special interest for RIS3 (Agro-food, Biosciences, ICT, Energy, etc.) q4.9 of the national questionnaire
Breakdown of higher management position holders between men and women subquestion of q5.3 of the national questionnaire
Expansion of the enterprises share in the domestic/foreign market and expansion to new markets (YES domestic/YES foreign/YES both/NO for existing and new markets) q5.8 of the national questionnaire
Assessment of the level of importance of a given list of practices related to the enterprise's access to the market (domestic/foreign) q5.9 of the national questionnaire
Assessment of the level of importance of a given list of digital technologies in relevance with the future growth of the enterprise q5.10 of the national questionnaire
Intension to use innovative digital practices in the future for a list of business processes (YES/NO) q5.11 of the national questionnaire
Selection of factors that would facilitate the adoption of innovative digital technologies q5.12 of the national questionnaire
Questionnaire evaluation section 6 of the national questionnaire
15.2. Comparability - over time

Due to important methodological changes driven by Oslo Manual 2018, CIS 2018 and CIS 2020 cannot be directly compared with previous CIS waves.

15.2.1. Length of comparable time series

Not requested.

15.3. Coherence - cross domain

See the comparison between SBS and CIS data in the section 15.3.3 below.

15.3.1. Coherence - sub annual and annual statistics

Not requested.

15.3.2. Coherence - National Accounts

Not requested.

15.3.3. Coherence – Structural Business Statistics (SBS)

This part compares key variables for aggregated CIS data with SBS data
Definition of relative difference between CIS and SBS data: DIFF = (SBS/CIS)*100

Comparison between SBS and CIS data (relative difference) by NACE categories and for enterprises with 10 or more employees

NACE Size class Number of enterprises (SBS/CIS)* Number of employees (SBS/CIS)* Total Turnover (SBS/CIS)*
Core NACE (B-C-D-E-46-H-J-K-71-72-73)** Total 94.55 92.37 86.21
Core industry (B_C_D_E - excluding construction) Total 91.59 91.43 97.95
Core Services (46-H-J-K-71-72-73)** Total 96.80 93.21 76.64

* The reported ratios compare CIS 2020 with SBS 2020.   

** Financial and insurance activities corresponding to NACE rev. 2 section K are excluded from the comparison.

15.4. Coherence - internal

Not requested.


16. Cost and Burden Top

Confidential information on the production cost of the CIS.


17. Data revision Top
17.1. Data revision - policy
EKT does not implement official (i.e., programmed) revisions of the final R&D, CIS, and GBARD data. Nonetheless, EKT’s policy for unexpected discrepancies (e.g., significant methodological mistakes) that greatly affect the data provides that EKT immediately re-announces (publicly on the website) the updated figures, along with the corresponding clarifications concerning the relevant corrections.
17.2. Data revision - practice

Not requested.

17.2.1. Data revision - average size

Not requested.


18. Statistical processing Top
18.1. Source data

See below.

18.1.1. Sampling frame (or census frame)

The Statistical Business Register of reference year 2018, maintained by the Hellenic Statistical Authority, was used as the sampling frame.

18.1.2. Sampling design

The sample of enterprises is determined following the specifications and precision requirements proposed by Eurostat in the survey methodological guidelines.

A one-stage stratified random sampling was applied for the selection of the CIS 2020 sample. The strata in the sampling frame were defined based on the following three variables:

  • 2-digit sector of economic activity, in accordance with NACE Rev.2 classification specifications
  • Region (NUTS 2 level)
  • Enterprise size class according to the number of employees (10-19, 20-49, 50-99, 100-249, 250-499, 500-999, 1000+ employees)

Sample selection was carried out by the Hellenic Statistical Authority using random sampling techniques applied to strata. In total, there were 8,589 enterprises selected from the sampling frame belonging in 1,246 strata.

18.1.3. Target population and sample size
Sample/census indicator Number of enterprises
Target population 14573 
Sample 8589
In case of combination sample/census:
Sampled units 8176
Enumerated units/census  413
Overall sample rate (overall sample/target population)  58.9%
18.1.4. Data source for pre-filled variables

Variables and indicators filled or prefilled from other sources.

 

Variables/Indicators Source Reference year
None

All variables are collected via the survey questionna

18.1.5. Data source and variables used for derivation and weighting
Item Response
Data source used for deriving population totals  Number of enterprises by NACE section, size class and NUTS2 region as provided in the Statistical Business Register.
Variables used for weighting  Number of enterprises in each stratum of the population.
18.2. Frequency of data collection

According to the Commission Regulation (UE) 995/2012, the innovation statistics shall be provided to Eurostat every two years in each even year.

18.3. Data collection

CIS data are collected with electronic (online) questionnaires addressed to the enterprises participating in the survey. The online questionnaire is available at the dedicated website https://metrics-login.ekt.gr/, in which all enterprises must first login using their unique credentials.

The LimeSurvey platform is used for the implementation of the electronic survey, which has been further developed by the National Documentation Centre with the integration of multiple functions. CIS questionnaires for all reporting periods are uploaded at https://metrics.ekt.gr/innovation/questionnaires.

18.3.1. Survey participation

Mandatory survey

18.3.2. Survey type

Combination of census and sample survey.

18.3.3. Combination of sample survey and census data
  • Census for enterprises over 500 persons employed and R&D 2020 performers.
  • Sampling from the Statistical Business Register for enterprises in the remaining size classes of the target population.
18.3.4. Census criteria

Census is conducted for all enterprises over 500 persons employed and R&D 2020 performers (enterprises that are systematically active in Research and Development based on the national survey on BES R&D).

18.3.5. Data collection method

Data collection method

Survey method Yes/No Comment
Face-to-face interview    
Telephone interview    
Postal questionnaire    
Electronic questionnaire (format Word or PDF to send back by email)    
Web survey (online survey available on the platform via URL)  YES Online survey supported by telephone contacts and by ~230 experienced statistical correspondents  
Other    
18.4. Data validation

Not requested.

18.5. Data compilation

Operations performed on data to derive new information according to a given set of rules.

18.5.1. Imputation - rate

Imputation is the method of creating plausible (but artificial) substitute values for all those missing.

Definition of imputation rate:

Imputation rate (for the variable x) (%) = 100*(Number of replaced values) / (Total number of values for a given variable)

Definition of weighted imputation rate:

Weighted imputation rate = 100*(Number of total weighted replaced values) / (Total number of weighted values for a given variable)

18.5.1.1. Imputation rate for metric variables

Imputation rate for metric variables by NACE categories and for enterprises with 10 or more employees:

NACE Size class Total Turnover (1) Turnover from products new to the market (2) R&D expenditure in-house (3)
Unweighted Weighted Unweighted Weighted Unweighted Weighted
Core NACE (B-C-D-E-46-H-J-K-71-72-73) Total 5.25 3.79 2.66 1.16 3.01 1.76
Core industry (B_C_D_E - excluding construction) Total  5.67  4.63 3.10 1.55  3.25 2.12
Core Services (46-H-J-K-71-72-73) Total  4.83  3.17 2.22 0.88 2.72  1.45

(1) = Total turnover in the last year of the reference period (t) (TUR)

(2) = Share of the turnover in the last year of the reference period (t) due to new or improved product new to the market in the total turnover for product innovative enterprises TUR_PRD_NEW_MKT/TUR(INNO_PRD)

(3) = R&D expenditure performed in-house (EXP_INNO_RND_IH)

18.5.2. Weights calculation

Weights calculation method for sample surveys

Method Selected applied method  Comments
Inverse sampling fraction X  
Non-respondent adjustments  X  
Other    
18.6. Adjustment

No calibration method used.

18.6.1. Seasonal adjustment

Not requested.


19. Comment Top


Related metadata Top


Annexes Top
GREECE_national CIS 2018-2020 questionnaire_EL