Turkish Statistical Institute (TurkStat)

Science and Technology Statistics Group

Türkiye İstatistik Kurumu, Devlet Mah. Necatibey Cad. No:114  06420 Çankaya/ANKARA

The Community Innovation Survey (CIS) is a survey about innovation activities in enterprises. The survey is designed to collect the information on types of innovation, processes of development of innovation like cooperation patterns, financing and expenditure, objectives of innovation activities or barriers for initiating or implementing innovation.

The CIS provides statistics by type of innovators, economic activity and size class of enterprises. The survey is currently carried out every two years across the EU Member States, EFTA countries and EU candidate countries.

In order to ensure comparability across countries, Eurostat together with the countries develops a Harmonised Data Collection (HDC) questionnaire and drafts the methodological recommendations for implementation of each survey round. 

CIS 2020 is a second in a row to implement concepts and methodology of the Oslo Manual 4th Edition revised in 2018. The changes in the CIS driven by the revision of the manual and their impact on collected indicators are described in the Statistics Explained article: Community Innovation Survey – new features. 

The legal framework for CIS since 2012 is the Commission Regulation No 995/2012 that establishes the quality conditions for the data collection and transmission and identifies the obligatory cross-coverage of economic sectors, size class of enterprises and innovation indicators. The target population are enterprises with at least 10 employees classified in the core NACE economic sectors (see 3.3).  Further activities may be covered on a voluntary basis in national datasets. Most statistics are based on the 3-year reference period (t, t-1, t-2), but some use only one calendar year (t or t-2). Please refer to the Annex section of the European metadata (ESMS) for details of the time coverage of collected indicators.

Indicators related to the enterprises are classified by country, economic activity (NACE Rev. 2), size class of enterprises and type of innovation.

The main typology of classification of enterprises in reference to innovation is the distinction between innovation-active enterprises (INN) and not innovation-active enterprises (NINN).

The enterprise is considered as innovative (INN) if during the reference period it successfully introduced a a) product or a) business process innovation, c) completed but not yet implemented the innovation, d) had ongoing innovation activities, e) abandoned innovation activities or was f) engaged in in-house R&D or R&D contracted out. Non-innovative (NINN) enterprises had no innovation activity mentioned above whatsoever during the reference period.

CIS covers main economic sectors according to NACE Rev.2 broken down by size class of enterprises and type of innovation activity.

In accordance with Commission Regulation 995/2012 on innovation statistics, the following industries and services are included in the core target population. Results are made available with these following breakdowns :

All NACE – Core NACE (NACE Rev. 2  sections & divisions B-C-D-E-46-H-J-K-71-72-73 )

CORE INDUSTRY (excluding construction) (NACE Rev. 2 SECTIONS B_C_D_E)

10-12: Manufacture of food products, beverages and tobacco

13-15: Manufacture of textiles, wearing apparel, leather and related products

16-18: Manufacture of wood, paper, printing and reproduction

20: Manufacture of chemicals and chemical products

21: Manufacture of basic pharmaceutical products and pharmaceutical preparations

19-22: Manufacture of petroleum, chemical, pharmaceutical, rubber and plastic products

23: Manufacture of other non-metallic mineral products

24: Manufacture of basic metals

25: Manufacture of fabricated metal products, except machinery and equipment

26: Manufacture of computer, electronic and optical products

25-30: Manufacture of fabricated metal products (except machinery and equipment), computer, electronic and optical products, electrical equipment, motor vehicles and other transport equipment

31-33: Manufacture of furniture; jewellery, musical instruments, toys; repair and installation of machinery and equipment

D: ELECTRICITY, GAS, STEAM AND AIR CONDITIONING SUPPLY

E: WATER SUPPLY; SEWERAGE, WASTE MANAGEMENT AND REMEDIATION ACTIVITIES

36: Water collection, treatment and supply

37-39: Sewerage, waste management, remediation activities

CORE SERVICES (NACE Rev. 2 sections & divisions 46-H-J-K-71-72-73)(NACE code in the tables = G46-M73_INN)

46: Wholesale trade, except of motor vehicles and motorcycles

H: TRANSPORTATION AND STORAGE

49-51: Land transport and transport via pipelines, water transport and air transport

52-53: Warehousing and support activities for transportation and postal and courier activities

J: INFORMATION AND COMMUNICATION

58: Publishing activities

61: Telecommunications

62: Computer programming, consultancy and related activities

63: Information service activities

K: FINANCIAL AND INSURANCE ACTIVITIES

64: Financial service activities, except insurance and pension funding

65: Insurance, reinsurance and pension funding, except compulsory social security

66: Activities auxiliary to financial services and insurance activities

M: PROFESSIONAL, SCIENTIFIC AND TECHNICAL ACTIVITIES

71: Architectural and engineering activities; technical testing and analysis

72: Scientific research and development

73: Advertising and market research

71-73: Architectural and engineering activities; technical testing and analysis; Scientific research and development; Advertising and market research

There is no additional breakdown for national survey. It is compatible with main sectors covered for Eurostat methodology.

In accordance with Commission Regulation 995/2012 on innovation statistics, the following size classes of enterprises according to number of employees are included in the core target population of the CIS:

• 10 - 49 employees
• 50 - 249 employees
• 250 or more employees

There is no additional size class added for national survey. It is compatible with the size classes covered for Eurostat methodology.

The description of concepts, definitions and main statistical variables is available in CIS 2020 European metadata file (ESMS) Results of the community innovation survey 2020 (CIS2020) (inn_cis12) in Eurostat database.

Enterprise

Core target population are all enterprises in CORE NACE activities (see 3.3.1) with 10 or more employees.

Geographical coverage regardless of their population size as with all provincial and district centres located in the Republic of Turkey's border villages have been covered.

There is no regional dimension available.

Several rounds of Community Innovation Survey have been conducted so far at two-year interval since end of 90’s.

*two reference periods can be distinguished for CIS light: 2000-2002 and 2001-2003

Not relevant.

CIS indicators are available according to 3 units of measure:

NR: Number for number of enterprises and number of persons employed.

THS_EUR: Thousands of euros. All financial variables are provided in thousands of euros, i.e. Turnover or Innovation expenditure.

PC: Percentage. The percentage is the ratio between the selected combinations of indicators.

For CIS 2020, the time covered by the survey is the 3-year period from the beginning of 2018 to the end of 2020.

Some questions and indicators refer to one year — 2020.

The list of indicators covering the 3-year period and referring to one year according to the HDC is available in the Annex section of the European metadata (ESMS). 

CIS surveys are based on the Commission Regulation No 995/2012, implementing Decision No 1608/2003/EC of the European Parliament and of the Council on the production and development of Community statistics on science and technology.

This Regulation establishes innovation statistics on a statutory basis and makes the delivery of certain variables compulsory e.g. innovation activities, cooperation, development, expenditures and turnover (see the Regulation). Each survey wave may additionally include further variables. 

In addition, the Regulation defines the obligatory cross-coverage of economic sectors and size class of enterprises.

National legislation for CIS 2020 survey is based on the Turkish Statistical Institute Official Statistics Programme 2017-2021.

Not requested.

CIS data are transmitted to Eurostat via EDAMIS using the secured transmission system.

Statistical Law of Turkey, Article No:13. "Confidential data can be accessed only by the ones involved in the production of official statistics, to the extent that they need for performing their duties properly. If the number of the statistical unit in any cell of the data table formed by aggregating the individual data is less than three or one or two of the statistical units are dominant even if the number of units is three or more, the data in the concerned cell is considered confidential. The confidential data compiled, processed and preserved for the production of official statistics cannot be delivered to any administrative, judiciary or military authority or person, can not be used for purposes other than statistics or as an instrument of proof. Civil servants and other staff in charge of compiling and processing these data are obliged to comply with this rule. This obligation continues after the related personnel leave their duties and posts. The rulers of the institutions and organisations producing official statistics shall take all measures to prevent any illicit access, use or revelation of the confidential data. Data or information obtained from sources that are open to all people shall not be deemed confidential. Data confidentiality ceases when a statistical unit gives written approval for the revelation of confidential data concerning itself. Confidential data can be published only as combined with other data so as not to allow any direct or indirect identification."

Statistical Law of Turkey, Article No:13. " If the number of the statistical unit in any cell of the data table formed by aggregating the individual data is less than three or one or two of the statistical units are dominant even if the number of units is three or more, the data in the concerned cell is considered confidential. "

Due to this regulation, aggregation process is performed by combining data.

The information is collected to be used only for statistical work, privacy is guaranteed by Law No. 5429. It can not be used as evidence for emergence of any liability or investigation. This privacy is the legal responsibility of Turkish Statistical Institute.

Press Release Date: 24 December 2021

The other related issues were explained in sections 8.2 and 8.3

https://data.tuik.gov.tr/Bulten/Index?p=Innovation-Survey-2020-37457&dil=2

It is the press release for Innovation Survey, 2020 results.

TurkStat have Data Release Calendar based upon 5429 No. Turkey Statistics Law and Official Statistics Program. 

The calendar offers users the specific dates for surveys to be published and has been updated regularly every year since 2007.

The link for data release calendar:

https://data.tuik.gov.tr/Bulten/Index?p=Innovation-Survey-2020-37457&dil=2

CIS is conducted and disseminated at two-year interval in pair years.

Accessibility and clarity refer to the simplicity and ease for users to access statistics using simple and user-friendly procedure, obtaining them in an expected form and within an acceptable time period, with the appropriate user information and assistance: a global context which finally enables them to make optimum use of the statistics.

https://data.tuik.gov.tr/Bulten/Index?p=Innovation-Survey-2020-37457&dil=2

The PDF file of the press release was attached below.

-              Online database (containing all/most results) : The users can access all the survey results, statistical tables and press release results from the web site. There is no specific online database for the survey.

https://data.tuik.gov.tr/Kategori/GetKategori?p=bilgi-teknolojileri-ve-bilgi-toplumu-102&dil=2

-              Analytical publication (referring to all/most results) : There is no analytical publication.

-              Analytical publication (referring to specific results, e.g. only for one sector or one specific aspect) : There is no analytical publication.

See the link and click Metadata / Scope of Data section https://data.tuik.gov.tr/Kategori/GetKategori?p=bilgi-teknolojileri-ve-bilgi-toplumu-102&dil=2

• Mining and quarrying (NACE B: 05-09)
• Manufacturing (NACE C: 10-33)
• Electricity, gas steam and air conditioning supply (NACE D: 35)
• Water supply; sewerage, waste management and remediation activities (NACE E: 36-39) (NACE E: 36-39)
• Wholesale trade, except of motor vehicles and motorcycles (NACE 46)
• Transportation and storage (NACE H: 49-53)
• Information and communication (NACE J: 58-63)
• Financial and insurance activities (NACE K: 64-66)
• Architectural and engineering activities; technical testing and analysis (NACE 71)
• Scientific research and development (NACE 72)
• Advertising and market research (NACE 73)

Not requested.

The users can access the micro data from Micro Data Research Centers located in central building and regional offices.

There is no other dissemination format.

Not requested.

Analytical Framework, concepts, definitions, classifications, scope of the data, characteristics of basic data sources accounting conventions, compilation practices, revisions.

Everyone can access these related issues on "https://data.tuik.gov.tr/Kategori/GetKategori?p=bilgi-teknolojileri-ve-bilgi-toplumu-102&dil=2".

Not requested.

There is no on-line manual about the survey. The reference documentation is Oslo Manual and Regulations.

Some explanations about conceptual and methodological issues have been published in national website as metadata. Everyone can access these related issues on "https://data.tuik.gov.tr/Bulten/Index?p=Innovation-Survey-2020-37457".

A national quality report is prepared by Science and Technology Statistics Group.

The statistics group in charge calculate the estimates for main variables; standard errors, confidence limits are examined by Quality Audit Group.

• Response burden
• Difficult to understand some questions and/or concepts (using pop-up and/or more detailed clarifications from Oslo Manual)
• Interviewing with the most responsible person for the part of the survey. Especially for the 250+ size class enterprises (acquiring appointments from the top managers as much as we can)
• Schedule of sending data to Eurostat (By designing SAS codes, this lag has been tried to descreased)
• Data coherence (using some edit codes with the assistance of a software into the our survey)
• Obtaining turnover data from administrative records

Relevance is the degree to which statistics meet current and potential users’ needs. It includes the production of all needed statistics and the extent to which concepts used (definitions, classifications etc.) reflect user needs. The aim is to describe the extent to which the statistics are useful to, and used by, the broadest array of users. For this purpose, statisticians need to compile information, firstly about their users and their needs.

The CIS is based on a common questionnaire and a common survey methodology in order to achieve comparable, harmonised and high quality results for EU Member States, EFTA countries, Candidates and Associated countries.

Presidency Science, Technology and Innovation Policies Board: the main body for policy making related to R&D and innovation topics.

Ministry of Science and Technology: Organization of grant schemes for enterprises, tax incentives and exemptions based on related laws.

The Scientific and Technological Research Council of Turkey: Organization of grant schemes for enterprises.

Turkish Industry and Business Assosication, Technology Development Foundation of Turkey: Organization of grant schemes for enterprises.

Researchers and/or students: Micro data usage and following press release results.

Not available

The respondents must fill the questionnaire according to Turkey Statistical Law No. 5429 "7, 8, 9 and 10 of" harvested in accordance.

If the questionnaires are not completed at the desired time, or if they are answered incorrectly, administrative fines shall be applied according to Articles 53 and 54 of the related law.

The implementation of administrative monetary penalties and other penalties does not remove the statistical unit's obligation to provide information.

All mandatory sectors and indicators are covered in national CIS to comply with model questionnaire.

Not requested.

Accuracy in the statistical sense denotes the closeness of computations or estimates to the exact or true values. Statistics are not equal with the true values because of variability (the statistics change from implementation to implementation of the survey due to random effects) and bias (the average of the possible values of the statistics from implementation to implementation is not equal to the true value due to systematic effects).

That part of the difference between a population value and an estimate thereof, derived from a random sample, which is due to the fact that only a subset of the population is enumerated.

The main indicator used to measure sampling errors for CIS data is the coefficient of variation (CV).

Coefficient of Variation= (Square root of the estimate of the sampling variance) / (Estimated value)

Formula:

where

Coefficient of variation (%) for key variables by NACE categories and for enterprises with 10 and more employees

[1] = Coefficient of variation for the percentage of innovative enterprises (INN) in the total population of enterprises (ENT20)
[2] = Coefficient of variation for the turnover of product innovative enterprises with new or improved products (TUR_PRD_NEW_MKT), as a percentage of total turnover of product innovative enterprises [TUR20,INNO_PRD].
[3] = Coefficient of variation for percentage of product and/or process innovative enterprises (incl. enterprises with abandoned and or on-going activities) involved in any innovation co-operation arrangement [COOP_ALL,INN], as a percentage of innovative enterprises (INN).

Standard error is calculated by the module survey freq and survey means under SAS 9.1.3 version. The standard error calculations related to proportions under this module is based on Taylor Series Linearization method. This module is a useful SAS procedure for generating results on the basis of both frequency tables and cross tables and their standard errors. In this module weighting procedures have also been taken into account. Formula used in the module is given below.

Non-sampling errors occur in all phases of a survey. They add to the sampling errors (if present) and contribute to decreasing overall accuracy. It is important to assess their relative weight in the total error and devote appropriate resources for their control and assessment.

Coverage errors (or frame errors) are due to divergences between the target population and the frame population. The frame population is the set of target population members that has a chance to be selected into the survey sample. It is a listing of all items in the population from which the sample is drawn that contains contact details as well as sufficient information to perform stratification and sampling.

Not requested.

Not requested.

Under covered groups of the target population are compatible with the sum of core NACE.

Not available.

Measurement errors occur during data collection and generate bias by recording values different than the true ones. The survey questionnaire used for data collection may have led to the recording of wrong values, or there may be respondent or interviewer bias.

Putting warnings into on-line questionnaire, preparing descriptive brochures to respondents, testing on-line questionnaire both in our centre and regional offices.

Non response occurs when a survey fails to collect data on all survey variables from all the population units designated for data collection in a sample or complete enumeration.                                                                                                                                                                                              

There are two types of non-response:                                                                                                                                                                                      

1) Unit non-response, which occurs when no data (or so little as to be unusable) are collected about a population unit designated for data collection.                                                                                                                                                                      

a) Un-weighted unit non-response rate (%) = 100*(Number of units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample)                                                                                                         

b) Weighted unit non-response rate (%) = 100*(Number of weighted units with no response or not usable response) / (Total number of in-scope (eligible) units in the sample)                                                                                                            

2) Item non-response, which occurs when only data on some, but not all survey data items are collected about a population unit designated for data collection.                                       

a) Un-weighted item non-response rate (%) = 100*(Number of units with no response at all for the item) / (Total number of eligible, for the item, units in the sample i.e. filters have to be taken into account) 

There is no item non response for the survey.

Unit non response rates were shared under the related sub-items of the quality report.

See below.

Un-weighted and weighted unit non-response rate by NACE categories and for enterprises with 10 or more employees

The number of eligible units is the number of sample units, which indeed belong to the target population.

Number of eligible units in survey data is 10811. Weighted unit non-response rate is %0.942.

2

See below.

Item non-response rate for Turnover (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees).

Item non-response rate for new questions in CIS t (in Core NACE: B-C-D-E-46-H-J-K-71-72-73 enterprises with 10 or more employees)
 

 Data is entered by respondents via on-line survey. The user name and password are provided by TurkStat. 

Not requested.

Timeliness and punctuality refer to time and dates, but in a different manner.

The timeliness of statistics reflects the length of time between data availability and the event or phenomenon they describe.

Timeliness of national data – date of first release of national level : 24.11.2021

Not requested.

Punctuality refers to the time lag between the release date of data and the target date on which they were scheduled for release as announced officially.

Date of transmission of complete and validated data to Eurostat (Number of days between that data and 16 September 2022) : 

Comparability aims at measuring the impact of differences in applied statistical concepts and definitions on the comparison of statistics between geographical areas, non-geographical domains, or over time.

The coherence of statistical outputs refers to the degree to which the statistical processes by which they were generated used the same concepts (classifications, definitions, and target populations) and harmonised methods. Coherent statistical outputs have the potential to be validly combined and used jointly.

The results are not published at regional level.

Not requested.

Methodological deviations from the CIS Harmonised Data Collection (HDC)

Methodological deviations from the CIS Harmonised Data Collection (HDC)

Due to important methodological changes driven by Oslo Manual 2018, only CIS 2018 and CIS 2020 can be directly compared with previous CIS waves.

Not requested.

See the comparison between SBS and CIS data in the section 15.3.3 below.

Not requested.

Not requested.

This part compares key variables for aggregated CIS data with SBS data
Definition of relative difference between CIS and SBS data: DIFF = (SBS/CIS)*100

Comparison between SBS and CIS data (relative difference) by NACE categories and for enterprises with 10 or more employees

* Numbers are to be provided for the last year of the reference period (t)

NOTE: TurkStat have protocol with related institutions to set a frame for business registers. All surveys determine the target population / samples from the same database for the reference period. Therefore there is no difference from Structural Business Statistics.

Not requested.

Confidential information on the production cost of the CIS.

Not requested.

Not requested.

Not requested.

See below:

National business register is used for the sampling frame

A sample of 10,849 enterprises was drawn. Enterprises with 10 and more employed persons were fully enumerated, 48.2% of those with 10-49 employed persons, and 27.36% of enterprises with 50 to 249 employed persons etc. Stratification variables were NACE classes (30 strata), size class (3 strata).  Altogether 90 strata were were filled with at least one enterprise.

Variables and indicators filled or prefilled from other sources.

According to the Commission Regulation (UE) 995/2012, the innovation statistics shall be provided to Eurostat every two years in each even year t+18.

Web based questionnaire is performed to respondents.

Mandatory

Data are collected through combination of census (for 250+ size class) and sample survey. On-line survey is used.

Sampling method is used for the enterprises with 10-49 and 50-249 employees. Census is carried out for the enterprises with greater than 250 employees.

Census is carried out for the enterprises with greater than 250 employees.

Data collection method

Not requested.

Operations performed on data to derive new information according to a given set of rules.

Imputation is the method of creating plausible (but artificial) substitute values for all those missing.

Definition of imputation rate:

Imputation rate (for the variable x) (%) = 100*(Number of replaced values) / (Total number of values for a given variable)

Definition of weighted imputation rate:

Weighted imputation rate= 100*(Number of total weighted replaced values) / (Total number of weighted values for a given variable)

Imputation rate for metric variables by NACE categories and for enterprises with 10 or more employees:

 There is no imputation in the survey. 

(1) = Total turnover in the last year of the reference period (t) (TUR)

(2) = Share of the turnover in the last year of the reference period (t) due to new or improved product new to the market in the total turnover for product innovative enterprises TUR_PRD_NEW_MKT/TUR(INNO_PRD)

(3) = R&D expenditure performed in-house (EXP_INNO_RND_IH)

Weights calculation method for sample surveys

Selection of sample unit: Sequential Simple Random Sampling is used in the strata by taking into account of the economic activities (in accordance with NACE Rev.2) and enterprise size according to the number of employees (10-49, 50-249 ve 250+).

Sample sizes and estimation methods: Innovation Survey is planned to give estimation according to size groups and economic activity groups for enterprises. According to estimation level stratification variables are given below : 

Estimation Level for Size Groups:  

- small enterprises: 10–49 employees;

- medium-sized enterprises: 50–249 employees;

- large enterprises: 250 or more employees                          

Estimation Level for Activity Groups can be observed from added file.

Weighting: At the first step, design weights are evaluated by the inverse of selection probabilities. Following the survey, non-response adjustment factors obtained and multiplied by the design weight to get final weights.

Not available

Not requested.