{"text_format":"1","workbook":"xlsx","n_sheets":3,"sheets":["Instructions","Safe researcher test","source data"],"not_rendered":{"charts":0,"images":0,"macros":1,"external_links":0,"defined_names":22,"comments":0,"pivot_tables":0},"unopened":[],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900"}

{"sheet":"Instructions","index":0,"n_rows":11,"n_cols":1,"rows_kept":11,"cut":false,"hidden":false,"merged":[]}
["Instructions for completing the self-assessment test"]
[]
["1. Go to the spreadsheet \"Safe researcher test\""]
["2. Click on the button \"Create test\". This will generate the random assignment of test answers"]
["3. In the column \"Your answer\" enter the value 1 to 5 which you think is the correct answer. You can go back and edit your answers as necessary"]
["4. When you have filled in all your answers, click on the button \"Show score\". This will not work until you have suggested an answer to each question"]
["5. Review your score. Individual questions are marked as \"T\" or \"F\" in the column next to your answer."]
["6. Review your understanding. Each answer (including the correct one) has feedback associated with it. This should explain why the answer is wrong (or why it is correct, if that surprises you)"]
["7. Once you have marked the initial test, further changes you make will immediately be reflected in the score and the feedback column. This allows you to confirm your understanding."]
[]
["This is a formative assessment (ie designed to help you learn). Please don't cheat more than you have to!"]

{"sheet":"Safe researcher test","index":1,"n_rows":36,"n_cols":11,"rows_kept":36,"cut":false,"hidden":false,"merged":[[0,0,0,7]]}
["How to be a safe researcher: self-study test"]
[null,null,null,null,null,{"$f":"+\"Number of responses: \"&test_block_num_resp","v":"Number of responses: 0"},null,{"$f":"+IF(COUNT(test_block_user_responses)=num_questions,\"Score: \"&Score&\"/\"&num_questions,\"Test not complete\")","v":"Test not complete"}]
[null,null,null,null,null,"Score can be displayed when all questions answered"]
[null,null,null,1,2,3,4,5,{"$f":"+COUNT(test_block_user_responses)","v":0},{"$f":"+COUNTIF(test_block_perfomance,\"=TRUE\")","v":0}]
["Q.","Module","Question",{"$f":"+\"Answer \"&D4","v":"Answer 1"},{"$f":"+\"Answer \"&E4","v":"Answer 2"},"Answer 3","Answer 4","Answer 5","Your answer\n1-5",null,"Feedback"]
[0,{"$f":"+INDEX(module_no,'Safe researcher test'!$A6)&\"\n\"","v":"1\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A6)&\"\n\"","v":"Who is in trouble if you breach data confidentiality?\n"},{"$f":"+INDEX(answers,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,D$4))&\"\n\"","v":"You\n"},{"$f":"+INDEX(answers,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,E$4))&\"\n\"","v":"The nearest PhD student\n"},{"$f":"+INDEX(answers,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,F$4))&\"\n\"","v":"The data manager\n"},{"$f":"+INDEX(answers,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,G$4))&\"\n\"","v":"All of us\n"},{"$f":"+INDEX(answers,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,H$4))&\"\n\"","v":"Anyone you can transfer the blame to\n"},null,{"$f":"+I6=INDEX(order,'Safe researcher test'!$A6,1)","v":false},{"$f":"+INDEX(feedback,'Safe researcher test'!$A6,INDEX(ans_order,'Safe researcher test'!$A6,I6))&\"\n\"","v":{"$error":"#VALUE!"}}]
[{"$f":"+A6+1","v":1},{"$f":"+INDEX(module_no,'Safe researcher test'!$A7)&\"\n\"","v":"1\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A7)&\"\n\"","v":"Who is in trouble if you breach data confidentiality?\n"}]
[{"$f":"+A7+1","v":2},{"$f":"+INDEX(module_no,'Safe researcher test'!$A8)&\"\n\"","v":"2\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A8)&\"\n\"","v":"What do we know about research use of confidential data?\n"}]
[3,{"$f":"+INDEX(module_no,'Safe researcher test'!$A9)&\"\n\"","v":"2\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A9)&\"\n\"","v":"Which of these is NOT one of the principles specified in the Regulation governing access to data? (See EU Regulation 557/2013 in the reference section)\n"}]
[4,{"$f":"+INDEX(module_no,'Safe researcher test'!$A10)&\"\n\"","v":"2\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A10)&\"\n\"","v":"Who is allowed to get access to microdata provided by Eurostat?  (see 'How to apply for microdata access' in the reference documentation)\n"}]
[5,{"$f":"+INDEX(module_no,'Safe researcher test'!$A11)&\"\n\"","v":"3\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A11)&\"\n\"","v":"What is the main difference between the “human” and the “intruder\" model in relation to academic research?\n"}]
[6,{"$f":"+INDEX(module_no,'Safe researcher test'!$A12)&\"\n\"","v":"4\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A12)&\"\n\"","v":"Which of these is not one of the 'five safes'?\n"}]
[7,{"$f":"+INDEX(module_no,'Safe researcher test'!$A13)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A13)&\"\n\"","v":"What is the commonest source of breaches of confidentiality?\n"}]
[8,{"$f":"+INDEX(module_no,'Safe researcher test'!$A14)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A14)&\"\n\"","v":"What is the commonest source of breaches of procedure?\n"}]
[9,{"$f":"+INDEX(module_no,'Safe researcher test'!$A15)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A15)&\"\n\"","v":"Which of these is acceptable, according to your access agreement?\n"}]
[10,{"$f":"+INDEX(module_no,'Safe researcher test'!$A16)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A16)&\"\n\"","v":"Can a Master's student access Eurostat data? (see 'How to apply for microdata access' in the reference documentation)\n"}]
[11,{"$f":"+INDEX(module_no,'Safe researcher test'!$A17)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A17)&\"\n\"","v":"What may be retained after the project is complete (see FAQs and Confidentiality agreement in the reference documentation)\n"}]
[12,{"$f":"+INDEX(module_no,'Safe researcher test'!$A18)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A18)&\"\n\"","v":"Your institute has got confidential data. Who is allowed to work with the data?\n"}]
[13,{"$f":"+INDEX(module_no,'Safe researcher test'!$A19)&\"\n\"","v":"5\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A19)&\"\n\"","v":"Which of the following mistake should you avoid when dealing with official microdata?\n"}]
[14,{"$f":"+INDEX(module_no,'Safe researcher test'!$A20)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A20)&\"\n\"","v":"According to Brandt et al (2010) which of these is an 'unsafe' statistic?\n"}]
[15,{"$f":"+INDEX(module_no,'Safe researcher test'!$A21)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A21)&\"\n\"","v":"According to Brandt et al (2010) which of these is a 'safe' statistic?\n"}]
[16,{"$f":"+INDEX(module_no,'Safe researcher test'!$A22)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A22)&\"\n\"","v":"According to Brandt et al (2010) what should be the MINIMUM frequency (threshold) for statistics such as cell counts, in the absence of dataset-specific guidelines?\n"}]
[17,{"$f":"+INDEX(module_no,'Safe researcher test'!$A23)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A23)&\"\n\"","v":"According to Brandt et al (2010) what should be the MINIMUM degrees of freedom for 'safe' statistics?\n"}]
[18,{"$f":"+INDEX(module_no,'Safe researcher test'!$A24)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A24)&\"\n\"","v":"According to Brandt et al (2010, section 2.3.1) how should class disclosure be dealt with?\n"}]
[19,{"$f":"+INDEX(module_no,'Safe researcher test'!$A25)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A25)&\"\n\"","v":"Is there usually a problem of data privacy from regression coefficients when analysing skewed data?\n"}]
[20,{"$f":"+INDEX(module_no,'Safe researcher test'!$A26)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A26)&\"\n\"","v":"Can regression residuals ever be published?\n"}]
[21,{"$f":"+INDEX(module_no,'Safe researcher test'!$A27)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A27)&\"\n\"","v":"Is it necessary to apply sensitivity rules to tabular data from sample surveys?\n"}]
[22,{"$f":"+INDEX(module_no,'Safe researcher test'!$A28)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A28)&\"\n\"","v":"The mean annual earnings of 12 individuals in a village is €315,000. The largest earner is a footballer on €3.5m per year. Given a minimum frequency of 10 and an (n, k) dominance rules of (1, 90), is mean or total earnings publishable according to the rules?\n"}]
[23,{"$f":"+INDEX(module_no,'Safe researcher test'!$A29)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A29)&\"\n\"","v":"My colleague told me, that graphs are always safe. Is he right?\n"}]
[24,{"$f":"+INDEX(module_no,'Safe researcher test'!$A30)&\"\n\"","v":"6\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A30)&\"\n\"","v":"What is secondary suppression?\n"}]
[25,{"$f":"+INDEX(module_no,'Safe researcher test'!$A31)&\"\n\"","v":"7\n"},{"$f":"+INDEX(questions,'Safe researcher test'!$A31)&\"\n\"","v":"What is NOT a key message to take away from this training?\n"}]
[]
[]
[]
[null,"Score"]
[null,"Num responses"]

{"sheet":"source data","index":2,"n_rows":30,"n_cols":32,"rows_kept":30,"cut":false,"hidden":false,"merged":[]}
["Instructions: copy and paste into the section 'source data' only - you sohudl have the same number of questions and answers. If you have more or less, reduce/increase the rows in 'source data' before pasting"]
["Also expand the blocks on the self-test sheet"]
["Number of questions",null,{"$f":"+ROWS(source_data)","v":25},"Number of answers per question",null,null,{"$f":"+COLUMNS(answers)","v":5},null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,1,2,3,4,5]
["Module","Test question","Answers",null,null,null,null,"Feedback",null,null,null,null,"Ordering variable",null,null,null,null,"Ordering fixed",null,null,null,null,"Order",null,null,null,null,"Ans. order"]
[null,null,true,1,2,3,4,true,1,2,3,4,"T",1,2,3,4,"T",1,2,3,4,"T",1,2,3,4,1,2,3,4,5]
[1,"Who is in trouble if you breach data confidentiality?","All of us","You","The data manager","Anyone you can transfer the blame to","The nearest PhD student","Everyone loses, as the likely consequence is a tightening of restrictions. So, if there is a genuine mistake or lack of understanding, the data owners will be more interesting in preventing a recurrence than allocating blame.",{"$f":"+H6","v":"Everyone loses, as the likely consequence is a tightening of restrictions. So, if there is a genuine mistake or lack of understanding, the data owners will be more interesting in preventing a recurrence than allocating blame."},{"$f":"+I6","v":"Everyone loses, as the likely consequence is a tightening of restrictions. So, if there is a genuine mistake or lack of understanding, the data owners will be more interesting in preventing a recurrence than allocating blame."},{"$f":"+J6","v":"Everyone loses, as the likely consequence is a tightening of restrictions. So, if there is a genuine mistake or lack of understanding, the data owners will be more interesting in preventing a recurrence than allocating blame."},{"$f":"+K6","v":"Everyone loses, as the likely consequence is a tightening of restrictions. So, if there is a genuine mistake or lack of understanding, the data owners will be more interesting in preventing a recurrence than allocating blame."},{"$f":"+RAND()","v":0.37895016098828527},{"$f":"+RAND()","v":0.82031379296398255},7.9664937923903167E-2,0.16323634460062542,0.56200667255649228,0.60308736615892045,0.90403463921618243,0.70914389646050746,0.2789643287309661,0.71736130182472058,{"$f":"+RANK(R6,$R6:$V6)","v":4},{"$f":"+RANK(S6,$R6:$V6)","v":1},3,5,2,{"$f":"+MATCH(AB$3,$W6:$AA6,0)","v":2},{"$f":"+MATCH(AC$3,$W6:$AA6,0)","v":5},3,1,4]
[2,"What do we know about research use of confidential data?","It is low risk","There is no risk","We know nothing!","There is no risk for academic use","Academic users are high risk","The evidence supports the idea that research use by academics is low risk ","Evidence shows that research use is low risk, but not zero risk","In fact we know quite a lot, and the evidence shows that research use is low risk, not high risk.","Evidence shows that academics still present a risk of misuse, particularly breaches of procedure","Evidence shows that academics present a low risk of breach of confidentiality.",{"$f":"+RAND()","v":0.34401534627008556},0.32352714742611122,0.89375760253871961,0.91797337293898551,0.25410336650804477,0.34907530099778727,0.64530541449561618,0.93098384280019542,0.4536221162890437,0.84467952640037602,{"$f":"+RANK(R7,$R7:$V7)","v":5},{"$f":"+RANK(S7,$R7:$V7)","v":3},{"$f":"+RANK(T7,$R7:$V7)","v":1},{"$f":"+RANK(U7,$R7:$V7)","v":4},{"$f":"+RANK(V7,$R7:$V7)","v":2},{"$f":"+MATCH(AB$3,$W7:$AA7,0)","v":3},5,2,4,1]
[2,"Which of these is NOT one of the principles specified in the Regulation governing access to data? (See EU Regulation 557/2013 in the reference section)","The proposal demonstrates substantial scientific merit","Access is requested by a recognised research entity","The requested type of confidential data for scientific purposes has been indicated","Access is provided either by the European Commission (Eurostat) or by another access facility accredited by the European Commission (Eurostat)","The relevant national statistical authority which provided the data has given its approval","Correct. The regulation does not make any such statement in its list of basic principles, as the regulation commits the European Commission to supporting research access.","No, this is in the principles: you must be part of recognised research entity to gain access to data via the European Commission (Eurostat)","No, this is in the principles: you must specify which type of confidential data you need for your project: secure use files ot scientific use files. ","No, this is in the principles: only Eurostat can provide access to data under this regulation. So if you acquire data from another source (eg a fellow researcher) you're potentially breaking the law.","No, this is in the principles: NSIs must agree to their data being used for research (and hence it is important you help them see the value of such research)",0.92735890165938573,0.60639278303232536,0.86511649152277037,0.24449148139441956,0.21862366553613188,0.20682043730300803,0.69171545387223377,0.43846856103945353,0.59100856160643411,0.6546191474757268,5,1,4,3,2,2,5,4,3,1]
[2,"Who is allowed to get access to microdata provided by Eurostat?  (see 'How to apply for microdata access' in the reference documentation)","Only the people who have successfully applied for access","Everyone","Those who are employed at a university","All people holding a PhD.","Every adult who is citizen of the EU.","Yes, only named individuals who have applied have access.","No. You have to meet certain criteria, e.g. your organisation must be recognised by Eurostat as a research entity.","No. First of all, your university needs to be a recognised research entity","No. First of all, you have to apply for access successfully.  ","No. You have to meet certain criteria, e.g. your organisation must be recognised by Eurostat as a research entity.",0.71569338516617953,0.21918248586839206,6.9154016515583838E-2,0.43864734091118618,0.96131449738444597,0.53751450870812389,8.0739980958874358E-2,0.48657103480949782,0.5528691227208451,0.94067531290510908,3,5,4,2,1,5,4,1,3,2]
[3,"What is the main difference between the “human” and the “intruder\" model in relation to academic research?","The intruder model makes no assessment of the  trustworthiness of types of users.","There is no real difference.","In the intruder model, researchers are especially skilled at statistical analysis","In the human model PhD students are less trustworthy.","The human model makes no assessment of the trustworthiness of types of users.","Yes. The intruder model makes no assumptions about trust in users: the 'worst case' is already covered by restricting the data. In contrast, the human model relies upon us all working together, with data restrictions being avoided if procedural solutions can be found. You are being allowed to demonstrate your ability to handle data safely.","No, they are based on different assumptions.  The intruder model makes no assumptions about trust in users: the 'worst case' is already covered by restricting the data. In contrast, the human model relies upon us all working together, with data restrictions being avoided if procedural solutions can be found. You are being allowed to demonstrate your ability to handle data safely.","No. Statistical skills are irrelevant; what matters is intention. The intruder model makes no assumptions about trust in users: the 'worst case' is already covered by restricting the data. In contrast, the human model relies upon us all working together, with data restrictions being avoided if procedural solutions can be found. You are being allowed to demonstrate your ability to handle data safely.","No. The intruder model makes no assumptions about trust in users: the 'worst case' is already covered by restricting the data. In contrast, the human model relies upon us all working together, with data restrictions being avoided if procedural solutions can be found. You are being allowed to demonstrate your ability to handle data safely.","The opposite is true. The intruder model makes no assumptions about trust in users: the 'worst case' is already covered by restricting the data. In contrast, the human model relies upon us all working together, with data restrictions being avoided if procedural solutions can be found. You are being allowed to demonstrate your ability to handle data safely.",0.44407056969608116,0.2758190484211428,0.27368402932145719,0.39018486451179735,0.48993723487815999,0.78292377433049198,0.59428506978148665,0.15769932664976372,0.78038831748501392,0.73994518740331261,1,4,5,2,3,1,4,5,2,3]
[4,"Which of these is not one of the 'five safes'?","Safe food","Safe projects","Safe data","Safe settings","Safe outputs","Yes, the most important one is missing - safe people.","The most important one is missing - safe people.","The most important one is missing - safe people.","The most important one is missing - safe people.","The most important one is missing - safe people.",0.10955797935414036,0.7896322709063216,0.76565924662603169,0.53031129768971808,0.28049561305050197,0.62763818418559858,1.8217771037205344E-2,0.43962816494107748,0.49562282684969428,0.76333846730520238,2,5,4,3,1,5,1,4,3,2]
[5,"What is the commonest source of breaches of confidentiality?","We don't know","Mistakes","Deliberate misuse","Deliberate, malicious misuse","Sunspots","True breaches of confidentiality are very rare, and so we have little information on them.",{"$f":"+H12","v":"True breaches of confidentiality are very rare, and so we have little information on them."},{"$f":"+I12","v":"True breaches of confidentiality are very rare, and so we have little information on them."},{"$f":"+J12","v":"True breaches of confidentiality are very rare, and so we have little information on them."},{"$f":"+K12","v":"True breaches of confidentiality are very rare, and so we have little information on them."},0.51953684682196366,0.66131816616730499,0.76959036943765624,0.71899051250512314,0.3405727059864323,2.2940750625652262E-2,0.25480933221281921,0.57103684304039559,0.10622755498672465,0.92179485753428625,5,3,2,4,1,5,3,2,4,1]
[5,"What is the commonest source of breaches of procedure?","Mistakes and ignorance","Deliberate avoidance of procedures","Deliberate, malicious misuse","PhD students","An approaching coffee break","Yes, failure to know and understand procedures,  may lead to misuse.","This is a fair answer, but it is not the commonest source of breach of precedure. If this is the only question you get wrong, give yourself 100%.","There is very little evidence for this. Most misuse comes through mistakes.","PhD students are human too, and so are just as likely as others to make mistakes.","This may increase the likelihood of taking short-cuts, but it's because you've made a mistake understanding the purpose of the procedures that leads to the breach.",0.30263133321520541,0.25615643197661775,0.51165011746980149,0.65049576067608905,0.34700059010791007,0.93521703903344,0.30365069948644996,0.8129986248829274,0.68220903480547357,0.93367938031403241,1,5,3,4,2,1,5,3,4,2]
[5,"Which of these is acceptable, according to your access agreement?","Producing low-quality output","Using the data for unauthorised research","Using the data for longer than agreed","Linking external data without permission","Copying the data to a memory stick","Yes, you have academic freedom as long as you don't breach confidentiality rules!","Incorrect. Doing this will invalidate your agreement, and you may be breaking the law.","Incorrect. Doing this will invalidate your agreement, and you may be breaking the law.","Incorrect. Doing this will invalidate your agreement, and you may be breaking the law.","Incorrect. Doing this will invalidate your agreement, and you may be breaking the law. Even if it is not explicitly forbidden, do not do this; you may be breaching implicit terms about keeping the data secure.",0.24927742061380287,0.11946483813700437,0.49913731194734368,0.44341455143345643,0.85284498051489965,0.87917038046412155,0.41408303374127287,0.62736552981453408,0.87557362582862208,0.91174071573831883,2,5,4,3,1,5,1,4,3,2]
[5,"Can a Master's student access Eurostat data? (see 'How to apply for microdata access' in the reference documentation)","No, because they are not employed by a recognised research entity","No, because they are not seen as trustworthy","Yes, if a member of staff acts as the principal researcher","Yes, if they are studying for a course with a recognised quantitative component","No, because they are not seen as having the necessary skills","Yes. For PhD students the case is slightly different as they are much more closely bound to the university.","No, the issue is that the regulation requires them to be employed by a recognised research entity","No. this is only applicable for PhD students","No, this is not relevant. The issue is that the regulation requires them to be employed by a recognised research entity","No, this is not relevant. The issue is that the regulation requires them to be employed by a recognised research entity",0.50743471829471964,0.81117773785056912,0.68261496799358001,0.47056341608532803,0.91134132068024898,0.8518714688481136,0.29307036082542792,0.30429418470719416,0.61040191207882044,0.1191516856166549,1,4,3,2,5,1,4,3,2,5]
[5,"What may be retained after the project is complete (see FAQs and Confidentiality agreement in the reference documentation)","Syntax files to carry out the analysis","The source data","Derived variables","Intermediate results (ie not published)","Everything but the source data","Yes. All data must be destroyed along with INTERMEDIATE (ie unpublished) results. Note that if you feel you need to retain data or results to deal with referee's queries, confirm with the support team that this is acceptable.","No. All data must be destroyed along with INTERMEDIATE (ie unpublished) results. Note that if you feel you need to retain data or results to deal with referee's queries, confirm with the support team that this is acceptable.","No. All data must be destroyed along with INTERMEDIATE (ie unpublished) results. Note that if you feel you need to retain data or results to deal with referee's queries, confirm with the support team that this is acceptable.","No. All data must be destroyed along with INTERMEDIATE (ie unpublished) results. Note that if you feel you need to retain data or results to deal with referee's queries, confirm with the support team that this is acceptable.","No. All data must be destroyed along with INTERMEDIATE (ie unpublished) results. Note that if you feel you need to retain data or results to deal with referee's queries, confirm with the support team that this is acceptable.",0.70419940435015027,0.92402746855777151,0.55509527218700772,0.11636350507732163,0.32216173038647355,0.72714785117558123,0.9720794397822401,1.0321566198498111E-2,0.61066660989566179,0.61363300361867834,2,1,5,4,3,2,1,5,4,3]
[5,"Your institute has got confidential data. Who is allowed to work with the data?","Only those peoples named on the project access agreement.","Permanent employees of the institute","Only the person who was the responsible contact applying for the data.","All project staff, if they have received appropriate training","Only project team who have been sworn-in to treat the data seriously.","Yes. Your project access agreement is the legal gateway.","No. The legal gateway only exists for named applicants","No. The applicant can ask for multiple people to be given access, as long as they are identified in the access agreement.","No. The training does not establish a legal gateway","No. Your internal measures do not establish a legal gateway",0.11005196758962743,0.51898516307569198,0.16694372035839977,1.7421578687775274E-2,0.65217139810014702,0.90031371603932175,0.67096878189974851,0.63004133926076333,0.86422141740558289,0.53798784761897234,1,3,4,2,5,1,4,2,3,5]
[5,"Which of the following mistake should you avoid when dealing with official microdata?","All of them","Using data for the wrong purpose","Using data outside the project period","Unauthorised data linkage","Giving data access to colleagues who are not named in the contract","Yes, all mistakes can lead to further restrictions of microdata access and all of us would lose. ","You really should avoid this mistake and all the others named as well!","You really should avoid this mistake and all the others named as well!","You really should avoid this mistake and all the others named as well!","You really should avoid this mistake and all the others named as well!",0.59649381347890207,0.35277696525470326,0.20859112221607568,0.44039618362955402,0.52725778985167249,0.85381245862614241,0.32847066916567902,0.43117883871290297,0.73659653203942221,0.68410667553062143,1,5,4,2,3,1,4,5,3,2]
[6,"According to Brandt et al (2010) which of these is an 'unsafe' statistic?","Estimation residuals","Correlation coefficients","Non-linear regression coefficients","R-squared","Linear regression coefficients","These are 'unsafe' because outliers, for example, could lead to approximate identification and disclosure.","No, these generally seen as 'safe'.","No, these generally seen as 'safe'.","No, these generally seen as 'safe'.","No, these generally seen as 'safe'.",6.4426019878116136E-2,0.36770703635723989,9.0516605825704533E-2,0.99142921061975409,0.74322320251998997,0.41163561909631052,0.86261926698729052,0.43967741056144583,0.46868452831649798,0.72236248733133357,5,1,4,3,2,2,5,4,3,1]
[6,"According to Brandt et al (2010) which of these is a 'safe' statistic?","Mode","Frequencies","Minima and maxima","Means ","Graphs","This is 'safe' as it gives no indication of how many respondents have this value, and by construction it must have lots of observations. It is only 'unsafe' in the specific cases of all observations being the same or all observations different (in both of which cases it is meaningless).","These are 'unsafe' unless demonstrably safe in a specific instance.","These are 'unsafe' unless demonstrably safe in a specific instance.","These are 'unsafe' unless demonstrably safe in a specific instance.","These are 'unsafe' unless demonstrably safe in a specific instance.",0.5011258670771267,0.37548973996093926,0.27394328645591148,0.96663934321462464,0.77467357170303963,0.35885085867722066,0.62387163391007394,0.41486526726562778,0.29404984166190984,0.85357673424098812,4,2,3,5,1,5,2,3,1,4]
[6,"According to Brandt et al (2010) what should be the MINIMUM frequency (threshold) for statistics such as cell counts, in the absence of dataset-specific guidelines?",10,1,2,3,5,"Yes, but note that having at least ten observations by itself does not guarantee non-disclosure. Is there secondary disclosure? Is there dominance? Class disclosure etc?","A minimum of one effectively means no limits.","A minimum of two means that each of the respondents could identify the other, even if no-one else could.","Three is popular as it prevents direct re-identification with only one or two respondents; but Brandt et al argue that this too low and liable to lead to secondary disclosure by differencing."," Brandt et al argue that this too low and liable to lead to secondary disclosure by differencing. For research users, where simple statistics are mainly used to describe the data generally, higher limits (eg 10) can be imposed without restricting useful output.",0.78220825458092547,7.1318758120473613E-2,0.18894953984509677,0.91291921144848731,0.48710102779829001,0.70878998833078388,0.77228230053860281,0.48782789030005513,0.65316028462509779,0.54884445501318346,2,1,5,3,4,2,1,4,5,3]
[6,"According to Brandt et al (2010) what should be the MINIMUM degrees of freedom for 'safe' statistics?",10,1,5,"2K, where K is the number of variables","Min(100,N/10), where N is the number of observations","Brandt et al accept that this is an arbitrary definition, but for genuine research it should have no impact.","A minimum of one effectively means no limits.","Brandt et al note that for genuine research a higher value has no impact but provides an extra check on the results; however, they accept that this is an arbitrary definition.","Statistically, the degrees of freedom can be an indicator of the robustness of the results; but Brandt et al are only concerned with confidentiality and so recommend a low fixed value.","Statistically, the degrees of freedom can be an indicator of the robustness of the results; but Brandt et al are only concerned with confidentiality and so recommend a low fixed value.",0.50333132884710263,9.9255807011310759E-2,0.8793330606785702,0.59135346231892172,0.27009440214139191,0.4153554275467185,0.8926966024098465,8.2542686761217454E-2,0.85589797268875012,0.4400072244892772,4,1,5,2,3,2,4,5,1,3]
[6,"According to Brandt et al (2010, section 2.3.1) how should class disclosure be dealt with?","Limits on concentration in one cell; no limit on empty cells","No recommendation","No full cells","No empty cells","No full or empty cells","Brandt et al recommend no cell has more than 90% of the row or column total. Empty cells are not seen as a problem as lack of evidence for something cannot be taken as evidence of a lack of that thing.","Brandt et al recommend no cell has more than 90% of the row or column total. Empty cells are not seen as a problem as lack of evidence for something cannot be taken as evidence of a lack of that thing.","Brandt et al recommend no cell has more than 90% of the row or column total. Empty cells are not seen as a problem as lack of evidence for something cannot be taken as evidence of a lack of that thing.","Brandt et al recommend no cell has more than 90% of the row or column total. Empty cells are not seen as a problem as lack of evidence for something cannot be taken as evidence of a lack of that thing.","Brandt et al recommend no cell has more than 90% of the row or column total. Empty cells are not seen as a problem as lack of evidence for something cannot be taken as evidence of a lack of that thing.",{"$f":"+RAND()","v":0.23852616810699945},0.60241050204234714,0.43786202806715779,0.50782750709969371,0.82920189447097681,0.53250265485250503,0.27498942700584617,0.82403143714963767,0.87166531913679046,0.64211493121454766,4,5,2,1,3,4,3,5,1,2]
[6,"Is there usually a problem of data privacy from regression coefficients when analysing skewed data?","No, regression analysis is per se associated with low risk.","No, regression is zero risk","Yes, an outlier could attract the regression function","No general answer possible: it depends on the sensitivity of the explanatory variable(s)","No general answer possible. It depends on the sensitivity of the depending variable(s)","Yes. No output is zero risk","No. No output is zero risk, even if the risk from regression coefficients is very low.","No. An outlier can attract the regression function, but for coefficients to be disclosive one observation has to differ from the others by orders of magnitude, and all but one of the values of the variables must be known; so a genuine regression on a skewed distribution should not lead to problematic coefficients.","No. For coefficients to be disclosive one observation has to differ from the others by orders of magnitude, and all but one of the values of the variables must be known; so a genuine regression on a skewed distribution should not lead to problematic coefficients.","No. For coefficients to be disclosive one observation has to differ from the others by orders of magnitude, and the values of all the explanatory variables must be known; so a genuine regression on a skewed distribution should not lead to problematic coefficients.",0.99345757001034429,0.24912917431192805,0.42113143991020452,6.3557619817251165E-2,0.38291002348143943,0.77274892366311432,0.74176102927083243,0.5082992314538175,0.31357026601850169,0.24383958687262053,1,2,3,4,5,1,2,3,4,5]
[6,"Can regression residuals ever be published?","Yes, if they have been explicitly checked for disclosure risk","Yes, as they are products of the model","Never","Yes if there are no outliers","Only for models with no categorical variables","Yes. They are treated as any other 'unsafe' output.","No. They are individual data points, and may highlight outliers, for example.","No. They are treated as any other 'unsafe' output, and can be published if, in the specific instance, they are safe.","No. No outliers is not sufficient. What if all the residuals cluster at one point? What about residuals from non-linear models? Like any individual data points, they need to be checked.","No. They are individual data points, and may highlight outliers, for example.",0.34120619842807987,0.80531560472975894,0.66112711923009926,0.18555840746650598,0.36036478143943573,0.39602263999764864,0.79860762351401426,0.33674918362763162,0.96146101234040604,0.58132018465048563,{"$f":"+RANK(R25,$R25:$V25)","v":4},{"$f":"+RANK(S25,$R25:$V25)","v":2},{"$f":"+RANK(T25,$R25:$V25)","v":5},{"$f":"+RANK(U25,$R25:$V25)","v":1},{"$f":"+RANK(V25,$R25:$V25)","v":3},4,2,5,1,3]
[6,"Is it necessary to apply sensitivity rules to tabular data from sample surveys?","Yes, because there might be unique or dominating observations","Yes, because the rules must always be followed","No, if the sample is designed randomly with proportion less than 0.8","No. Sampling is an established anonymisation method producing safe data any case.","We don’t know.  ","Yes. For example, when looking at small geographical areas there might be easily identified outliers; business might dominate their industries; or rare health events might be linked to other data","Not quite. Yes, follow the rules, but it's more important you understand WHY they are there. A table is an 'unsafe statistic' meaning you need to confirm that a particular instance is safe, rather than assuming it.","No. Sampling doesn't guarantee non-disclosiveness, although it does lower the risk.","No. Sampling doesn't guarantee non-disclosiveness, although it does lower the risk.","Incorrect. We do know we should check all tables whether sampled or not. It is likely that the sampled table is safe, but you still need to show that, in this particular instance, it is safe.",0.82015200320225479,0.88169102686290945,0.68863723871750937,0.47788342585070387,0.91186008689152986,0.88159632146977551,0.95066265390325555,0.73252837102850821,0.2824393723814318,0.45670273317594978,2,1,3,5,4,2,1,3,5,4]
[6,"The mean annual earnings of 12 individuals in a village is €315,000. The largest earner is a footballer on €3.5m per year. Given a minimum frequency of 10 and an (n, k) dominance rules of (1, 90), is mean or total earnings publishable according to the rules?","No, it fails one of the rules","Yes, it passes all the rules","Yes, it passes at least one of the rules","No it fails all the rules","The total can't, but the mean can be","Correct: it has sufficient observations but fails the dominance rule","Incorrect: it has sufficient observations but fails the dominance rule","No: it should pass all the rules, and it fails the dominance rule","Incorrect: it fails the dominance rule, but does  sufficient observations; however, it should pass all the rules for publication","No: it has sufficient observations but fails the dominance rule, and so can't be published either as a mean or total (one is a linear transformation of the other)",0.1026062281225093,0.78607017789389766,0.63288828312044143,0.14931641099090298,0.69373710910736619,0.15534089344537561,0.68676933576095855,0.87857640404420601,0.21434850491929058,0.85211850496439612,5,3,1,4,2,3,5,2,4,1]
[6,"My colleague told me, that graphs are always safe. Is he right?","No. These are always risky by default and should always be checked. ","It depends on the graph type. For instance a bar chart is always safe. ","Only boxplots are unsafe.","Yes","You are not allowed to make graphs based on official data.","Correct. Graphs should be considered as if they were tables, but presented in a different format. Hence, you should apply the same rule to each point on a graph or image as if it was a cell in a table. They can be safe in specific circumstances, but need checking.","Not quite. Whether any  type of graph  can be published depends on the data, and so it must be checked; in general, graphs cannot be published until shown to be safe (they are tables in a different format).","No. All graphs should be considered as if they were tables, but presented in a different format. Hence, you should apply the same rule to each point on a graph or image as if it was a cell in a table.","No. Graphs should be considered as if they were tables, but presented in a different format. Hence, you should apply the same rule to each point on a graph or image as if it was a cell in a table.","No, all outputs are allowed as long as they do not breach confidentiality.  Graphs should be considered as if they were tables, but presented in a different format. Hence, you should apply the same rule to each point on a graph or image as if it was a cell in a table.",0.49842584708417281,0.63193481941582408,0.62081358421627875,0.82498860291283072,0.33714323849580163,0.93646896569366544,0.60054346797101754,0.62722386611250891,0.22646176495835824,0.66071850171909297,1,4,3,5,2,1,5,3,2,4]
[6,"What is secondary suppression?","To suppress additional cells to prevent disclosure by calculating the difference of the totals and the remaining non-suppressed cells.","Secondary suppression is suppressing more than one cell","Suppression that is done by the data user.","Secondary suppression is another term for combining categories","Secondary suppression is another term for rounding.","Yes. Secondary suppression is designed to reduce the risk of confidentiality breach, although it cannot guarantee it.","No. Secondary suppression is about suppression of additional cells to prevent disclosure by calculating the difference of the totals and the remaining non-suppressed cells.","No. Secondary suppression is about suppression of additional cells to prevent disclosure by calculating the difference of the totals and the remaining non-suppressed cells.","No. Secondary suppression is about suppression of additional cells to prevent disclosure by calculating the difference of the totals and the remaining non-suppressed cells.","No. Secondary suppression is about suppression of additional cells to prevent disclosure by calculating the difference of the totals and the remaining non-suppressed cells.",8.7821557862170274E-2,0.54300479715447691,0.25909833352844414,0.90525153893724564,0.2628273466019958,0.65010968553036852,1.7098890676261469E-2,0.65935479170157796,0.32532875844432485,0.31888647254771307,2,5,1,3,4,3,1,4,5,2]
[7,"What is NOT a key message to take away from this training?","Application of Statistical Disclosure Control guarantees that data are safe to be published","Following Statistical Disclosure Control rules makes results of research safer","We're all in this together","Data protection has several dimensions: the Five Safes","We all make mistakes","True, Statistical Disclosure Control guidelines might prevent some confidentiality breaches, but cannot prevent all. We all make mistakes and data protection is a complex issue; it has several dimensions: the Five Safes.","This IS one of key messages from this training: Statistical Disclosure Control rules will help you to prevent some obvious mistakes.","This IS one of key messages from this training: confidentiality breaches will probably lead to in more restrictions and a more burdensome administrative procedure.","This IS one of key messages from this training: data protection is not limited to the disclosure risks in the final output.","This IS one of key messages from this training: we all make mistakes; your professionalism is shown by the way you deal with them: correct and report if necessary.",0.67550436258221436,7.4342498084661202E-2,0.29394110666590123,0.95584628313459585,0.20941679448696315,0.28978154491900476,0.66509706107966637,3.0842860913536052E-2,0.40006380263874586,0.48031079218409267,4,1,5,3,2,2,5,4,1,3]