Katrin Baumgartner Beatrix Wiedenhofer Galik Statistics Austria Budapest

Katrin Baumgartner Beatrix Wiedenhofer. Galik Statistics Austria Budapest, Hungary 16 -17 May 2019 www. statistik. at Cognitive Testing of Model Questionnaire on Working Time We provide information

Cognitive Tests of working time questions 1. Sampling and recruitment 2. Interview guideline 3. Cognitive interviewing 4. Analysis 5. Main results 6. Recommendations www. statistik. at slide 2 | 09 September 2020

1. Sampling and recruitment Key characteristics of respondents: Ø professional status Ø full-time, part-time job Ø overtime hours Ø shift work Ø second job Ø age, sex Sample: last wave of core LFS (5 th interview) www. statistik. at slide 3 | 09 September 2020

2. Interview guideline 1. Step: Translation of model questions and development of national questionnaire 2. Step: Various probes after each question Ø Mainly general probes : „How easy or difficult was this answer? “ „Why? “ Ø Special comprehension probes : „What do you mean by a written contract? “ Ø Paraphrasing : „Can you tell me in your own words what we want to know? “ Ø Recall probes : „How did you remember? “ Ø „Going-back“ probes : finally return to some questions www. statistik. at slide 4 | 09 September 2020

3. Cognitive Interviewing Ø Field work: 15 cognitive interviews, June to September 2017 Ø Duration: on average 40 minutes per interview Ø Participants: 2 persons from LFS team, 1 respondent Ø Audio tapes: interviews were recorded Ø Reference week : similar distribution to core LFS (incl. public holidays) Ø First wave: 10 interviews with first version Ø Second wave: 5 interviews after revision of some questions www. statistik. at slide 5 | 09 September 2020

4. Analysis Observation protocols: immediately after cognitive interviews, included hard facts of the interview, given answers, first impression, also information from core LFS. Main problems were revealed. Transcriptions of the tape recordings: outsourced. Phases of analysis: 1. Paraphrasing 2. Generalizing and evaluation 3. Reducing the information 4. Comprehensive summary www. statistik. at slide 6 | 09 September 2020

4. Analysis Phase 1: Template for paraphrasing of answers Answer or General Further Answer to Spontaneous reaction on answer or answers or question reaction how to get to comprehenreactions the answer sion. . . Phase 2: Template for generalizing and evaluation Answer to question Correct or false Difficulty Evaluation General comprehension . . . . www. statistik. at slide 7 | 09 September 2020

5. Main Results – CUT_4 (HWUSUAL) CUT_4 is a new question under IESS Framework Regulation, located after contractual hours (also new), Target group: Employees with contractual hours (CONTRHRS) Question CUT_4: Do you usually work the contractually determined XX hours per week? Yes? No? If verbal agreement (in AT CUT_1 split): Do you usually work the agreed XX hours per week? Yes? No? number is shown Only if no: Question on usual hours www. statistik. at slide 8 | 09 September 2020

5. Main Results – CUT_4 (HWUSUAL) Ø 9 persons received question CUT_4 in test wave 1, Ø 7 indicated “YES”, contractual hours are usually worked, Ø Usual hours of cognitive interviews tended to be lower 50 43. 0 45 40 Cognitive Interviews 40. 0 38. 5 32. 0 35 Core LFS 30 30. 0 45. 0 40. 0 38. 0 32. 0 25 20 15 12. 0 10 5 0 1 www. statistik. at 2 3 4 5 6 7 slide 9 | 09 September 2020

5. Main Results – CUT_4 (HWUSUAL) 1 st test wave, N=10 (9 employees, 1 self-employed): Ø 7 (9): “YES”, but deviations related to usual hours to Core LFS Ø 2 (9): “NO”, both respondents rated question as difficult. o 1 (9): “NO”, usual hours asked afterwards (CUT_5). Same number indicated as related to contractual hours. o 1 (9): couldn’t decide if “YES” or “NO”, CUT_5 was asked. 2 nd test wave, N=5 (4 employees): Ø Respondents had to indicate usual hours directly (CUT_5). Less problems could be observed. Ø Proposal to delete CUT_4, also because it seems to be suggestive. www. statistik. at slide 10 | 09 September 2020

5. Main Results – CUT_7 (DWUSUAL) DWUSUAL was an optional variable, not included in future LFS. Question DWUSUAL: On how many days do you work usually? Ø Helpful during cognitive interviews, respondents reported on working hours of individual weekdays. Ø Difficult for persons with shift work (one respondent had three weeks with five days per week and one week with four days). Ø Overlapping days in case of shift work caused problems. Ø Varying working time (e. g. sometimes working on the weekend) difficult. Ø Proposal not to include DWUSUAL in regular LFS, also due to complex data processing. www. statistik. at slide 11 | 09 September 2020

5. Main Results – ABSHOLID: One of three new variables on absences under IESS, The following questions refer to the week from Monday. . to Sunday. . We are interested in those days, on which you normally work, but had a day off for a certain reason. Did you have at least half a working day off this week for holidays, compensatory leave or public holidays? Public holiday was on Monday, 22. 5. Yes? No? How many working days did you have off? Ø Question wording of 2 nd test wave adapted: it was pointed out, that only those days have to be indicated, on which the respondent normally works. Ø „Half day“: interpreted according to individual working time. www. statistik. at slide 12 | 09 September 2020

5. Main Results – EXRTAHRS EXTRAHRS: New variable under IESS on additional hours, EXT_1 a (employees with contractual hours): Have you worked more than XX hours this week? Yes? No? EXT_2: How many extra hours have you worked this week? If no contractual hours (self-employed, few employees): number of usual instead of contractual hours shown in question. Ø 11(15) rated the question as easy. Ø 2(15): difficult to remember the reference week; 2(15): first answer corrected later (probes, actual hours). Ø Good experiences with this short question (and hours shown) www. statistik. at slide 13 | 09 September 2020

6. Recommendations Ø CUT_4: We propose to delete it and to ask HWUSUAL directly; CUT_4 has an impact on the results regarding usual hours; should be asked in same way by all NSIs. Ø EXTRAHRS: We suggest to shorten wording of model question EXT_1 a and to show the indicated number of contractual (EXT_1 a) or usual (EXT_1 b) hours in the question. Ø HWUSUAL, HWACTUAL: Most important questions on working time, national questions should correspond to the model questions (CUT_5, ACT_1), e. g. not including overtime and main meal breaks in the question. www. statistik. at slide 14 | 09 September 2020

Please address queries to: Katrin Baumgartner Beatrix Wiedenhofer-Galik Contact information: Guglgasse 13, 1110 Vienna phone: +43 (1) 71128 -7211 phone: +43 (1) 71128 -8287 katrin. baumgartner@statistik. gv. at beatrix. wiedenhofer-galik@statistik. gv. at www. statistik. at Thank you! slide 15 | 09 September 2020