CostEfficient Framework for Data Collection for CATI Surveys

Cost-Efficient Framework for Data Collection for CATI Surveys Social Surveys Collection Research Steering Committee (SSCRSC) François Laflamme December 2010 Statistics Canada • Statistique Canada

Past and current research q Paradata research has mainly directed its effort in improving the current data collection process and practices q Paradata research has also suggested that the interviewer staffing levels are not always optimally allocated with respect to the workload sample and the expected productivity 2 Statistics Canada • Statistique Canada 2021 -09 -14

Challenges and objective q One of the main challenges is to collect cost-effective data while maintaining a high level of quality t According to the forecasted budget reductions, the pressure has increased and will continue to grow q The objective of the project is to propose a costefficient framework for data collection for CATI surveys 3 Statistics Canada • Statistique Canada 2021 -09 -14

Cost-efficient framework Five 5 dimensions: 1. Metrics used for costing and budgeting surveys 2. Resources allocation within surveys 3. Resources allocation between surveys 4. Collection process and practices 5. Operational constraints 4 Statistics Canada • Statistique Canada 2021 -09 -14

1. Metrics used for costing and budgeting surveys q Should be based on objective, measurable and comprehensible assumptions q Should be monitored throughout the survey collection t Budget too high - low productivity t Budget too low - more difficult to reach targets q Budget often based on previous survey cycles or comparable surveys t But it is exactly what we try to improve (e. g. low TPU) 5 Statistics Canada • Statistique Canada 2021 -09 -14

2 & 3. Resources allocation within and between surveys q Within survey t Interviewer staffing levels should consider sample workload and collection progress in taking advantage of the entire collection period ● Survey productivity decreases for all CATI surveys during collection q Between surveys t Many concurrent surveys compete for data collection resources 6 Statistics Canada • Statistique Canada 2021 -09 -14

Resources allocation within and between surveys q What is the best strategy within survey? 7 Statistics Canada • Statistique Canada 2021 -09 -14

Resources allocation within and between surveys q The main idea is to try to maintain the survey productivity for all surveys for a given RO (red line) between reasonable boundaries around the average productivity q How? 8 Statistics Canada • Statistique Canada 2021 -09 -14

Resources allocation within and between surveys q The strategy is to distribute system time for a given period (day or week) in function of the inverse of the proportion of the budget spent (inversely correlated to productivity) to maintain productivity at RO level 9 Statistics Canada • Statistique Canada 2021 -09 -14

Resources allocation within and between surveys q In practice t Need to get consistent budget figures for all surveys t Need to get daily or weekly capacity system time t Need to consider the active collection period of each survey t Need to take into account operational constraints t Is it feasible? Can it be operationalized and automated? q The objective is to produce guidelines for RO to help them allocate collection resources only at the aggregate level. 10 Statistics Canada • Statistique Canada 2021 -09 -14

4. Collection process and practices q Focus of the past research q Some examples t Best time to call t Call scheduler features ● Cap on calls, customized time slices, Z-groups etc… t Increased the proportion of evening shifts versus day shifts to improve contact rate and productivity t Active management t Responsive collection design q No significant efficiency if budget and resources allocation remain the same. 11 Statistics Canada • Statistique Canada 2021 -09 -14

5. Operational constraints q RO capacity t Varies by day (interviewer availability) t LFS week t Holidays and special event q Average productivity t Varies by RO and survey q Interviewer schedule in advance q Interviewer training across surveys q Etc… 12 Statistics Canada • Statistique Canada 2021 -09 -14

Comments q 3 Separate projects t Costing metrics t Resources allocation within and between surveys t Collection process and practices Ø All need to take into account operational constraints q All dimensions have to be considered simultaneously to succeed in improving the costefficiency of data collection. 13 Statistics Canada • Statistique Canada 2021 -09 -14

For more information, please contact Pour plus d’information, veuillez contacter François Laflamme francois. laflamme@statcan. gc. ca 14 Statistics Canada • Statistique Canada 2021 -09 -14