Qualtrics for data collection Nathan R Jones Ph

Qualtrics for data collection Nathan R. Jones, Ph. D Senior Project Director University of Wisconsin Survey Center nrjones@ssc. wisc. edu University of Wisconsin Survey Center

Goals of the Course Day 1 • Overview of survey research concepts, principles, and terminology • Qualtrics orientation to introduce workflow from questionnaire design to final data University of Wisconsin Survey Center

Goals of the Course Day 2 – Apr 14, 2 -4 p • General tips for questionnaire design • Orientation to Qualtrics tools for writing and formatting survey questions University of Wisconsin Survey Center

Goals of the Course Day 3 – Apr 19, 10 a-12 p • Advice on fielding and managing surveys • Qualtrics tools for launching surveys and keeping track of sample members University of Wisconsin Survey Center

Why do you want to do a survey? University of Wisconsin Survey Center

So, we’re doing surveys… • Principal parts of a survey Mode Instrument Respondents University of Wisconsin Survey Center

Examples • Typical Qualtrics links look like this: https: //uwmadison. co 1. qualtrics. com/SE/? SID=SV_6 Mu. ZXpp. PN 92 uci 9 https: //uwmadison. qualtrics. com/SE/? Q_SS=26 a 4 u. Qdai. Uswgjr_9 Zv. Zae 9 DCmf 8 ost&_=1 • Follow along! http: //bit. ly/1 ZSwk 6 J University of Wisconsin Survey Center

What is a GOOD survey? University of Wisconsin Survey Center

What is a GOOD questionnaire? • Achieve your study goals • Collect the data you need to answer your question(s) • Allow sufficiently complex analysis • Do not reinvent the wheel • Great questions, indices, tools already exist • Plan for external comparison unless you have a great reason to innovate • Low burden • Ask questions that are easy to answer • Do not waste time University of Wisconsin Survey Center

Why do a survey? • To describe a population • Census • Probability sample • Standardized interview schedule • To test for changes or effects • Case-control studies • Clinical trials • May use multiple modes University of Wisconsin Survey Center

Probability sample Why can’t we just talk to people? University of Wisconsin Survey Center

Probability sample • Identify the population of interest. • Obtain a list of members of the population. (This list is called the sample frame) • Select units so that all units have a known probability of selection that is greater than 0. University of Wisconsin Survey Center

Principal parts of a survey • • • Study Design Sample Design Mode of administration Instrument development Pretesting, IRB Data collection Data preparation - weighting, processing, delivery Documentation Analysis Budget University of Wisconsin Survey Center

A Survey From a Process Perspective (Groves et al. 2004) University of Wisconsin Survey Center

Other than surveys…. ? With some creativity, Qualtrics can be used for other purposes. • • data entry training quality control evaluation market research pre/post-event feedback and other uses with some creativity University of Wisconsin Survey Center

Other than surveys…. ? With some creativity, Qualtrics can be used for other purposes. • data entry University of Wisconsin Survey Center

Other than surveys…. ? With some creativity, Qualtrics can be used for other purposes. • data entry Never / Sometimes / Often / Always University of Wisconsin Survey Center

Respondent interaction • How many times will you collect data? • Once • Cross-sectional • Sample population at single point in time • Many times • Trend – Repeated cross-sections • Cohort – Follow a group over time • Panel – Follow several groups over time University of Wisconsin Survey Center

Pre-Testing, IRB • • • Develop standardized questions Pre-test candidate questions Test entire instrument Obtain permission to conduct survey Keep records and documentation! University of Wisconsin Survey Center

Field Procedures • • Initial contact and obtaining cooperation Incentives Training interviewers Follow-up procedures after survey Supervision and reporting Re-contacting methods for longitudinal studies Procedures for protecting respondents University of Wisconsin Survey Center

And finally… You can use your data! • But do not forget final documentation • Sampling procedures, special cases • Instrument bugs • Field procedures, decisions, and materials • Coding, decisions, and special cases • Data cleaning • Weighting University of Wisconsin Survey Center

Qualtrics workflow • • • Create survey Draft and revise instrument Activate survey Upload contact information Draft survey invitations Send initial email Check progress Draft reminder emails Send reminder emails Download data and summary reports University of Wisconsin Survey Center

Qualtrics interface University of Wisconsin Survey Center

Switch to Qualtrics University of Wisconsin Survey Center

A Survey From a Process Perspective (Groves et al. 2004) University of Wisconsin Survey Center

Questions? University of Wisconsin Survey Center

Thank you! Nathan R. Jones Senior Project Director University of Wisconsin Survey Center nrjones@ssc. wisc. edu University of Wisconsin Survey Center