Evaluating Filter Questions Used for the Participation Activity

Evaluating Filter Questions Used for the Participation & Activity Limitation Survey David Lawrence Questionnaire Design Resource Centre Statistics Canada QUEST 2007

Overview ¡ PALS background ¡ Rationale for study ¡ Population of interest ¡ Findings & Observations ¡ What now

PALS Background ¡ National post-censal survey ¡ Target: Canadian adults & children whose everyday activities may be limited due to a health-related condition or problem ¡ Conducted 4 times: 1986, 1991, 2001 & 2006 ¡ Census filter questions used to create a sampling frame.

Rationale for Study ¡ On-going initiative to improve efficiencies in the collection of social statistical data ¡ Review of many social concepts towards harmonizing various questions included on social surveys. ¡ Activity limitation questions are a part of this review. ¡ Evaluate the performance of the filter questions

Population of Interest Two specific areas of interest: ¡ ‘False positive’ respondents ¡ Respondents having ‘soft’ conditions.

Methodology ¡ 57 cognitive interviews with PALS respondents ¡ Interviews conducted at focus group facilities ¡ Four test sites ¡ Participants: - False positive adults - False positive children - Adult respondents having a ‘soft’ condition - Child respondents having a ‘soft’ condition

Specific Objectives Explore: ¡ comprehension of filter questions question intent meaning of terms ¡ reporting issues related to “soft” conditions ¡ potential structural problems with questions

Census Filter Question Do you have any difficulty hearing, seeing, communicating, walking, climbing stairs, bending, learning or doing any similar activities? О Yes, sometimes О О Yes, often No

Canadian Community Health Survey The next few questions deal with any current limitations in your daily activities caused by a long-term health condition or problem. In these questions a long-term condition refers to a condition that is expected to last or has already lasted 6 months or more. Do you have any difficulty hearing, seeing, communicating, walking, climbing stairs, bending, learning or doing any similar activities? О Yes, sometimes О Yes, often О No

Activity Reduction Questions Does a physical condition or mental condition or health problem reduce the amount or kind of activity you can do: . . . … … at home? at work or school? in other activities for example, transportation or leisure? Yes, sometimes Yes, often No

Findings & Observations ¡ Question context ¡ Question location ¡ Terminology ¡ Mode ¡ Proxy vs. non-proxy response

What Now? ¡ ‘No’ sample (False negatives) … May 2007 ¡ Further evaluation … quantitative study? ¡ Address issues pertaining to harmonization …