Instrument for Participant Communication Chapter 12 Instrument Development

Instrument for Participant Communication Chapter 12

Instrument Development Process • Phase 1: Developing the instrument design strategy • Phase 2: Constructing and refining the measurement questions • Phase 3: Drafting and refining the instrument

Flowchart for Instrument Design Investigative Questions Prepare Preliminary Analysis Plan Measurement Questions Pretest individual Questions Instrument Design Pretest Individual Questions Instrument Ready for Data Collection

Data Hierarchy • Management Question – The dilemma, stated in question form, that the manager needs resolved • Research Question – The fact-based translation of the question the researcher must answer to contribute to the solution of the management question • Investigative Question – Specific questions the researcher must answer to provide sufficient detail and coverage of the research question – There may be several questions as the researcher moves from the general to the specific • Measurement Question – Questions participants must answer if the researcher is to gather the needed information and resolve the management question

Strategic Concern • What type of data is needed to answer the management question? • What communication approach will be used? • Should the question be structured, unstructured or some combination? • Should the question be undisguised or disguised? If the latter, to what degree?

Data Collection • • Type of data Communication approach Question structure Disguising objectives and sponsors

Ways to Interact with the Participant • • Personal interview Telephone Mail Computer

Types of Measurement Questions? • Target • Classification • Administrative

Appropriate Question Content • Should this question be asked? • Is the question of proper scope and coverage? • Can the participant adequately answer this question, as asked? • Will the participant willingly answer this question, as asked?

How to Test a Respondent’s Appropriateness • Filter questions • Screen questions

Question Wording Criteria • Is the question stated in terms of a shared vocabulary? • Does the question contain vocabulary with a single meaning? • Does the question contain unsupported assumptions? • Is the question correctly personalized? • Are adequate alternatives presented within the question?

What Dictates Your Response Strategy? • • Characteristics of participants Nature of the topic(s) being studied Type of data needed Your analysis plan

Types of Response Questions • • • Free-response Dichotomous Multiple-choice Checklist Rating Ranking

Guidelines to Refining the Instrument • Awaken the participant's interest • Use buffer questions as a guide to request sensitive information • Use the funnel approach to move to more specific questions

Improving Survey Results • Pretesting is an established practice for discovering errors and useful for training the research team