10 Questionnaires and Instruments mailto ckfarnmgt ncu edu

  • Slides: 34
Download presentation
10 Questionnaires and Instruments 量表設計 中央大學. 資訊管理系 范錚強 mailto: ckfarn@mgt. ncu. edu. tw 2012.

10 Questionnaires and Instruments 量表設計 中央大學. 資訊管理系 范錚強 mailto: ckfarn@mgt. ncu. edu. tw 2012. 05 updated 中央資管:范錚強 1

Learning Objectives Understand. . . The link forged between the management dilemma and the

Learning Objectives Understand. . . The link forged between the management dilemma and the communication instrument by the management-research question hierarchy. The influence of the communication method on instrument design. The three general classes of information and what each contributes to the instrument. 中央資管:范錚強 2

Learning Objectives Understand. . . The influence of question content, question wording, response strategy,

Learning Objectives Understand. . . The influence of question content, question wording, response strategy, and preliminary analysis planning on question construction. Each of the numerous question design issues influencing instrument quality, reliability, and validity. The sources for measurement questions The importance of pretesting questions and instruments. 中央資管:范錚強 3

Overall Flowchart for Instrument Design 中央資管:范錚強 Instrument Ready for Data Collection 4

Overall Flowchart for Instrument Design 中央資管:范錚強 Instrument Ready for Data Collection 4

Flowchart for Instrument Design Phase 1 中央資管:范錚強 5

Flowchart for Instrument Design Phase 1 中央資管:范錚強 5

Strategic Concerns in Instrument Design What type of scale is needed? What communication approach

Strategic Concerns in Instrument Design What type of scale is needed? What communication approach will be used? Should the questions be structured? Should the questioning be disguised? 中央資管:范錚強 6

Technology Affects Questionnaire Development Write questionnaires more quickly Create visually driven instruments Eliminate manual

Technology Affects Questionnaire Development Write questionnaires more quickly Create visually driven instruments Eliminate manual data entry Save time in data analysis Web. Surveyor used to write an instrument. 中央資管:范錚強 7

Disguising Study Objectives Reluctantly shared, Conscious-level information Willingly shared, Conscious-level information Situations where disguise

Disguising Study Objectives Reluctantly shared, Conscious-level information Willingly shared, Conscious-level information Situations where disguise is unnecessary Knowable, Limited-conscious-level information Subconscious-level information 中央資管:范錚強 8

Dummy Table for American Eating Habits Use of Convenience Foods Age Always Use Frequently

Dummy Table for American Eating Habits Use of Convenience Foods Age Always Use Frequently Use Sometimes Rarely Use Never Use 18 -24 25 -34 35 -44 55 -64 65+ 中央資管:范錚強 9

Flowchart for Instrument Design Phase 2 中央資管:范錚強 10

Flowchart for Instrument Design Phase 2 中央資管:范錚強 10

Question Categories and Structure Administrative Classification Target 中央資管:范錚強 11

Question Categories and Structure Administrative Classification Target 中央資管:范錚強 11

Question Content Should this question be asked? Is the question of proper scope and

Question Content Should this question be asked? Is the question of proper scope and coverage? Can the participant adequately answer this question as asked? Will the participant willingly answer this question as asked? 中央資管:范錚強 12

Question Wording Adequate alternatives Shared vocabulary Criteria Personalized Single meaning Misleading assumptions Biased 中央資管:范錚強

Question Wording Adequate alternatives Shared vocabulary Criteria Personalized Single meaning Misleading assumptions Biased 中央資管:范錚強 13

Response Strategy Objectives of the study Participant’s motivation to share Factors Ease and clarity

Response Strategy Objectives of the study Participant’s motivation to share Factors Ease and clarity with which participant communicates Participant’s level of information Degree to which participants have thought through topic 中央資管:范錚強 14

Free-Response Strategy What factors influenced your enrollment in Metro U? ____________________________________________ 中央資管:范錚強 15

Free-Response Strategy What factors influenced your enrollment in Metro U? ____________________________________________ 中央資管:范錚強 15

Dichotomous Response Strategy Did you attend the “A Day at College” program at Metro

Dichotomous Response Strategy Did you attend the “A Day at College” program at Metro U? Yes No 中央資管:范錚強 16

Multiple Choice Response Strategy Which one of the following factors was most influential in

Multiple Choice Response Strategy Which one of the following factors was most influential in your decision to attend Metro U? Good academic standing Specific program of study desired Enjoyable campus life Many friends from home High quality of faculty 中央資管:范錚強 17

Checklist Response Strategy Which of the following factors influenced your decision to enroll in

Checklist Response Strategy Which of the following factors influenced your decision to enroll in Metro U? (Check all that apply. ) Tuition cost Specific program of study desired Parents’ preferences Opinion of brother or sister Many friends from home attend High quality of faculty 中央資管:范錚強 18

Rating Response Strategy Strongly influential Somewhat influential Not at all influential Good academic reputation

Rating Response Strategy Strongly influential Somewhat influential Not at all influential Good academic reputation Enjoyable campus life Many friends High quality faculty Semester calendar 中央資管:范錚強 19

Ranking Please rank-order your top three factors from the following list based on their

Ranking Please rank-order your top three factors from the following list based on their influence in encouraging you to apply to Metro U. Use 1 to indicate the most encouraging factor, 2 the next most encouraging factor, etc. _____ Opportunity to play collegiate sports _____ Closeness to home _____ Enjoyable campus life _____ Good academic reputation _____ High quality of faculty 中央資管:范錚強 20

Summary of Scale Types Type Restrictions Scale Items Scale points Data Type Rating Scales

Summary of Scale Types Type Restrictions Scale Items Scale points Data Type Rating Scales Simple Category Scale Needs mutually exclusive choices One or more 2 Nominal Multiple Choice Single-Response Scale Needs mutually exclusive choices; may use exhaustive list or ‘other’ many 2 Nominal Multiple Choice Multiple-Response Scale (checklist) Needs mutually exclusive choices; needs exhaustive list or ‘other’ many 2 Nominal Likert Scale Needs definitive positive or negative statements with which to agree/disagree One or more 5 Ordinal Likert-type Scale Needs definitive positive or negative statements with which to agree/disagree One or more 7 or 9 Ordinal 中央資管:范錚強 21

Type Summary of Scale Types Restrictions Scale Items Scale points Semantic Differential Scale Needs

Type Summary of Scale Types Restrictions Scale Items Scale points Semantic Differential Scale Needs words that are opposites to anchor the graphic space. One or more 7 Numerical Scale Needs concepts with standardized or One or defined meanings; needs numbers anchor many the end-points or points along the scale; score is a measurement of graphical space from one anchor. 3 -10 Ordinal or Interval Multiple Rating List Scale Needs words that are opposites to anchor the end-points on the verbal scale Up to 10 5 -7 Ordinal Fixed Sum Scale Participant needs ability to calculate total to some fixed number, often 100. Two or more none Interval or Ratio Stapel Scale Needs verbal labels that are operationally defined or standard. One or more 10 Ordinal or Interval Graphic Rating Scale Needs visual images that can be One or interpreted as positive or negative more anchors; score is a measurement of 中央資管:范錚強 graphical space from one anchor. none Data Type Ordinal (Interval, or Ratio) 22

Summary of Scale Types Type Restrictions Scale Items Scale points Data Type Ranking Scales

Summary of Scale Types Type Restrictions Scale Items Scale points Data Type Ranking Scales Paired Comparison Scale Number is controlled by participant’s stamina and interest. Up to 10 2 Forced Ranking Scale Needs mutually exclusive choices. Up to 10 many Comparative Scale Can use verbal or graphical scale. Up to 10 中央資管:范錚強 Ordinal or Interval Ordinal 23

Internet Survey Scale Options 中央資管:范錚強 24

Internet Survey Scale Options 中央資管:范錚強 24

Internet Survey Scale Options 中央資管:范錚強 25

Internet Survey Scale Options 中央資管:范錚強 25

Internet Survey Scale Options 中央資管:范錚強 26

Internet Survey Scale Options 中央資管:范錚強 26

Sources of Questions Handbook of Marketing Scales The Gallup Poll Cumulative Index Measures of

Sources of Questions Handbook of Marketing Scales The Gallup Poll Cumulative Index Measures of Personality and Social-Psychological Attitudes Measures of Political Attitudes 中央資管:范錚強 Index to International Public Opinion Sourcebook of Harris National Surveys Marketing Scales Handbook American Social Attitudes Data Sourcebook 27

Flowchart for Instrument Design: Phase 3 Instrument Ready for Data Collection 中央資管:范錚強 28

Flowchart for Instrument Design: Phase 3 Instrument Ready for Data Collection 中央資管:范錚強 28

Branching Question 中央資管:范錚強 29

Branching Question 中央資管:范錚強 29

Components of Questionnaires 中央資管:范錚強 30

Components of Questionnaires 中央資管:范錚強 30

Overcoming Instrument Problems Build rapport Redesign question process Explore alternatives Use other methods Pretest

Overcoming Instrument Problems Build rapport Redesign question process Explore alternatives Use other methods Pretest 中央資管:范錚強 33