Bringing it all together Lecture 11 Becoming a

Bringing it all together Lecture 11: Becoming a Research: Using Data Dr Suzanna Forwood Suzanna. Forwood@Anglia. ac. uk 2/24/2021 Becoming a Researcher: Using Data 1

Summary • MES feedback • Module recap • Using data: the professionals Box 4 • Coding questionnaires • What happens next 2/24/2021 Becoming a Researcher: Using Data 2

MEQ feedback 2/24/2021 Becoming a Researcher: Using Data 3

MEQ responses • Thankyou for all your comments and feedback. • 41 of 176 students completed the forms. Overall satisfaction Things you like and we will keep next year Things you didn’t like and improvements for next year 2/24/2021 Becoming a Researcher: Using Data 4

MEQ responses • Things I can’t change (sorry) • The module has to be compulsory – teaching this content is a BPS accreditation requirement • You need to learn stats and how to write-up data in a research report to be able to complete next years modules and your final year project. • If you fail this module (<30 in one element and/or <40 overall) • You will need to resit the elements you fail in the summer. • Support will be available from me and on Canvas. 2/24/2021 Becoming a Researcher: Using Data 5

Feedback What you liked What to improve • Lecturer • Relevance to course • Practicals • MCQs during trimester • Poll. Everywhere • Not purely maths • Too much per lecture • More SPSS • More revision/ selfstudy/ interactive learning • Change Assessment vs FCP • BODMAS teaching 2/24/2021 Becoming a Researcher: Using Data 6

Feedback • Changes for next year • New module “Becoming a Researcher” • New module “Mind and Behaviour” • Edit lectures – less content per lecture. • More independent learning activities • More SPSS/ Excel /JASP activities 2/24/2021 Becoming a Researcher: Using Data 7

Module overview and recap 2/24/2021 Becoming a Researcher: Using Data 8

Module Objectives This module will teach you how to write the results section of a research report. This means: • identify and described an experimental design ** • summarise numerical data • choose which statistical test to use ** • conduct statistical tests using appropriate software ** • reach a conclusion and report your conclusion ** More options will be covered in 2 nd year 2/24/2021 Becoming a Researcher: Using Data 9

Week 1: Why do we need stats? Research Question / Hypothesis Design (IV and DV) 1. Select the right statistical test 2. Report the statistical score and probability 3. Evaluate the hypothesis 2/24/2021 Becoming a Researcher: Using Data 10

What do Psychologists need statistics for anyway? • Describing what was measured in numbers, tables or graphs • Choose a test based on IVs and DV. • State whether the differences and correlations in our data are reliable • Evaluate hypothesis 2/24/2021 • We need to communicate the data • We want to know whether one variable alters or is associated with another variable • We need to reach a conclusion about our hypotheses Becoming a Researcher: Using Data 11

What do Psychologists need statistics for anyway? • Describing what was measured in numbers, tables or graphs • Choose a test based on IVs and DV. • State whether the differences and correlations in our data are reliable • Evaluate hypothesis 2/24/2021 Becoming a Researcher: Using Data This is a research report results section 12

Psychology report writing guide https: //canvas. anglia. ac. uk/courses/3403/files/238394? module_item_id=117658 2/24/2021 Becoming a Researcher: Using Data 13

Week 4 • Structure of a research report • Research question, design, selecting stats test. • Using probability to reach a conclusion 2/24/2021 Becoming a Researcher: Using Data 14

Skills needed for Research Report • Formulate a research question • Describe the experiment design • Select a statistical test • Summarising the data • Conducting and reporting the test • Reach a conclusion from the test 2/24/2021 Becoming a Researcher: Using Data 15

Week 5 -6: T-tests • Comparing two group means • IV: categorical • Within subjects related or paired t-tests • Between subjects unrelated or independent t-tests • DV: continuous 2/24/2021 Becoming a Researcher: Using Data 16

Which parametric test to use? How many IVs? subject? IV type? If categorical, Is the IV between-subject how many levels? Pearson correlation or regression Continuous (Same or different people in One each group? ) Two Categorical More than two Within (Same) Related t-test Between (Different) Unrelated t-test Within (Same) Single factor repeatedmeasures ANOVA Between (Different) Single factor betweensubjects ANOVA Multiple Regression Continuous Two or more Parametric test or within- Categorical Within (Same) Two-factor repeatedmeasures ANOVA Between (Different) Two-factor betweensubjects ANOVA Both Mixed factor ANOVA Multiple regression/ ANCOVA Both Decision tree: excerpt from Andy Field’s “Discovering Statistics” books - back page. 2/24/2021 Becoming a Researcher: Using Data 17

Week 7: correlation • Relationship between two variables • IV: continuous • DV: continuous 2/24/2021 Becoming a Researcher: Using Data 18

Which parametric test to use? How many IVs? subject? IV type? If categorical, Is the IV between-subject how many levels? Pearson correlation or regression Continuous (Same or different people in One each group? ) Two Categorical More than two Within (Same) Related t-test Between (Different) Unrelated t-test Within (Same) Single factor repeatedmeasures ANOVA Between (Different) Single factor betweensubjects ANOVA Multiple Regression Continuous Two or more Parametric test or within- Categorical Within (Same) Two-factor repeatedmeasures ANOVA Between (Different) Two-factor betweensubjects ANOVA Both Mixed factor ANOVA Multiple regression/ ANCOVA Both Decision tree: excerpt from Andy Field’s “Discovering Statistics” books - back page. 2/24/2021 Becoming a Researcher: Using Data 19

Writing a research report 1. Formulate a research question Action: use the variables listed, and include your hypothesis (lecture 4) 2. Describe the experiment design Action: decide your design (lecture 4) 3. Select a statistical test Action: decide the right test (lecture 4) 4. Conduct the statistical test Action: use SPSS (Practical 6 or 8 – slides and worksheet) 5. Reach a conclusion Action: is your result significant? (lecture 4) 6. Write up the report Action: use the model answers in the practical slides (Practical 6 or 8 – slides and worksheet) 2/24/2021 Becoming a Researcher: Using Data 20

Using Data: The Professionals 21

Box 4: Data science to make the world a better place Using data for Public Understanding of Risk • Prof David Spiegelhalter, Winton Professor for the Public Understanding of Risk, Winton Centre for Risk and Evidence Communication. • Promoted concepts such as the micromort (a one in a million chance of death) and microlife (a 30 -minute reduction of life expectancy). • Appears on radio and TV talking about the application of probability in everyday life Reading • Blog: Micromort – Understanding Uncertainty • Documentary: Tails you win: The Science of Change, BBC • Book: Sex by Number 22

Box 4: Data science to make the world a better place Using data to promote a fact-based worldview • Prof Hans Rosling, Professor of International Health. • He rose to prominence with TED talk: The Best Stats you’ve never seen. In 2005 launched Gapminder. org, with his son and daughter-in-law. In 2010, presented the Joy of Stats on BBC. • Amardeo Sarma remembers Rosling as being "able to bring data to life" and how "he shows us how we are wrong in many of our beliefs and that we just don't know much about the world. " Sarma calls Rosling a "global citizen" for his activities around the world. Reading • TED talk: The Best Stats you’ve never seen • Book: Factfulness: ten reasons we’re looking at the world wrong – and why things are better than you think • Take the Gapminder Test: http: //forms. gapminder. org/s 3/test 2018 23

Something new and useful: Questionnaires 2/24/2021 Becoming a Researcher: Using Data 24

Creature of Habit Scale 2/24/2021 Becoming a Researcher: Using Data 25

a A tot 2/24/2021 ll a n i ts n e m e t a t s 7 2 l of Becoming a Researcher: Using Data 26

COHS • How did this ll a n i nts 2 f o l a A tot e m e t 7 sta • Become this? 2/24/2021 Becoming a Researcher: Using Data 27

Scales, questionnaires and measures • A set of questions that measure a psychological construct. E. g. • Personality traits or states • Behavioural dispositions or experiences • Attitudes or beliefs • Ask self-reported questions • The set has been created, ‘cleaned’, tested and validated following established methods • You should use it as a single entity You cannot Make it up or Break it up 2/24/2021 Becoming a Researcher: Using Data 28

COHS: Questionnaire development Ersche, K. D. , Lim, T. V. , Ward, L. H. , Robbins, T. W. , & Stochl, J. (2017). Creature of Habit: A self-report measure of habitual routines and automatic tendencies in everyday life. Personality and individual differences, 116, 73 -85. 2/24/2021 Becoming a Researcher: Using Data 29

COHS: Questionnaire development • Item generation • Creation of statements that might measure ‘Creature of Habit’ type behaviours and thoughts. • Use literature, interviews, discussion with researchers to identify items. • All items are statements with Likert scale responses (agree-disagree) 2/24/2021 Becoming a Researcher: Using Data 30

COHS: Questionnaire development • Factor analysis of responses • Circle is item • Colour is Scale • Analysis groups items into scales based on participant responses. • They remove unwanted items 2/24/2021 Becoming a Researcher: Using Data 31

COHS: Questionnaire development • Scales become subscales • Scale 1 (16 items) measures routine • Scale 2 (11 items) measures automaticity 2/24/2021 Becoming a Researcher: Using Data 32

COHS: Questionnaire development Reliability • Do all items measure the same thing – internal consistency? • Mc. Donald‘s omega and Cornbach's alpha • routine(ω=0. 92, α= 0. 89) • automaticity(ω= 0. 91, α= 0. 86) • High scores suggest satisfactory reliability for both scales. All questions within each scale assess the same thing 2/24/2021 Becoming a Researcher: Using Data 33

COHS: Questionnaire development Validity • Does the scale measure the latent construct? • Correlation with other measures 2/24/2021 Becoming a Researcher: Using Data 34

COHS: Questionnaire development Validity • Does the scale measure the latent construct? • Correlation with other measures • ↑Routine related to ↓Sensation seeking (SSS-V) • ↑Automaticity related to ↓Goal pursuit (HSCQ) Scale assess something meaningful versus other measures 2/24/2021 Becoming a Researcher: Using Data 35

COHS: Questionnaire Use Ask participants ALL the questions as they are written 2/24/2021 Becoming a Researcher: Using Data 36

COHS: Questionnaire scoring Scoring 0 2/24/2021 1 2 3 Becoming a Researcher: Using Data 4 Item responses scored 0 to 4 37

COHS: Questionnaire scoring Scoring Item 0 to 4 Sum subscales Routine 2/24/2021 1 Routine 0 Automaticity 3 Routine 1 Automaticity 4 Becoming a Researcher: Using Data 38

COHS: Questionnaire scoring Scoring Item 0 to 4 Sum subscales Routine = Routine 1+0+1= 2 out of 12 Automaticity = Routine 2/24/2021 Automaticity Becoming a Researcher: Using Data 3+4= 7 out of 8 39

COHS: Questionnaire scoring Scoring • For the full 27 questions means 7 2 f o al t o t A 2/24/2021 ll a n i ts n e m e t a t s Becoming a Researcher: Using Data 40

Scales, questionnaires and measures • A set of questions that measure a psychological construct. • Ask self-reported questions • The set has been created, ‘cleaned’, tested and validated following established methods • You should use it as a single entity You cannot Make it up or Break it up Follow the instructions on the original paper 2/24/2021 Becoming a Researcher: Using Data 41

Library > Subject Guide > Psych • Psyc. TESTS: a data base of questionnaires 2/24/2021 Becoming a Researcher: Using Data 42

What happens next? 2/24/2021 Becoming a Researcher: Using Data 43

What happens next? First year • MOD 005722 Becoming a researcher: Designing Research (15 credits) • MOD 005723 Becoming a researcher: Using Data (15 credits) 1. 2. In-class tests (40%) – MCQs assessing stats knowledge Research report (60%) Second year • MOD 006618 Research in Action: Statistical Thinking (15 credits) 1. 2. In–class tests (40%) - MCQs testing stats knowledge Group project research report (60%) • MOD 006619 Research in Action: Qualitative methods and Psychology in Practice (15 credits) Third year • MOD 002531 Psychology Project (30 credits) 1. 2/24/2021 Research Report summarising the data you have collected. Becoming a Researcher: Using Data 44

What happens next? In this module (BAR: UD) we have Which will prepare you for next year (RIA: ST), when you will • Learned the logic of, and how to carry out in SPSS 1. z-tests 2. t-tests 3. Correlation + regression 4. chi-squared • Learned how to write research reports and results sections • Assessment with 1. in-class MCQs 2. a research report including • Learn the logic of, and how to carry out in SPSS 1. ANOVA (more complex a t-tests and correlation 2/24/2021 2. version of t-tests) Multiple regression (more complex version of correlation) • Learned how to write research reports and results sections • Assessment with 1. in-class MCQs 2. a research report including a 2 x 2 ANOVA Becoming a Researcher: Using Data 45

See you next year! • Thank you for being a wonderful class 2/24/2021 Becoming a Researcher: Using Data 46