An Introduction to Fully Integrated Mixed Methods Research

An Introduction to Fully Integrated Mixed Methods Research © Elizabeth G. Creamer

Chapter 1 Foundational Issues Purpose of the Chapter: Introduce Foundational Terms and Definitions Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Goals of the Chapter 1. Review different perspectives about the definition of mixed methods research. 2. Distinguish mixed methods from multimethod and quasimixed methods research. 3. Consider some challenges in distinguishing qualitative and quantitative approaches. 4. Describe a mixed methods way of thinking as a logic that undergirds mixed methods approaches. 5. Acknowledge concerns that are voiced about mixed methods approaches. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Terms Introduced in the Chapter 1. Complementarity argument 2. Evaluation research 3. Fully integrated mixed methods research 7. Methodology 8. Mixing 9. Multimethod 10. Phase or stage 11. Quasi-mixed methods 12. Triangulation 4. Inference 5. Meta-inference 6. Method Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Defining MMR Mixed methods research is a research design with philosophical assumptions as well as methods of inquiry. As a methodology, it involves philosophical assumptions that guide the direction of the collection and the analysis of data and the mixture of qualitative and quantitative approaches in many phases in the research process … As a method, it focuses on collecting, analyzing, and mixing both qualitative and quantitative data in a single study or series of studies. (Creswell & Plano Clark, 2011) Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Non-Controversial and Controversial Elements about the Definition • Non-Controversial • More Debated/Controversial 1. Requires both a QUAL and QUANT phase. 1. Is it both a method and a methodology? 2. Requires that the two be mixed in some way. 2. Is it determined by a single study or can it be determined across multiple studies? 3. What distinguishes QUAL and QUANT approaches? 4. Is it necessary for a study to be planned as MMR from the onset or acceptable for it to emerge? Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Distinguishing Method and Methodology • Method – a set of practices and procedures for conducting empirical research • Methodology – a coherent framework of philosophical assumptions and guidelines Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

MMR – Requires Some Type of Mixing • The linking, merging, or embedding of the qualitative and quantitative strands in a mixed methods study Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Distinguishing QUANT and QUAL Phase of Research Process QUANT QUAL Design Variable-oriented (breadth) Answers what questions Case-oriented (depth) Answers why and how questions Type of data collected Numbers Words Sampling Allows for generalizability Context-bound Analytical strategy Produces words Deductive Hypotheses testing Produces numbers Inductive Hypotheses generation Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Inductive and Deductive Reasoning Inductive reasoning is exploratory; it begins without predetermined hypotheses EVIDENCE Deductive reasoning begins with hypotheses EVIDENCE Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

We Like to Think That There are QUANT and QUAL Methods • We think of QUAL, but is often implicitly MMR • Grounded theory • Ethnography • Case study • Evaluation Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

But … Methods Alone Don’t Always Distinguish QUANT From QUAL • Document analysis – content analysis (analysis of words) • Can be done qualitatively • Can be done quantitatively • Can be done using mixed methods • Observation • Can be structured (i. e. counting specific behaviors –QUANT) • Can be unstructured (i. e. QUAL) Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Multimethod and Quasi-Mixed Methods • Multimethod research • Quasi-Mixed Methods • Involves multiple methods from the same tradition – generally QUAL. • Has a QUAL and a QUANT strand, but the results are never intermingled (i. e. mixed) Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Complementarity Argument – A Major Rationale for MMR • The use of a combination of methods can offset the weaknesses inherent in any one method. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Triangulation – A Second Major Rationale for MMR • A design strategy … where two or more methods are intentionally used to assess the same construct or phenomenon for purposes of confirmation or corroboration. (Greene, Caracelli, & Graham, 1989) Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Discovering the Remains of Richard III: A Contemporary Example of Triangulation Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Mixed Methods as a Logic of Inquiry • A logic of inquiry is a philosophical mindset that underlies an inquiry. • A “Mixed Method Way of Thinking” (Greene, 2007) 1. A commitment to engage complexity and to consider multiple viewpoints 2. Intentionality about engaging multiple ways of knowing. 3. The deliberate engagement of difference and paradox. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

The Arch as a Metaphor for MMR • An arch is constructed from the ground up, with each arm held in place by the arch which is placed in last and which holds the structure in place. • An arch can be both a feat of engineering and an aesthetic marvel. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

An Arch’s Keystone – A Metaphor for a Meta-Inference • A meta-inference links results from the QUAL and QUANT strands of a mixed methods study. • A keystone is a wedge-shaped piece of building material that links the two arms of an arch. • Not all arches have a keystone; not all MM studies have a meta-inference. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Fully Integrated MMR • In fully integrated mixed methods research, the intent is to engage qualitative and quantitative approaches in all phases of the research process. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

Extending the Metaphor to Quasi-MMR • As compared to an arch, two separate columns represent the type of research where multiple methods are used, but never linked or integrated. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.

“Mixed Up” Methods – Objections to MMR • Objection 1: QUANT and QUAL are driven by two inherently different (an incompatible) paradigms or views of reality. • Objection 2: It is impractical because it requires expertise in multiple methods. • Objection 3: It endorses “method blurring” or the piracy of methods without concern for the methodological assumptions that are behind them. Elizabeth G. Creamer, An Introduction to Fully Integrated Mixed Method Research © 2018 SAGE Publications, Inc.