Three purposes of triangulation in language teaching research

Three purposes of triangulation in language teaching research Richard Watson Todd KMUTT © 2006 Richard Watson Todd

What is triangulation? Triangulation comes from surveying b Triangulation means measuring something from different perspectives b Possible different perspectives include different instruments, subjects, methods of analysis, places, times b © 2006 Richard Watson Todd

Claims made for triangulation Internal validity b Reliability b Stability b Plausibility b Researcher confidence b © 2006 Richard Watson Todd

How triangulation works “demonstrating the same findings through different sources” b “confirming data collected in one way with data collected in a completely different way” b “maximising the possibility of obtaining credible findings by cross-validating them” b © 2006 Richard Watson Todd

Purposes of triangulation To identify valid and reliable findings b To compare different findings b To identify valid data sources and methods b © 2006 Richard Watson Todd

The data b b b b Extracts of classroom language analysed for topics using: Functional analysis (Sinclair and Coulthard, 1975( Theme-rheme progression Given-new progression Lexical analysis (Hoey, 1991( Topic-based analysis using logical relations Topic-based analysis using associations Prime focus: To identify topic discontinuities © 2006 Richard Watson Todd

Purpose 1: To identify valid and reliable findings Large number of discontinuities identified b 13 points where all analyses agree on a discontinuity b 14 points where 5 analyses agree on a discontinuity b These 27 points are most likely points for discontinuities to be identified by participants b © 2006 Richard Watson Todd

Purpose 2: To compare different findings Problems of using triangulation to identify valid findings for topics and coherence b Examine points where a discontinuity is identified by only one analysis b Sinclair and Coulthard (1975): most points b Given-new progression: fewest points (proportionately( b © 2006 Richard Watson Todd

Purpose 2: To compare different findings (cont(. Research into perceptions of teachers and learners (e. g. Block, 1994( b Teachers and learners perceive classroom activities differently b Teachers and learners operate according to different systems b © 2006 Richard Watson Todd

Purpose 3: To identify valid data sources and methods Examine overall patterns of similarities and differences between all analyses b Calculate z-scores showing relationships between each pair of analyses b Design a benchmark control analysis b Construct an extended tree diagram b Compare validity of each analysis b © 2006 Richard Watson Todd

Purpose 3: To identify valid data sources and methods (cont(. For discontinuities: b Control analysis = placing the average number of discontinuities at equidistant intervals through the discourse b © 2006 Richard Watson Todd

© 2006 Richard Watson Todd

Purpose 3: To identify valid data sources and methods (cont(. Another example: b Identifying topics for stretches of discourse bounded by discontinuities b Control analysis = topic is the most frequent content word in the stretch of discourse b © 2006 Richard Watson Todd

© 2006 Richard Watson Todd

Purposes of triangulation Identifying valid and reliable findings: may be possible, but overemphasised b Comparing different findings: more likely to be of use in ELT research b Identifying valid data sources and methods: potentially useful, especially in methodological studies b © 2006 Richard Watson Todd