PSYA 4 research methods Section C Validating new

PSYA 4 - research methods Section C

Validating new knowledge • The role of peer review • the assessment of scientific work by others who are experts in the same field (i. e. ‘peers’). • The goal of peer reviewing is to ensure that any research conducted & published is high quality. • Peer reviewers are generally unpaid. • Usually there a number of reviewers • Their task is to report on the quality of the research and then their views are considered by a peer review panel.

The Office of Science and Technology (2002) suggests peer review serves 3 main purposes: • Allocation of research funding – Research is paid for by various government and charitable bodies. Therefore public bodies require reviews to enable them to decide which research is likely to be worthwhile. • Publication of research in scientific journals and books – Scientific journals provide scientists with the opportunity to share the results of their research. The peer review process has only been used in such journals since middle of 20 th century as a means of preventing incorrect or faulty data entering the public domain. • Assessing the research rating of university departments – All university science departments are expected to conduct research and this is assessed in terms of quality. Future funding for the department depends on receiving good ratings from the peer review.

AO 2: COMMENTARY • It is clear why peer review is essential – without it we don’t know what is mere opinion and speculation, and what is real fact. • While the purpose of peer review is beyond question, certain features of the process can be criticised.

Criticisms of peer review • Unachievable ideal – • isn’t always possible to find an appropriate expert to review research. This means that poor research may be passed because the reviewer didn’t really understand it. • Anonymity • usually practised so that reviewers honest and objective. • However may have opposite effect if reviewers use the anonymity to settle old scores or bury rival research. • Research is conducted in a social world where people compete for research grants, & make friends & enemies. Social relationships inevitably affect objectivity. • Some journals now favour open reviewing (both author and reviewer know each other’s identity).

Cont… • Publication bias • Peer review tends to favour the publication of positive results, because editors want research that has important implications to increase the standing of their journal. • Preserving the status quo • Peer review results in preference for research that goes with existing theory rather than unconventional work. • Science is generally resistant to large shifts in opinion. Change takes a long time and requires a ‘revolution’ in the way people think. Peer review may be one of the elements that slows down change.

Possible exam questions • Discuss the process of peer review. [8] • Discuss how psychologists validate new knowledge. [6]

Conventions on reporting of investigations • Scientific journals contain research reports which tend to be organised into the following sections: • Abstract • Introduction • Method • Results • Discussion • References • Appendix

What are these? • Abstract • A summary of the study covering the aims/hypothesis, method/procedures, results and conclusions. • Introduction/Aim • a review of previous research (theories and studies), explaining why researchers are conducting this study. The researchers state their aims & hypotheses • Method • A detailed description of what researchers did, providing enough information for replication. • Includes information about participants, testing environment, procedures used to collect data, and instructions given to participants before (the brief) and afterwards (the debrief).

Cont…. • Results • contains what researchers found, including descriptive statistics (tables, averages and graphs) & inferential statistics (statistical tests to determine significant). • Discussion • The researchers offer explanations of the findings & evaluate their work, consider the implications of results and make suggestions for future research. • References • full details of articles or books that are mentioned • Appendix • Details of materials used, brief etc & statistical calculations