Educational Research Chapter 3 Preparing and Evaluating a

Educational Research Chapter 3 Preparing and Evaluating a Research Plan Gay, Mills, and Airasian

Topics Discussed in this Chapter n n n Characteristics of a research plan General considerations in developing a research plan Components of a quantitative research plan Components of a qualitative research plan Evaluation of a research plan

Characteristics of a Research Plan A research plan is a detailed description of the procedures that will be used to investigate your topic or problem. Obj. A. 1

Characteristics of a Research Plan n General components of a research plan n n A justification for the hypotheses or exploration of the research problem A detailed presentation of the steps to be followed in conducting the study Obj. A. 1

Characteristics of a Research Plan n Purposes of a written research plan n Forces the researcher to think through every aspect of the study Facilitates the evaluation of the proposed study Provides detailed procedures to guide the conduct of the study Obj. A. 2

Characteristics of a Research Plan n Benefits of a written research plan n A well thought out research plan… n n saves time, provides structure to the study, reduces the probability of costly mistakes, and generally results in a higher quality research study. Obj. A. 3

General Considerations n Three general issues to consider when developing a research plan n Ethics of research Legal restrictions Cooperation from participants

General Considerations n Ethics of research n Five ethical principles n n n Beneficence and non-malfeasance Fidelity and responsibility Integrity Justice Respect for people’s rights and dignity Obj. 1. 1

General Considerations n Legal restrictions n National Research Act of 1974 n Protects participants n n Protection from harm – not exposing subjects to risks Informed consent – subjects participate of their own free will with an understanding of the nature of the study and possible risks Stipulates that proposed research activities involving human subjects must be reviewed and approved by an authorized group Internal Review Boards and Committees on Human Subjects Obj. 1. 2 & 2. 1

General Considerations n Legal restrictions n Family Educational Rights and Privacy Act of 1974 n Protects students’ privacy n n n Access to students’ records Need for written permission to use data identifying students Known as the Buckley Amendment Obj. 2. 1

General Considerations n Two additional issues related to ethical and legal responsibilities n n Deception Cooperation of participants

General Considerations n Deception n Situations in which complete information related to the study is not given to participants n n n Such information would influence or change participants’ responses Studies can be negatively affected by informing participants of certain details Use of deceptive practices must be undertaken very, very carefully Obj. 1. 2

General Considerations n Cooperation of participants n Gaining entry to the research site n n Approval needed at several levels n Site n Administrators n Teachers n Students Approval is not cooperation Obj. 1. 6

General Considerations n Cooperation from participants (continued) n Strategies to enhance cooperation n n Clearly explain the benefits of the study Afford stakeholders the opportunity to review drafts of the report for their approval Brief stakeholders on the findings Provide professional development sessions for stakeholders Obj. 1. 7

Quantitative Research Plans n Four major components n n Introduction Method Data analysis Timeline and budget Obj. 3. 1

Quantitative Research Plans n Introduction n Three sections n n Statement of the topic Review of the literature Statement of the hypotheses Statement of the topic n n The topic is identified with a discussion of the background and rationale Stated at the beginning of the plan Obj. 3. 2

Quantitative Research Plans n Introduction (continued) n Review of the literature n n Provides an overview of the topic and positions the study in the context of what is known, and, more importantly, what is not known about the topic Completed at the beginning of the study and placed in the beginning of the plan Obj. 3. 2

Quantitative Research Plans n Introduction (continued) n Statement of the hypotheses n n A formal statement specifying the hypothesis, support for expected relationships between variables, and operational definitions of all variables Hypotheses in quantitative studies are usually deductively reasoned Obj. 3. 2

Quantitative Research Plans n Method n Five major sections n n n Participants Instruments Design Procedures Data analyses Participants n n Identifies the characteristics of the population and sample as well as the sampling technique used Quantitative studies typically use large samples and probability sampling techniques Obj. 3. 3

Quantitative Research Plans n Method (continued) n Instruments n n Descriptions of the specific measures of each variable, the technical characteristics of the instruments, and the administration and scoring techniques Quantitative studies typically use non-interactive instruments n n n Tests Questionnaires Surveys Obj. 3. 3

Quantitative Research Plans n Method (continued) n Design n n Descriptions of the basic structure of the study and the specific research design chosen Quantitative studies typically use highly structured, static designs Obj. 3. 3

Quantitative Research Plans n Method (continued) n Procedures n Detailed descriptions of all the steps that will be followed in conducting the study, assumptions, and limitations n n n Gaining entry to the site How subjects will be selected The ways data will be collected analyzed Assumptions – any important “fact” presumed to be true but not verified Limitations – some aspect of the study that could have a negative effect upon the results n n Size of the sample Length of the study Obj. 3. 3

Quantitative Research Plans n Method (continued) n Data analysis n Descriptions of the techniques used to analyze the data n n Descriptive statistics – statistics that summarize data in terms of central tendency (e. g. , means), variation (e. g. , standard deviations), relative position (e. g. , standard scores), or relationships (e. g. , correlations) Inferential statistics – procedures used to infer the likelihood of the results happening in the population rather than just the sample Obj. 3. 3 & 3. 4

Quantitative Research Plans n Method (continued) n Data analysis (continued) n n The hypotheses usually determine the specific research design which in turn influences the specific analyses used Quantitative studies usually focus on the appropriate statistical procedures to analyze numerical data Obj. 3. 3 & 3. 4

Quantitative Research Plans n Timeline and budget n Timeline n n Description of the major activities and corresponding anticipated completion dates Help assess the feasibility of conducting the study The resulting structure helps avoid procrastination A general strategy is to allow more time than you initially think you will need!!! Obj. 3. 5 & 3. 6

Quantitative Research Plans n Timeline and budget (continued) n Budget n Descriptions of anticipated costs that are likely to be incurred n n n Salaries Copying Telephone Travel Optional in many plans Obj. 3. 5 & 3. 6

Qualitative Research Plans n n n Qualitative studies are characterized by openended, emergent designs Research plans must be responsive to the context and setting as well as the flexibility of the design The influence of prior fieldwork n n The authors recommend pre-proposal fieldwork to help understand the socio-cultural context of the setting Alternatives include drawing on one’s own experiences or the literature Obj. 4. 1 & 4. 2

Qualitative Research Plans n Additional ethical issues in qualitative research n n Unique emerging nature of qualitative designs increases the likelihood of unanticipated and unreviewed ethical issues Unique personal involvement with participants raises issues n n n Objective collection and interpretation of data Possibility of observing potentially illegal or unprofessional behavior Aligning professional and personal ethical perspectives Obj. 1. 5

Qualitative Research Plans n Six general components n n n Title of the study Introduction to the study Research procedures Potential contributions of the study Limitations Appendices Obj. 4. 3

Qualitative Research Plans n Title n n n Conveys key concepts of the study Provides a framework for continued reflection Serves as a conceptual point of reference Obj. 4. 4

Qualitative Research Plans n Introduction n Four sections n n n Purpose statement Framing the study Initial research question Related literature Purpose statement n A clearly written, concise statement that sets the stage for the rest of the plan Obj. 4. 5

Qualitative Research Plans n Introduction (continued) n Framing the study n n An attempt to demonstrate the relevance of the study using a frame of reference to which the reader can relate Describes the contribution of the study to existing theory, educational policy, or the solution of a practical problem Obj. 4. 5

Qualitative Research Plans n Introduction (continued) n Initial research question n n Specifying research questions is difficult at this stage given the ongoing, emergent nature of qualitative research Linked closely to theory, policy, or practical problem used to frame the study Obj. 4. 5

Qualitative Research Plans n Introduction (continued) n Review of the literature n n Links the study to any underlying assumptions and theories related to the initial research question Accomplishes several things n n n Assesses the researcher’s preparedness to conduct the study Identifies potential gaps in the literature Suggests promising educational practices Refines the initial research question Embeds the research questions in “guiding hypotheses” Obj. 4. 5

Qualitative Research Plans n Procedures n Eight sections n n n n Description of the overall approach and rationale for the study Site and sample selection Researcher’s role Data collection methods Data management methods Data analysis strategies Trustworthiness features Ethical considerations Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Overall approach and rationale n n n Identifies the qualitative approach (e. g. , ethnography, historical study, grounded theory, etc. ) Provides the rationale for why the particular approach is appropriate Provides a link to the appropriate literature on research methods Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Site and sample n n Describes the rationale for choosing the particular sample Describes the process for gaining entry to the site Describes the site Discusses the likelihood of building trusting relationships with the participants Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Researcher’s role n n Describes any negotiations needed to gain entry to the site Discusses participants’ expectations in terms of reciprocity Anticipates any ethical dilemmas Data collection methods n n Describes the fieldwork techniques and tools for collecting data Identifies multiple data sources Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Data management methods n Provides insights into ways by which the large quantity of data will be manipulated n n Data sources Volume of data Storage Information such as times, dates, locations, etc. Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Data analysis strategies n n Interpretive nature of the analyses of data from fieldwork, observations, interviews, etc. Describes procedures for collating data Discusses the manner by which the data will be categorized in terms of emergent themes Provides a rationale for the conclusion and interpretations Obj. 4. 6

Qualitative Research Plans n Procedures (continued) n Trustworthiness features n n n The researcher’s efforts to address traditional validity and reliability issues The use of triangulation – multiple data sources and collection methods Ethical considerations n n n Demonstrates sensitivity to the ethical issues related to informed consent Describes the plan to obtain informed consent States the researcher’s personal/professional ethical perspectives Obj. 4. 6

Qualitative Research Plans n Potential contribution of the research n n n Describes how the study will contribute to an understanding of the phenomenon being studied Provides a link from the possible implications of the study to the broader framework under which the study was begun Limitations n Discusses any limitations related to the researchers’ ability to deal with situations over which they have no control

Qualitative Research Plans n Appendices n Provide information helpful in assessing the value and feasibility of the study n n n Timeline Proposed table of contents Sample consent form Internal Review Board (IRB) approval Sample of data collection protocols Obj. 4. 7

Evaluation of a Research Plan n Informal assessment n n n Formal assessment n n n Critiques by the researcher, advisors, peers and colleagues, etc. Critiques by experienced researchers Field tests Pilot studies Modifications based on the results of both informal and formal evaluations Obj. 5. 1 & 5. 2