Beyond Behavior Developing a Model for Assessing Spirituality

Beyond Behavior: Developing a Model for Assessing Spirituality Dr. Ronald M. Miller Dr. Paul H. Freebairn Kelsey J. O. Cowden M. L. Brian Chan Taylor Snarr Kathy L. Pulotu BYU-Hawaii 2007

BYU Hawaii § § § Small, 4 -year comprehensive university About 2400 students Highly international campus (50%) Mission to serve Asia & Pacific Arts & sciences (professional programs in business, education and computing) Located near Oahu’s north shore

Positive Effects of Religion n Positive Psychology ¡ Correlations between religion, and academic performance have become very popular (Tisdell, 2001). n Religious students often… ¡ …obtain higher GPA’s. ¡ …study for longer periods of time. ¡ …rate higher on overall satisfaction with their academic experience (Mooney, 2005). ¡ …display positive self-concept characteristics (Astin, et al. , 2004)

Definitions n Spirituality “The search for the sacred” (Slater, Hall, and Edwards, 2001). n Religiosity “…religion includes a sacred element, but the search must be done in the context of a group that legitimizes its means and methods” (Slater, et al, 2001). n Religiosity and spirituality are not mutually exclusive concepts and can both overlap and exist separately. (Mytko, Knight, 1999)

Spirituality vs. Religiosity n Constructs overlap but are not identical n Religiosity measures outward religious practice n Spirituality by an inner felt sense of closeness or relationship with a higher power. n Religiosity is the outward expression of an inner feeling n Religious exercise provides structure to support spirituality within a community of believers

Current Assessments Religious Orientation Scale (Allport & Ross, 1967) n Spiritual Well Being Scale (Ellison, 1983) n Spiritual Assessment Inventory (Hall & Edwards, 1996) n Spiritual Transcendence Scale (Piedmont, 2000) n Faith Development Scale (Leak, 2003) n n. Lengthy Interview n Three Religious Assumes subscales: dynamics Well-Being involved subscale in n Intrinsic vs. Extrinsic n. A forced-choice, paired item measures relationships a sense with others of well-being is relevant in to n Fulfillment scale, consisting of eight pairs of relationship to In God. with God. of my prayers Example: the quiet statements, with one statement n Intrinsic n Two ¡ dimensions: Example: I don’t finda much and /or meditations, I find sense of representing a “more mature” satisfaction in one’s private prayer n. Example: Quite often I have 1)Development wholeness. of relationship statement of faith development. with been keenly aware of the with God n. Universality n. Example: presence of Godalways or the Divine Example: I almost feel Example: There is nome higher plane of a)It does not bother to become Being. completely off from god n Existentialcut Well-Being measures consciousness orreligions spirituality that binds exposed to other a sense of life-purpose and lifen 2)Awareness all people. Godin becoming b)Extrinsic I don’t find of value satisfaction. n. Connectedness Example: I am frequently aware of n. Example: The primary exposed to other religions. ¡ Example: I don’t know who I God prompting me to do something. purpose ofnot prayer is toreflects gain (In this pair, statement (a) Example: I do have any strong am where I came from, who or has relief and protection. greater faith development. ) emotional ties to someone died. where I’m going.

Our Need for a New Scale n. Christian Based Religious University (LDS) ¡Desire to better understand motivations behind behaviors n LDS students “…receive the highest scores of all groups on five of the 12 measures: Religious Commitment, Religious Engagement, Religious/Social Conservatism, Spirituality, and Equanimity. They also obtain above average scores on Spiritual Quest, Charitable Involvement, and Ecumenical Worldview, and the lowest score of all groups on Religious Skepticism” (Astin et al. , 2004). n Current Scales… ¡ …mostly measure religiosity---not spirituality ¡ …do not measure motivations n ¡ ¡ Our definition of spirituality is based on motivations, not behaviors …do not utilize levels or stages …are not precise in definitions

Modeling Kohlberg’s Morality n Kohlberg’s six-stage model of moral development has been a backbone to the moral reasoning construct. n There are 2 stages for the 3 separate levels: ¡ Pre-Conventional: External Morality n ¡ Conventional: Member-of-society perspective n ¡ These persons act morally to please society or to remain in good standing with others. Post-Conventional: Broad conception of universal principles (Justice) n n These persons act morally to avoid punishments or to gain rewards. These persons act morally because they understand it to be the best for all; they act according to what is just or right. Kohlberg validated his model with trained professionals conducting The Moral Judgment Interview or MJI. (Colby & Kohlberg, 1987)

Defining Issues Test (DIT) n James Rest DIT ¡ ¡ ¡ Designed by James Rest in the 1970’s (Rest, 1976) Psychometric measure for Kohlberg’s 6 stages of moral development. Has been utilized for over 25 years n Valid cross-sectionally, longitudinally, sequentially, and across all different ages (Schlafli, Rest, Thoma, 1985) n After reading a dilemma and then rating and ranking the importance of statements in a decision making process Rest could accurately place participants within the appropriate stage of moral development. n This was an alternative to the constraints inherent in Kohlberg’s interview.

The Structure of the DIT Participants… n …are presented with a dilemma within a short story n …answer what should be done. ¡ It is unimportant what they would actually do, rather the justification behind the action is important. (Kohlberg, 1971)

The Structure of the DIT Participants… n …rate 12 statements according to the extent the statement influenced their decision. ¡ 5 point Likert scale n …then rank the 1 st, 2 nd, 3 rd, and 4 th most important items that influenced their decision.

Scoring the DIT: The Principled reasoning score, or the P-Score n … is defined as “the weighted average of the ranked Stage 5 and 6 items summed across the six dilemmas” (Thoma, 2002). n Stages 5 and 6 make up the 3 rd, or Post-conventional, level of moral reasoning n n If a participant ranks a level 3 item as the most important down to 4 th most important, they receive between 4 and 1 points depending ¡ 0 pts are rewarded for anything other than a stage 3 answer ¡ 10 points possible per dilemma ¡ 60 points possible for entire DIT Points are summed and divided by 60 n The resulting percentage is the P-Score n “The DIT is a rating and ranking task that produces a non-stage based index of development” (Thoma, 2002).

James W. Fowler n Fowler’s (1981) Stages of Faith Development ¡ similar to Kohlberg -- focused on actual human development. ¡ ¡ ¡ ¡ n n n Stage 1 - "Primal or Undifferentiated" faith (birth to 2 years) Stage 2 – "Intuitive-Projective" faith (ages 3 to 7) Stage 3 – "Mythic-Literal" faith (mostly school children) Stage 4 – "Synthetic-Conventional" faith (arising in adolescence) Stage 5 – "Individualize-Reflective" faith (usually mid- twenties to late thirties) Stage 6 – "Conjunctive" faith (mid-life crisis) Stage 7 – "Universalizing" faith, or Enlightenment Only first two stages have empirical support Not a validated scale Not peer reviewed (published in a book)

Gibson, T. S. n Gibson (2004) “Four levels Toward Christian Spiritual Maturity” ¡ 4 stages based on Kohlberg’s stages and Christian beliefs. n n ¡ Accommodation to God’s Law Respect for and obedience to God’s Law Principle-centered commitment to a Christian worldview Kingdom-centered commitment to God’s glory Gibson did not design a scale to measure these, merely presented this theory and encourages churches to aid people in their progression.

Designing a New Instrument n Defining Spiritual Issues Test (DSIT) ¡ Based on Kohlberg’s stages of Morality ¡ Combining Fowler and Gibson’s theories ¡ Utilizing DIT as a framework n Goal: Design and Validate the DSIT to better measure spirituality. ¡ …without eliminating religiosity habits but focusing on motivations

DSIT: Three levels n n n Level 1 ¡ Correlates to Kohlberg’s Pre-conventional stage ¡ Entitled “Reward/Punishment” ¡ These persons are spiritual in order to avoid punishment, or to receive a direct reward. Level 2 ¡ Correlates to Kohlberg’s Conventional stage ¡ Entitled “Social Consequence” ¡ These persons are only spiritual or “good” because they want to please society or direct authority such as church leaders. Level 3 ¡ Correlates to Kohlberg’s Post-Conventional stage ¡ Entitled “Enlightenment” ¡ These persons are spiritual because they want to become better, knowledgeable, or like God.

Defining Spiritual Issues Test (DSIT) n Framework of DIT n Builds off Fowler & Gibson’s theories and scales n Simpler wording and fragments for ease with an international population. DIT Example: Whether the essence of living is more encompassing than the termination of dying, socially and individually. DSIT Example: Church authorities teach me to pray. n Eliminated confusing grammar, such as switching tenses, double negatives n Strictly personalized statements dealing with spiritual motivations DIT Example: Whether the druggist deserves to be robbed for being so greedy and cruel. DSIT Example: I will be saved in Heaven if I pray. n Each statement deals with 1 of the 3 levels of spirituality

Parallel DIT Scoring n In DIT & DSIT: Participants rate (scale: Great to None) then rank most important influences ¡ The DSIT also has them rank least important n DIT utilizes P-Score, DSIT utilizes S-Score ¡ In ranking section… n n n DIT assigns points based on stage 5 & 6 responses DSIT assigns points based on level 3 (which parallels stage 5 & 6) Unlike DIT, we were also interested in individual rating scores for each level.

Method: Participants n Participants ¡ 105 in total n 82 of whom completed demographics ¡ Home Area: n USA: 42 n Pacific Islands (including Hawaii): 21 n Asia: 19 ¡ Year in School: n Freshmen: 8 n Sophomore: 18 n Junior: 26 n Senior: 30 ¡ Gender: n Male: 18 n Female: 64

Method: Procedures n DSIT was placed online for students’ convenience n Professors called for participants during class & emailed the link; some offered extra credit as an incentive n Each participant read and responded to 3 of the 6 total dilemmas

Method: Apparatus DSIT: 6 Dilemmas n Aaron’s Prayer ¡ n When the company seems to be dishonest, should David quit his job? Gary & Kristy’s Hardship ¡ n When answers from the scriptures cost him money, should James stop searching the scriptures? n n David’s Job ¡ n When her husband demands she stay home, should Ruth attend church? James’ Study ¡ n After losing his wife, should Aaron stop praying? Ruth’s Conversion ¡ n Demographics When they are unable to buy food, should Gary & Kristy pay tithes to the church? Steve’s Offer ¡ When competing for a job position, should Steve accept the offer? n n Gender Age Year in School Two Year Religious Service Mission Marriage Status Home Country

Apparatus: DSIT n Each participant received 3 of the 6 dilemmas n Some dilemmas have non-sequitur questions, to detect honest responding ¡ The DIT also had non-sequitur questions n Each of the 3 levels has 6 -7 statements per dilemma

Similar Format for DSIT & DIT

Example Dilemma: Aaron’s Prayer Aaron is happily married and is a successful businessman. Devastatingly, his wife Irene is diagnosed with terminal stomach cancer. Respectable church leaders have taught Aaron that blessings result from prayer. In addition to his regular prayers, Aaron starts praying for Irene's recovery. Because of the complexity of her condition, Irene's unique treatment starts becoming a financial burden to Aaron. Due to his increasing stress levels, his performance at work has declined. This decline coupled with the downsizing within his company results in Aaron losing his job. He is no longer able to afford the expensive treatment; therefore, the innovative treatment is halted. While searching for other resources, Irene's condition worsens and sadly she passes away. Should Aaron stop praying?

Example Questions: Aaron’s Prayer n 5 -point scale: 4) Great 3) Much 2) Some 1) Little 0) None n Level 1: Reward/Punishment ¡ Examples: n God will bless me if I continue to pray. n I will be punished if I stop praying. n Level 2: Social Consequence ¡ Examples: n n n My family is pleased with me when I pray. Church authorities teach prayer. Level 3: Enlightenment ¡ Examples: n n I want to communicate with God. I have faith in God’s ultimate plan.

Validation: Factor Analyses & Reliability n Due to each participant doing only 3 dilemmas, two factor analyses were performed. (DSIT 1 and DSIT 2 represent the two halves) n Both revealed 3 separate levels as predicted. ¡ Factor Loadings ranged from. 02 to. 91 ¡ 32. 5% were above. 7 Reliability: ¡ DSIT 1 Cronbach Alpha =. 952 ¡ DSIT 2 Cronbach Alpha =. 704 n n In further steps the questions will be revised to improve factor loadings as well as reliability

Scoring Techniques n Two main types of scoring were utilized ¡ Spirituality Score or S-Score. . . n …is found by summing the points received in the “Most Important” section. Students received various points based on the importance they choose for Level 3 statements. S-Score: If they choose a Level 3 for “Most Important” =4 pts. Level 3 for n Scale: 0 -30 pts. n n ¡ “ 2 nd most important” =3 pts. Down to 1 pt…. At each dilemma they could get 10 points. Level Scores… n n n …are found by summing the total for each level during the rating portion. Each participant receives scores for Level 1, Level 2, and Level 3. Scale: 0 -72 pts (6 questions X 3 dilemmas X 4 max points)

Investigative Analyses n n Other instruments have found that spirituality generally increases from Freshman to Senior years in college. (Holcomb & Nonneman, 2004) We will investigate if our instrument shows the same trend. ¡ *Note: For these analyses the instrument was no longer split.

S-Score by Year in School S-Score (0 -30) n n As predicted… Spirituality as defined by the S-Score increases from Freshmen to Seniors.

Analyses: Level 1, 2, 3 by Year in School Freshmen n n Seniors Both Freshmen and Seniors show the highest scores on Level 3 then Level 1. Both groups scored the lowest on Level 2.

Level 1 by Year in School Level One (0 -72) n n As predicted… Level 1 (the lowest level of spirituality) decreased as students spent more time in college

Level 2 by Year in School Level Two (0 -72) n n As predicted… Level 2 spirituality decreased from Freshmen to Seniors.

Level 3 by Year in School Level Three (0 -72) n n n Not as predicted… Level 3 spirituality actually decreases from Freshmen to Seniors. This is interesting especially since S-Score, which takes into account level 3 answers, increased.

Conclusions from Results n While S-Scores increased from Freshmen to Seniors, the individual level scores decreased. This may be the result of Seniors being more discriminating in rating individual items, but they actually rank level 3 items as more important in the decision making process. n The S-Score tells us a great deal because it takes into account the person’s most important statements n Yet, it is necessary to examine all 3 level’s scores in order to fully understand the person’s spirituality.

Next Steps… n Revise questions to increase factor loadings n Create & validate more dilemmas n Correlate scale with other spirituality measures for validity n Retest reliability n Negative S-Score by utilizing the least important responses n To reduce imprecise interpretations, have each participant give examples of the different ratings ¡ For example, “To me a 5 means I am unselfish. ”

Next Steps… n Improve scoring technique by use of Ternary plots ¡ This will take into account each person’s level scores to better illustrate spirituality

Author Contact Information Dr. Ronald M. Miller millerr@byuh. edu Dr. Paul H. Freebairn freebaip@byuh. edu