Refreshing Your Testing Toolkit Whats New Whats Revised

  • Slides: 57
Download presentation
Refreshing Your Testing Toolkit What’s New? What’s Revised? What are You Missing? Presented by:

Refreshing Your Testing Toolkit What’s New? What’s Revised? What are You Missing? Presented by: Dr. Deirdre Pickerell, CHRP, GCDFi Life Strategies Ltd.

Setting the Scene Getting Started Refreshi ng My Testing Toolkit Agenda

Setting the Scene Getting Started Refreshi ng My Testing Toolkit Agenda

SETTING THE SCENE

SETTING THE SCENE

A Pan-Canadian Perspective Little overlap between what is taught vs. used Evidence of a

A Pan-Canadian Perspective Little overlap between what is taught vs. used Evidence of a “one size fits all” approach Most commonly used for career exploration and planning Tool effectiveness impacted selection decisions Rich mixture of informal and standardized assessments Interest assessment widely used for career decisionmaking FLMM-CDSWG, 2009

Influences on Testing Choices Proposal requests (RFPs) Mandates and contracts Familiarity and habit Budget

Influences on Testing Choices Proposal requests (RFPs) Mandates and contracts Familiarity and habit Budget Qualifications Marketing

Canadian Standards / Guidelines: Area of Specialization—S 1 Assessment Knowledge Skill Competencies • Describe

Canadian Standards / Guidelines: Area of Specialization—S 1 Assessment Knowledge Skill Competencies • Describe assessment instruments and methods • Identify appropriate standardized career assessments and informal assessment methods • Explore appropriate instruments and procedures with clients • Use standardized career assessments • Review and evaluate results with clients

Assessment. . . Processe s Models Tools/Te sts

Assessment. . . Processe s Models Tools/Te sts

Types of Assessment Tools/Tests Informal • • Checklists Games Fantasies Forced-choice activities • Card

Types of Assessment Tools/Tests Informal • • Checklists Games Fantasies Forced-choice activities • Card sorts • Structured interviews Formal • • Needs Interests Skills Aptitude/Achieveme nt • Work Values • Personal Style

Emerging Approaches to Assessment Tools Assessment tools are not “magic bullets” They are useful

Emerging Approaches to Assessment Tools Assessment tools are not “magic bullets” They are useful for … • Gathering data • Providing some (not all) pieces of the puzzle • Exploration vs. prediction Best practices include engaging the testtaker in • Choosing what to assess • Interpreting the results • Converting test results into goals and action

GETTING STARTED

GETTING STARTED

Before You Start Test? No Test?

Before You Start Test? No Test?

Testing Considerations Location • Onsite / Offsite/ Online Distraction Level • Public vs. private

Testing Considerations Location • Onsite / Offsite/ Online Distraction Level • Public vs. private space • Group vs. individual Security / Supervision Client Accommodati on Computers Requirements Budget and Mandate Timeline • Proctoring • Physical / Language • Online / Computer scored • Consumable vs. Non-consumable • Funder/employer preferred / program goal • Administration and scoring • Interpretation

Qualification Levels C Level B Level A Level • Unrestricted • Anyone can purchase

Qualification Levels C Level B Level A Level • Unrestricted • Anyone can purchase / use • University training in tests and measurements • Specific training • Advanced training / supervision • Ph. D / Registered Psychologist

Assessment Framework External Factors Personal Characteristics Reproduced with permission from Career Pathways 2 nd

Assessment Framework External Factors Personal Characteristics Reproduced with permission from Career Pathways 2 nd Ed. (Amundson & Poehnell, 2008)

Do You Know What’s Available? Ask others • What are your colleagues using? Why?

Do You Know What’s Available? Ask others • What are your colleagues using? Why? Look online • What is available through test publishers? Bookmark helpful resources • Publisher websites • Buros’ Mental Measurements Yearbook • http: //buros. org/mental-measurements-yearbook

Test Publishers

Test Publishers

Example: Research Psychologist Press (Sigma) § Ashland Interest Assessment § Career Directions Inventory §

Example: Research Psychologist Press (Sigma) § Ashland Interest Assessment § Career Directions Inventory § Employee Screening Questionnaire 2 § Five-Factor Nonverbal Personality Questionnaire § Jackson Career Explorer § Jackson Vocational Interest Survey § Leadership Skills Profile - Development Report § Multidimensional Emotional Intelligence Assessment § Occupational Stress Inventory-Revised § Personnel Assessment Form § SIGMA Survey for Police Officers § Six Factor Personality Questionnaire

REFRESHING MY TESTING TOOLKIT

REFRESHING MY TESTING TOOLKIT

Considerations… There are countless assessment tools available This presentation introduces just a few •

Considerations… There are countless assessment tools available This presentation introduces just a few • To illustrate a range of test formats and content • To whet your appetite for further exploration These are not recommendations or “best picks” • Many good assessments are not included here • Some of these assessments may not fit your clients • A “one size fits all” approach is not recommended

Assessing Skills Card Sorts • Motivated Skills (Dick Knowdell) • Skill. Scan Aptitude /

Assessing Skills Card Sorts • Motivated Skills (Dick Knowdell) • Skill. Scan Aptitude / General Intelligence • Multi-Aptitude Battery (MAB) Achievement / Grade Level Emotional Intelligence • Wide Range Achievement Test (WRAT 4) • Bar. On Eqi • MEIA

Motivated Skills Cards Acronym Authors Date of Publication Qualification s Format Items • Motivated

Motivated Skills Cards Acronym Authors Date of Publication Qualification s Format Items • Motivated Skills • Richard L. Knowdell • n. d. • Level A • Card Sort • Online • 54 • Workbook / Worksheet also available Source: http: //career-lifeskills. com/career-assessments-79/knowdell-card-sorts-153/

Skill. Scan Acronym Authors Date of Publication Qualification s Format Items • Skill. Scan

Skill. Scan Acronym Authors Date of Publication Qualification s Format Items • Skill. Scan • Lesah Beckhusen • 2009 • Level A • Card Sort • Online • Professional: 64 • Advanced: 60 Source: http: //career-lifeskills. com/career-assessments-79/skillscan-card-sorts-151/

Transferable Skills Scale Acronym Authors Date of Publication Qualification s Format Items • TSS

Transferable Skills Scale Acronym Authors Date of Publication Qualification s Format Items • TSS • John Liptak & Laurence Shatkin • 2011 • Level A • Paper-and-pencil • 96 Source: http: //career-lifeskills. com/career-assessments-79/jist-assessments 150/transferable-skills-scale-tss-10 -2425. html

Others Aptitude Achieveme nt Emotional Intelligence Multi-Aptitude Battery-II Wide Range Achievement Test Emotional Quotient

Others Aptitude Achieveme nt Emotional Intelligence Multi-Aptitude Battery-II Wide Range Achievement Test Emotional Quotient Inventory 2. 0 Kaufman Test of Educational Achievement Multi. Dimensional Emotional Intelligence Assessment Kaufman Brief Intelligence Test

Assessing Interests Holland Self-Directed Search (SDS) Career Decision-Making System (CDMS) Career Exploration Inventory (CEI)

Assessing Interests Holland Self-Directed Search (SDS) Career Decision-Making System (CDMS) Career Exploration Inventory (CEI) Inventory Career Directions (CDI) Inventory Ashland Interest (AII) Inventory Strong Interest (SII) Jackson Vocational Interest Survey (JVIS)

Holland Self-Directed Search Acronym Authors Date of Publication Qualification s Format Items • SDS

Holland Self-Directed Search Acronym Authors Date of Publication Qualification s Format Items • SDS • John Holland • 1994 (4 th ed. , Canadian) • Level A • Paper-and-pencil • Online • 217 Source: http: //www. self-directed-search. com/

Career Decision-Making System Acronym Authors Date of Publication Qualification s Format Items • CDMS

Career Decision-Making System Acronym Authors Date of Publication Qualification s Format Items • CDMS • Arthur J. O'Shea & Rich Feller • 2008 (Canadian ed. ) • Level A • Paper-and-pencil • 120 Source: http: //www. pearsonassess. ca/en/programs/00/63/36/p 006336. html? prod. Categor y=psychological-vocational

Career Exploration Inventory (5 th ed) Acronym Authors Date of Publication Qualification s Format

Career Exploration Inventory (5 th ed) Acronym Authors Date of Publication Qualification s Format Items • CEI • John J. Liptak • 2015 • Level A • Paper-and-pencil • 128 Source: http: //career-lifeskills. com/career-assessments-79/jist-assessments 150/career-exploration-inventory-cei-the-5 th-edition-11 -824. html

Career Directions Inventory Acronym Authors Date of Publication Qualification s Format Items • CDI

Career Directions Inventory Acronym Authors Date of Publication Qualification s Format Items • CDI • Douglas N. Jackson • 2000 • Level A • Paper-and-pencil • Online • 100 Source: http: //www. sigmaassessmentsystems. com/assessments/cdi. asp

Ashland Interest Assessment Acronym Authors Date of Publication Qualification s Format Items • AIA

Ashland Interest Assessment Acronym Authors Date of Publication Qualification s Format Items • AIA • Douglas N. Jackson & Connie W. Marshall • 1997 • A Level • Paper-and-pencil • Online • 144 Source: http: //www. sigmaassessmentsystems. com/assessments/aia. asp

Jackson Vocational Interest Survey Acronym Authors Date of Publication Qualification s Format Items •

Jackson Vocational Interest Survey Acronym Authors Date of Publication Qualification s Format Items • JVIS • Douglas N. Jackson • 1999 • A Level • Paper-and-pencil • Online • 289 Source: http: //www. sigmaassessmentsystems. com/assessments/jvis. asp

Strong Interest Inventory Acronym Authors Date of Publication Qualification s Format Items • SII

Strong Interest Inventory Acronym Authors Date of Publication Qualification s Format Items • SII • E. K. Strong Jr. • 2012 • B Level • Paper-and-pencil • Online • 291 Source: http: //www. psychometrics. com/en-us/assessments/stronginterest-inventory. htm

Assessing Values Card Sorts • Planning on Purpose Cards • Career Values Cards Surveys

Assessing Values Card Sorts • Planning on Purpose Cards • Career Values Cards Surveys • Work Motivation Scale • Career Values Scale Informal • Informal Work Values Checklist • Corporate Culture Audit

Planning on Purpose Cards Acronym Authors Date of Publication Qualification s Format Items •

Planning on Purpose Cards Acronym Authors Date of Publication Qualification s Format Items • Planning on Purpose • Hudson Institute • n. d. • Level A • Card Sort • 66 Source: http: //hudsoninstitute. com/product/planning-on-purpose-card-deck/

Career Values Cards Acronym Authors Date of Publication Qualification s Format Items • Career

Career Values Cards Acronym Authors Date of Publication Qualification s Format Items • Career Values • Richard L. Knowdell • n. d. • Level A • Card Sort • Online • 54 • Workbook / Worksheet also available Source: http: //career-lifeskills. com/career-assessments-79/knowdell-card-sorts 153/? zenid=9 daa 536042 de 03 fe 5 d 703 dc 1 e 050898 e

Work Motivation Scale Acronym Authors Date of Publication Qualification s Format Items • WMS

Work Motivation Scale Acronym Authors Date of Publication Qualification s Format Items • WMS • Robert P. Brady • 2008 • Level A • Paper-and-Pencil • 32 Source: http: //career-lifeskills. com/career-assessments-79/jist-assessments 150/work-motivation-scale-wms-10 -2689. html

Career Values Scale Acronym Authors Date of Publication Qualifications Format Items • CVS •

Career Values Scale Acronym Authors Date of Publication Qualifications Format Items • CVS • Donald Mac. Nab, Shawn Bakker, and George Fitzsimmons • 2002 • Level A • Online • 88 Source: https: //www. psychometrics. com/en-us/assessments/career-survey. htm

Informal Work Values Checklist Aesthetics Belonging Challenge Competition Creativity Independence Knowledge Leadership Money People

Informal Work Values Checklist Aesthetics Belonging Challenge Competition Creativity Independence Knowledge Leadership Money People Publicity Quality Stability Source: Career Strategies for a Lifetime of Success (p. 192)

Informal Corporate Culture Audit Artefacts Insider “Language ” Common Employee Traits Source: Career Strategies

Informal Corporate Culture Audit Artefacts Insider “Language ” Common Employee Traits Source: Career Strategies for a Lifetime of Success (p. 154)

Assessing Personal Style Temperame nt Personality Type Five Factor Models • Personality Dimensions •

Assessing Personal Style Temperame nt Personality Type Five Factor Models • Personality Dimensions • True Colours • Myers-Briggs Type Indicator (MBTI) • Majors Personality Type Indicator (PTI) • Type Focus • NEO-FFI • NEO PI-3 • Six Factor Personality Questionnaire (SFPQ) Other • Work Personality Index

Work Personality Index Acronym Authors Date of Publication Qualification s Format Items • WPI

Work Personality Index Acronym Authors Date of Publication Qualification s Format Items • WPI • Psychometrics • 2014 • Level A • Paper-and-pencil • Online • 198 Source: http: //www. psychometrics. com/en-us/assessments/work-personality. htm

Type Focus Acronym Authors Date of Publication Qualification s Format Items • Type Focus

Type Focus Acronym Authors Date of Publication Qualification s Format Items • Type Focus • David J. Wood • 1997 • Level A • Online • 62 Source: https: //www. typefocus. com/beforelogin/why_typefocus

Career Personality Inventory Acronym Authors Date of Publication Qualification s Format Items • Career

Career Personality Inventory Acronym Authors Date of Publication Qualification s Format Items • Career Personality Inventory • John J. Liptak • 2010 • Level A • Paper-and-pencil • 80 Source: http: //career-lifeskills. com/career-assessments-79/jistassessments-150/career-personality-inventory-cpi-10 -3249. html

True Colours Acronym Authors Date of Publication Qualification s Format • True Colours •

True Colours Acronym Authors Date of Publication Qualification s Format • True Colours • Don Lowry • 1978 • Level B • Paper-and-pencil • Online Items Source: https: //truecolorsintl. com/

Personality Dimensions Acronym Authors Date of Publication Qualification s Format Items • PD •

Personality Dimensions Acronym Authors Date of Publication Qualification s Format Items • PD • Lynda Mc. Kim • 2003 • Level B • Paper-and-pencil • Online • Card Sort • Traits & Characteristics Checklist • Introversion/Extraversion Quiz

Myers-Briggs Type Indicator Acronym Authors Date of Publication Qualification s Format Items • MBTI

Myers-Briggs Type Indicator Acronym Authors Date of Publication Qualification s Format Items • MBTI • Isabel Briggs Myers & Katharine C. Briggs • 2010 • Level B • Paper-and-pencil • Online • Step I – 93 • Step II - 144 Sources: http: //www. psychometrics. com/en-us/assessments/mbti_stepi. htm and http: //www. psychometrics. com/en-us/assessments/mbti_stepii. htm

Majors Personality Type Indicator Majors Personality Type Elements Acronym Authors Date of Publication Qualification

Majors Personality Type Indicator Majors Personality Type Elements Acronym Authors Date of Publication Qualification s Format Items • Majors. PTI & Majors. PTE • Mark S. Majors • 2011 • Level B • Paper-and-pencil (PTI only) • Online • Majors. PTI – 52 • Majors. PTE - 127 Source: http: //career-lifeskills. com/majors-assessments-145/

Six Factor Personality Questionnaire Acronym Authors Date of Publication Qualification s Format Items •

Six Factor Personality Questionnaire Acronym Authors Date of Publication Qualification s Format Items • SFPQ • Douglas N. Jackson, Sampo V. Paunonen, & Paul F. Tremblay • 2000 • Level B • Paper-and-pencil • Online • 108 Source: http: //www. sigmaassessmentsystems. com/assessments/sfpq. asp

Other Tests and Tools (JIST) Ability Explorer Interview Style Inventory Assessing Barriers to Education

Other Tests and Tools (JIST) Ability Explorer Interview Style Inventory Assessing Barriers to Education Job Search Attitude Inventory Barriers to Employment Success Job Search Knowledge Scale Career and Life Explorer Job Survival and Success Scale Career Planning Scale Military-to-Career Transition Inventory Career Priorities Profile Re-Employment Success Inventory College Survival and Success Scale Transition-to-Work Inventory College-to-Career Transition Inventory Work Activities Matcher Employability Skills Inventory Work Readiness Inventory

Other Tests and Tools ACER Mechanical Reasoning Test ACER Select Series Career Beliefs Inventory

Other Tests and Tools ACER Mechanical Reasoning Test ACER Select Series Career Beliefs Inventory Career Factors Inventory Exam Preparation Inventory Five Factor Wellness Inventory Salient Beliefs Review Style Matters: Kraybill Conflict Style Inventory Thomas-Kilmann Conflict Mode Inventory

Final Thoughts

Final Thoughts

Define Your “Client” Individua l 3 rd Party Referre r Funder

Define Your “Client” Individua l 3 rd Party Referre r Funder

Get Informed Consent What is being done? How will it help? Why? By whom?

Get Informed Consent What is being done? How will it help? Why? By whom? What are the risks? What happens with the results? What are my options? What happens if I choose not to continue?

Know What You Need Online • • Manual Test Codes Computer Internet Access Paper-and-Pencil

Know What You Need Online • • Manual Test Codes Computer Internet Access Paper-and-Pencil • • • Manual Assessment Booklets Record Forms Templates for Scoring Worksheets/Workboo ks

Think Before You Buy Is the tool appropriate for my purpose? Is it a

Think Before You Buy Is the tool appropriate for my purpose? Is it a reliable/valid measure? Am I qualified to administer the tool? What is the age / reading level? How long does it take to administer? How long does it take to score?

Make Sure You. . . Have a goal Consider all options Monitor appropriateness Consider

Make Sure You. . . Have a goal Consider all options Monitor appropriateness Consider culture, competency, comfort Allow sufficient time

Remember Don’t be wooed by marketing campaigns • Do your research • Read the

Remember Don’t be wooed by marketing campaigns • Do your research • Read the manual Don’t just rely on the status quo • Find alternatives • Go beyond your favourites Take the tools yourself Use the most recent version • Understand the changes that occurred and why