Underground Coal Mine Supervisor Training MSHA Immersion Team

Underground Coal Mine Supervisor Training MSHA Immersion Team 5. 10. 2007 Joe Breighner • Allison Czapracki • Tangie Gray • Rashmi Jain • Abi Jones

Agenda • Introduction • Analysis • Design Approach • Development • Challenges • Training System • Evaluation • Future Recommendations

Instructional Design Process Integrative Learning Design Framework for Online Learning (Dabbagh & Bannan-Ritland, 2005)

Performance Challenge State of the Coal Mining Industry Underground Coal Miner Age Report (2004) Source: Energy Information Administration

Performance Challenge State of the Coal Mining Industry “[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years. ” - Bruce Watzman, V. P. of Safety, Health & Human Resources for the National Mining Association

Statement of Work Year 2 (2006 -2007) Second Phase Challenge Develop underground coal mine supervisor training program Six Duties (JTAs) 1. Pre-Shift Examination 2. Arrive on Section 3. On-Shift Examination 4. End of Shift Duties 5. Training Responsibilities 6. Emergency & Unusual Situations

Statement of Work Year 2 (2006 -2007) Second Phase Statement Work • Develop 6 course lessonsoffor 6 supervisory duties • Utilize DOL LCMS (Workforce Connections) • Comply 100% with ADA and Section 508 regulations • Comply to SCORM 2004 standards • Validate instructional strategy by cross- referencing TLOs/ELOs with assessment strategies • Provide a timeline with milestones and deliverables

Analysis Needs • Learner • Task • Performance Analysis • Current conditions • Desired performance • Learner Analysis • Prefer visually stimulating training that incorporates graphics • Expect technology to be used in training • 100% have access to the Internet either at work or at home. • 70% comfortable with technology • Miners with 1 -3 years experience • Mine supervisors seeking refresher training (professional development) • Training professionals at mines

Analysis Needs • Learner • Task Analysis • Content Analysis • SME Meetings • Additional JTA Analysis • Information Processing Analysis (IPA)

Analysis Needs • Learner • Task • Supervisor Problem-Solving Matrix Requires Procedural Rule-Using Duty Skills 1 Arrive on Section Requires Principle Rule Using Skills Fire Hazards Gas Testing & Ventilation 2 Conduct On-Shift Examination Roof & Rib Control 9 Conduct Pre-Shift Examination 10 Conduct End of Shift Examination Dust Control Guarding Recordkeeping 11 Emergency & Unusual Situations Clean Up 12 Training Responsibilities Emergency & Unusual Situations

Analysis Needs • Learner • Task • Supervisor Problem-Solving Matrix Requires Procedural Rule-Using Duty Skills 1 Arrive on Section 2 Guided Scenarios Conduct On-Shift Examination 9 Conduct Pre-Shift Examination 10 Conduct End of Shift Examination 11 Emergency & Unusual Situations 12 Requires Principle Rule Using Skills Training Responsibilities Mine Examinations JTAs as Job Aids Title 30 Code of Federal Regulations

Analysis Cross Referencing Design Matrix

Design Approach Year 1 (2005 -2006) First Phase Distributed Learning Support System Overall Supervisor Training (Problem Solving) Gagné’s 9 Events of Instruction Macro level Scenario & Case. Based Learning Micro level Duties 1 -10 (Procedure) Duty 12 (Principle) Duty 11 (Problem-Solving)

Design Approach Year 2 (2006 -2007) Second Phase Macro level Micro level

Design Approach Electronic Performance Support System (EPSS) JTA Online Worksheet Spider HTML Word Document PDF Document Links to 30 CFR Rank-able Steps Printable Visual Aid Links to Relevant Scenarios Add, Modify, Delete Steps Ready. Reference

Design Approach Case-Based Reasoning Scenarios Guided Scenarios Pre-Shift Examination On-Shift Examination Arrive On Section Emergency & Unusual Situations Vignettes Training Responsibilities End of Shift Duties

Development

Development

Challenges Design to Development • Challenges in taking a design strategy grounded in EPSS and CBR while implementing it in a SCORM-compliant Learning Content Management System: • LCMS challenges • SCORM challenges • Section 508 challenges

Challenges Learning Objects Technology • Corporations involved in developing technology-based training are tapping into the potential of learning object systems for reasons that include: • Increased efficiency (dev cycle time) • Increased effectiveness and personalized training (Dabbagh & Bannan-Ritland, 2002) • f design and dev tasks

Challenges Learning Content Management System • Released April 2004 • SCORM & Section 508 compliant • Structures content as learning objects • Delivers content

Challenges Learning Content Management System • • • Limited GUI Choices Page-turner navigation restrictions Learning object creation and reuse Naming conventions Limited repository access Which one is the Pre-Shift Examination Checklist? 315 fbde 59 b 8 df 8702506 f 70 a 2 db 035 b 7. doc abb 2 cace 59 ad 88329 f 52183 ac 17 ca 108. doc 67 ea 281380 eb 9 bc 4324 ead 1125199 b 14. doc

Challenges SCORM • Object Granularity Creation • No creation guidelines • Lack of granularity convention • Tagging • Understanding future uses

Challenges Section 508 • Section 508 Law • Who does it protect? • Why is it important? “The Mine Supervisor prototype presentation layer (look and feel) will comply 100% with all Americans with Disabilities Act, Section 508 conventions as required by OMB. ” - MSHA Online Training System - Statement of Work [2006/2007]

Challenges Flash • Difficult to build accessible movies • Not all elements are screen-reader friendly • ‘Alt’ text must be added

Challenges Interactivity • No ‘mouseovers’ • Color elements difficult to follow by colorblind users • Resulting approach • Tradeoffs • Workarounds

Challenges

Challenges

Challenges

Training System http: //supervisor. mineindustry. com

Formative Evaluation First Iteration - Year 2 ( January 2006) Second Phase • Online survey • Focus Group Interviews • Primary SME contacts Content Navigation Ease of Use • Results

Formative Evaluation Second Iteration - Year 2 (March 2007) Second Phase • • Expert Review • • Coal industry SMEs Instructional designers Usability Testing • • One-to-One Contextual Inquiry Content Navigation Ease of Use Methodology • Results / Recommendations

Formative Evaluation Second Iteration - Year 2 (March 2007) Second Phase

Formative Evaluation Second Iteration - Year 2 (March 2007) Second Phase surveymonkey screenshot

Evaluation Results • 88% - JTAs were fully informative • 75% - JTA connections to the scenarios, 30 CFR, and minespecific worksheets were helpful • 86% - Objectives were clear and easy to understand

Recommendations Continuing Evaluation • Pedagogy • SCORM & Technical • Suggestions for training system evaluation and development • Summative Evaluation using Kirkpatrick’s levels of evaluation • Pedagogical Recommendations

Recommendations Summative Evaluation • • • Level 2 • Guided Scenario Assessment Questions Level 3 • • • Follow-up Surveys and Questionnaires Observations on the Job Interviewing a Trainee’s Supervisor Level 4 • • Reviewing a Trainee’s Performance Records Safety Records

Recommendations Pedagogical • Integrate the remaining 6 supervisory duties into the system • Develop a more comprehensive unit on Training Responsibilities • Provide flexible and interactive formats for answering scenario questions • Track Learner Progress • Enable a Community of Practice • Immersive Virtual Simulations

Recommendations SCORM & Technical • Learning Object • Granularity Repository (l. i. e. ) • Sequencing and • Common Graphical Assessment User Interface • Style Guide • Outside Resources • Naming Schema • Plug-Ins and • Labeling Software Add-ons Content with Metadata

Conclusion 2007 GMU MSHA Immersion Team Statement of Work ✓Develop 6 course lessons for 6 supervisory duties ✓Utilize DOL LCMS (Workforce Connections) ✓Comply 100% with ADA and Section 508 regulations ✓Comply to SCORM 2004 standards ✓Validate instructional strategy by crossreferencing TLOs/ELOs with assessment strategies ✓Provide a timeline with milestones and deliverables

Team Website http: //supervisor. mineindustry. com

Thank You ! Will Peratino Department of Labor Paul Bizich MSHA Jeff Duncan MSHA Sharon Casto MSHA Don Conrad Sharon Cook Bob Glatter MSHA Tom Kessler MSHA Jerry Vance MSHA Courtney Cox Power. Train

Questions ?