TEAM OREGON MOTORCYCLE SAFETY PROGRAM Program Evaluation Based

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Program Evaluation Based on the National Standards TEAM OREGON Motorcycle Safety Program Pat Hahn, Communications Manager

TEAM OREGON MOTORCYCLE SAFETY PROGRAM About TEAM OREGON • 13, 000 students • Mandatory training • Two approved courses (BRT/IRT) • Two advanced courses (RSP/ART) • Proprietary curricula

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Knowledge Survey Rate your knowledge of the TEAM OREGON rider training curriculum evaluation survey: No knowledge Some knowledge Much knowledge

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Opinion Survey How useful are surveys in evaluating rider training curriculum effectiveness? Not useful Somewhat useful Very useful

TEAM OREGON MOTORCYCLE SAFETY PROGRAM e. Rider™ Overview All classroom done online Proven effective State-approved 2/3 time commitment Interactive/video

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Pre-Post Survey Question Topics 1. 2. 3. 4. 5. 6. Riding gear Controls Basic skills Riding strategies Advanced skills Passing, surface hazards, weather 7. Passengers, group riding, touring 8. Impairment 9. Engagement – classroom 10. Engagement – range Results 10 7. 3 8 6 5. 4 9. 1 8. 8 8. 7 8. 5 7. 4 5. 3 4 2 0 BRT ONB Pre-course IRT Post-course ONI

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Poor Survey Question Rate your knowledge of proper riding technique, motorcycle technology and biker culture: 0 = no knowledge 2 = some knowledge 5 = much knowledge

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Better Survey Question Rate your knowledge of proper technique for braking in a straight line: 0 = no knowledge 2 = some knowledge 5 = much knowledge

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Pre-Post Survey Based on the National Standards • Derived from Standards • 45 Qs • Split into 4 surveys – 11 in common – 8 -10 unique

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Question Sample Before taking the course, how likely were you to wear proper protective riding gear? Not Likely 1 2 3 4 Very Likely 5 After taking the course, how likely are you to wear proper protective riding gear? Not Likely 1 2 3 4 Very Likely 5

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Question Sample Before taking the course, how well did you understand the risk associated with operating a motorcycle? Not Well 1 2 3 4 Very Well 5 After taking the course, how well do you understand the risk associated with operating a motorcycle? Not Well 1 2 3 4 Very Well 5

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Mid-Term Results • • • OR, ID and FL participating 28% response rate Current sample: 1, 800 (2, 700) 97% completion rate OR and ID differences not significant – Combined for analysis • Significant, positive change in every topic • Response patterns eerily similar

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to wear proper riding gear? OR/ID Mean Change: 0. 9325 Florida Mean Change: 1. 1456 | T-statistic: -2. 3177 P-value: 0. 0208

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to wear proper riding gear? Pre-course response distributions for Oregon/Idaho and Florida BRT students OR/ID Mean Change: 0. 9325 Florida Mean Change: 1. 1456 | T-statistic: -2. 3177 P-value: 0. 0208

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to wear proper riding gear? Post-course response distributions for Oregon/Idaho and Florida BRT students OR/ID Mean Change: 0. 9325 Florida Mean Change: 1. 1456 | T-statistic: -2. 3177 P-value: 0. 0208

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to wear proper riding gear? Mean change from pre-course to post-course response for Oregon/Idaho and Florida BRT students OR/ID Mean Change: 0. 9325 Florida Mean Change: 1. 1456 | T-statistic: -2. 3177 P-value: 0. 0208

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to wear proper riding gear? OR/ID Mean Change: 0. 9325 Florida Mean Change: 1. 1456 | T-statistic: -2. 3177 P-value: 0. 0208

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to avoid factors that impair your ability to ride safely? OR/ID Mean Change: 0. 7781 Florida Mean Change: 1. 0287 | T-statistic: -2. 9084 P-value: 0. 0038

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how likely were/are you to follow motorcycle laws, rules and regulations? OR/ID Mean Change: 0. 6006 Florida Mean Change: 0. 9175 | T-statistic: -3. 9966 P-value: 07. 366 e-5

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how well did/do you understand strategies for avoiding hazards? OR/ID Mean Change: 2. 1270 Florida Mean Change: 1. 9714 | T-statistic: 1. 8417 P-value: 0. 0660

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how well did/do you understand proper technique for cornering? OR/ID Mean Change: 2. 4463 Florida Mean Change: 2. 1656 | T-statistic: 3. 1538 P-value: 0. 0017

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Before/after taking this course, how well did/do you understand the importance of using your head and eyes to control a motorcycle? OR/ID Mean Change: 2. 5253 Florida Mean Change: 2. 1851 | T-statistic: 3. 5992 P-value: 0. 0004

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Rate your skill level before/after taking the course. OR/ID Mean Change: 1. 2958 Florida Mean Change: 1. 3659 | T-statistic: -1. 1823 P-value: 0. 2376

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Takeaways • Demonstrate program effectiveness based on National Standards • Provide fair measure for any state, any curriculum • Provide baseline for future curricula development • Hone to focus on priorities and learning objectives

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Knowledge Survey Rate your knowledge of the TEAM OREGON rider training curriculum evaluation survey: No knowledge Some knowledge Much knowledge

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Opinion Survey How useful are surveys in evaluating rider training curriculum effectiveness? Not useful Somewhat useful Very useful

TEAM OREGON MOTORCYCLE SAFETY PROGRAM

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Change in Knowledge of the TEAM OREGON rider training curriculum evaluation survey

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Change in Opinion Usefulness of surveys in evaluating rider training curriculum effectiveness

TEAM OREGON MOTORCYCLE SAFETY PROGRAM Pat. Hahn@Oregon. State. edu