The Benefit of Transparent and Documented Outcome Linkages

The Benefit of Transparent and Documented Outcome Linkages in Student Learning “A Guide on How to Eliminate Needing Lots of Coffee to Do It!” Jennifer Breaux, Dr. PH, MPH, Drexel School of Public Health Ray Lum, MPhil, MS, Drexel School of Public Health Mustafa Sualp, President & CEO, AEFIS, LLC

A Need for a Simpler Overview… BBLearn DSLPs Banner Programs AEFIS Course Learner Centered Syllabus Direct Assessments Surveys

AEFIS Systems Relationship AEFIS drex el. goaefis. net LMS AMS BBLearn Banner

Organizational Architecture AEFIS Institutional Implementation System (Colleges, Campuses, etc. ) Academic Unit Department Program Course Section

AEFIS Algorithm Drexel Student Learning Priorities [DSLPs] Program Design DSLP Transcript [Outcomes] Syllabus [Objectives] Indirect Assessment Direct Assessment

AEFIS Implementation Level 1 Level 2 Level 3 Level 4 Implementation Level 1 Indirect Assessment & Evaluation Tools (Surveys) Powerful framework for administering and distributing automated collection tools 2 Courses Catalog & Syllabi 3 Academic Programs Develop course learning outcomes for indirect assessment Design academic programs and manage student outcomes 4 Direct Assessment Plan and document embedded assessments and manage direct assessment results

Meet Dr. Jennifer Breaux, Dr. PH, MPH Assistant Professor in Community Health and Prevention and let’s follow her story in a day of her academic life… As Director of Undergraduate Education at the School of Public Health, Drexel University, Jen manages her: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!

Manages Her Course Catalog ü Course Wide Objectives ü Set Syllabus Defaults ü Check Program Mappings ü Access Historical Data § Assessments § Syllabi

Course Syllabus Before MS Word Document Individually Managed After AEFIS PDF Syllabus Centrally Managed

Course Description/ Catalog Before After

Course Objectives Before After

AEFIS dissemination strategies Top-down & Bottom Up School of Public Health Programs • Core Courses in MPH Program • Executive MPH Program • Epi/Biostat Online Program • LGBT Online Program • Global Health Online Program • Undergraduate Public Health Program (Minor/Major) School of Public Organizational Support • Office of Academic Affairs • Program • Departments (Academic Coordinators) • Blackboard/AEFIS Admin

AEFIS dissemination staff strategy College of Engineering College of Nursing • Biomedical Engineering (ABET accreditation) • Practicum Services College of Arts & Sciences • Course Evaluations

Program Mapping Package for SPH Drexel Student Learning Priorities – DSLP’s Course Catalog Details in AEFIS Manual Mapping Template Program Outcomes in AEFIS

Program Mapping Manual Mapping Template

Manages Her Course Catalog Course Wide Objectives In AEFIS Access Historical Data In AEFIS Syllabus Defaults In AEFIS

Manages Her Course Syllabi ü Confirm Syllabi Details ü Verify Assessment Planning ü Access through Bb Learn

Manages AEFIS syllabus in Blackboard

Manages Her Academic Program ü Manage Program Outcomes ü Map Program Outcomes to Course Objectives ü Plan Direct Assessment Schedule

Manages Her Academic Program

Mapping Her Program Outcomes to Courses

Map Program Outcomes to Course Objectives

Manages Her Direct Assessments ü Schedule Direct Assessments ü Request Results from Faculty ü Analyze Results ü Close the Loop & Continuously Improve Academic Program

Meet Jennie Shaw, SPH’s Health Management and Policy Academic Coordinator and let’s follow her story in a day of her administrator’s life… As Academic Coordinator at the School of Public Health, Drexel University, Jennie manages AEFIS for Health Management and Policy Dept: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!

Manages Her Direct Assessments

Meet Ray Lum, Associate Professor in the Health Management and Policy and Director of E-Learning for the School of Public Health and let’s follow his story in a day of his academic life… As a faculty at the School of Public Health, Drexel University, Ray is piloting AEFIS direct assessment for the School: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!

Manages His Direct Assessments

Meet Don Mc. Eachron, Professor in the Biomedical Engineering Program, School of Biomedical Engineering, Science and Health Systems and let’s follow his story in a day of his academic life… As the Coordinator for Academic Assessment and Quality Improvement at the School of Biomedical Engineering, Science and Health Systems, Drexel University, Don is piloting AEFIS direct assessment for the School: ü ü ü Course Catalog Course Syllabi External Accreditor Drexel Student Learning Priorities Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!

What Are the Targets? – Student Learning Outcomes (SLOs): School Developed 9 Intellectual Pathways Incorporating both ABET (external accreditor) criteria and Drexel Student Learning Priorities

Example - Communication • SLO - Communication – The graduate employs an understanding of audience, purpose and context to communicate effectively in a range of situations using appropriate media while displaying a significant aptitude for presenting scientific and technical materials to diverse audiences. • Supported By – ABET g Ability to communicate effectively – Drexel Learning Priority - Communication: Employ an understanding of audience, purpose and context to communicate effectively in a range of situations using appropriate media

Create Measurable Sub-elements Capable of being Mapped into Curriculum (Performance criteria; Performance Indicators; Learning Indicators, etc. )

Map SLOs or Subcomponents to Courses

Collect Direct Assessment Data

Display Direct Assessment Data

Meet Lora Furman, Director of Operations in the College of Nursing and Health Professions and let’s follow her story in a day of his adminstrator’s life… As a the Director of Nursing Operations at the College of Nursing and Health Professions, Drexel University, Lora is piloting AEFIS at the practicum assessment tool for the College: ü ü ü Course Catalog Course Syllabi Academic Program Direct Assessment Practicum Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!

Moving Her Practicum Assessment Process to AEFIS Screen Shots from Custom Development

Curricular Improvements Actions • Culture of Assessment • Transparent Information • Orientation Sessions • Revise and Updated Websites • Revised and Updated Course Design • Course Mapping to Program Outcomes • Extended Transcript Pilot • Simplicity • Alignment of Assignments • Alignment of Courses to Program Outcomes • Extended Transcript • Convergences of Tools

Student Benefits Current Day Mentality • I want an “A” • Do not access information • Does not recognize the value • Look at courses discretely • I want a job • Teach Me Future & Intended Enlightenment Culture of Assessment Transparent Information Alignment of Assignments Alignment of Courses to Program Outcomes • Extended Transcript • Taking Charge of Learning Strategy • •

Questions? Thank you!