The Benefit of Transparent and Documented Outcome Linkages
The Benefit of Transparent and Documented Outcome Linkages in Student Learning “A Guide on How to Eliminate Needing Lots of Coffee to Do It!” Jennifer Breaux, Dr. PH, MPH, Drexel School of Public Health Ray Lum, MPhil, MS, Drexel School of Public Health Mustafa Sualp, President & CEO, AEFIS, LLC
A Need for a Simpler Overview… BBLearn DSLPs Banner Programs AEFIS Course Learner Centered Syllabus Direct Assessments Surveys
AEFIS Systems Relationship AEFIS drex el. goaefis. net LMS AMS BBLearn Banner
Organizational Architecture AEFIS Institutional Implementation System (Colleges, Campuses, etc. ) Academic Unit Department Program Course Section
AEFIS Algorithm Drexel Student Learning Priorities [DSLPs] Program Design DSLP Transcript [Outcomes] Syllabus [Objectives] Indirect Assessment Direct Assessment
AEFIS Implementation Level 1 Level 2 Level 3 Level 4 Implementation Level 1 Indirect Assessment & Evaluation Tools (Surveys) Powerful framework for administering and distributing automated collection tools 2 Courses Catalog & Syllabi 3 Academic Programs Develop course learning outcomes for indirect assessment Design academic programs and manage student outcomes 4 Direct Assessment Plan and document embedded assessments and manage direct assessment results
Meet Dr. Jennifer Breaux, Dr. PH, MPH Assistant Professor in Community Health and Prevention and let’s follow her story in a day of her academic life… As Director of Undergraduate Education at the School of Public Health, Drexel University, Jen manages her: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!
Manages Her Course Catalog ü Course Wide Objectives ü Set Syllabus Defaults ü Check Program Mappings ü Access Historical Data § Assessments § Syllabi
Course Syllabus Before MS Word Document Individually Managed After AEFIS PDF Syllabus Centrally Managed
Course Description/ Catalog Before After
Course Objectives Before After
AEFIS dissemination strategies Top-down & Bottom Up School of Public Health Programs • Core Courses in MPH Program • Executive MPH Program • Epi/Biostat Online Program • LGBT Online Program • Global Health Online Program • Undergraduate Public Health Program (Minor/Major) School of Public Organizational Support • Office of Academic Affairs • Program • Departments (Academic Coordinators) • Blackboard/AEFIS Admin
AEFIS dissemination staff strategy College of Engineering College of Nursing • Biomedical Engineering (ABET accreditation) • Practicum Services College of Arts & Sciences • Course Evaluations
Program Mapping Package for SPH Drexel Student Learning Priorities – DSLP’s Course Catalog Details in AEFIS Manual Mapping Template Program Outcomes in AEFIS
Program Mapping Manual Mapping Template
Manages Her Course Catalog Course Wide Objectives In AEFIS Access Historical Data In AEFIS Syllabus Defaults In AEFIS
Manages Her Course Syllabi ü Confirm Syllabi Details ü Verify Assessment Planning ü Access through Bb Learn
Manages AEFIS syllabus in Blackboard
Manages Her Academic Program ü Manage Program Outcomes ü Map Program Outcomes to Course Objectives ü Plan Direct Assessment Schedule
Manages Her Academic Program
Mapping Her Program Outcomes to Courses
Map Program Outcomes to Course Objectives
Map Program Outcomes to Course Objectives
Map Program Outcomes to Course Objectives
Manages Her Direct Assessments ü Schedule Direct Assessments ü Request Results from Faculty ü Analyze Results ü Close the Loop & Continuously Improve Academic Program
Meet Jennie Shaw, SPH’s Health Management and Policy Academic Coordinator and let’s follow her story in a day of her administrator’s life… As Academic Coordinator at the School of Public Health, Drexel University, Jennie manages AEFIS for Health Management and Policy Dept: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!
Manages Her Direct Assessments
Manages Her Direct Assessments
Manages Her Direct Assessments
Manages Her Direct Assessments
Manages Her Direct Assessments
Meet Ray Lum, Associate Professor in the Health Management and Policy and Director of E-Learning for the School of Public Health and let’s follow his story in a day of his academic life… As a faculty at the School of Public Health, Drexel University, Ray is piloting AEFIS direct assessment for the School: ü ü Course Catalog Course Syllabi Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!
Manages His Direct Assessments
Manages His Direct Assessments
Manages His Direct Assessments
Meet Don Mc. Eachron, Professor in the Biomedical Engineering Program, School of Biomedical Engineering, Science and Health Systems and let’s follow his story in a day of his academic life… As the Coordinator for Academic Assessment and Quality Improvement at the School of Biomedical Engineering, Science and Health Systems, Drexel University, Don is piloting AEFIS direct assessment for the School: ü ü ü Course Catalog Course Syllabi External Accreditor Drexel Student Learning Priorities Academic Program Direct Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!
What Are the Targets? – Student Learning Outcomes (SLOs): School Developed 9 Intellectual Pathways Incorporating both ABET (external accreditor) criteria and Drexel Student Learning Priorities
Example - Communication • SLO - Communication – The graduate employs an understanding of audience, purpose and context to communicate effectively in a range of situations using appropriate media while displaying a significant aptitude for presenting scientific and technical materials to diverse audiences. • Supported By – ABET g Ability to communicate effectively – Drexel Learning Priority - Communication: Employ an understanding of audience, purpose and context to communicate effectively in a range of situations using appropriate media
Create Measurable Sub-elements Capable of being Mapped into Curriculum (Performance criteria; Performance Indicators; Learning Indicators, etc. )
Map SLOs or Subcomponents to Courses
Collect Direct Assessment Data
Display Direct Assessment Data
Meet Lora Furman, Director of Operations in the College of Nursing and Health Professions and let’s follow her story in a day of his adminstrator’s life… As a the Director of Nursing Operations at the College of Nursing and Health Professions, Drexel University, Lora is piloting AEFIS at the practicum assessment tool for the College: ü ü ü Course Catalog Course Syllabi Academic Program Direct Assessment Practicum Assessment … and uses AEFIS to do it which eliminates coffee lots of coffee consumption!
Moving Her Practicum Assessment Process to AEFIS Screen Shots from Custom Development
Curricular Improvements Actions • Culture of Assessment • Transparent Information • Orientation Sessions • Revise and Updated Websites • Revised and Updated Course Design • Course Mapping to Program Outcomes • Extended Transcript Pilot • Simplicity • Alignment of Assignments • Alignment of Courses to Program Outcomes • Extended Transcript • Convergences of Tools
Student Benefits Current Day Mentality • I want an “A” • Do not access information • Does not recognize the value • Look at courses discretely • I want a job • Teach Me Future & Intended Enlightenment Culture of Assessment Transparent Information Alignment of Assignments Alignment of Courses to Program Outcomes • Extended Transcript • Taking Charge of Learning Strategy • •
Questions? Thank you!
- Slides: 47