A TALE OF TWO METHODS COMPARATIVE ASSESSMENT OF

  • Slides: 22
Download presentation
A TALE OF TWO METHODS: COMPARATIVE ASSESSMENT OF FACE-TO-FACE AND ONLINE LEARNING National Institute

A TALE OF TWO METHODS: COMPARATIVE ASSESSMENT OF FACE-TO-FACE AND ONLINE LEARNING National Institute on the Assessment of Adult Learning 2011: Virtual Assessment. Real Outcomes. Yuerong Sweetland, Ph. D – Director of Assessment , Franklin University

Presentation Overview Institutional Context and Background Assessment Model and Process Case Studies Closing the

Presentation Overview Institutional Context and Background Assessment Model and Process Case Studies Closing the Loop Questions & Answers

Background (1) Founded in 1902 as the YMCA School of Commerce Accrediting bodies: HLC

Background (1) Founded in 1902 as the YMCA School of Commerce Accrediting bodies: HLC and IACBE Adult students Undergraduate Average Age: 33 Graduate Average Age: 35

Background (2) First online courses offered 1998 As of Fall 2010, Franklin Offers 28

Background (2) First online courses offered 1998 As of Fall 2010, Franklin Offers 28 undergraduate majors & 4 graduate majors, available both f 2 f and online More than 11, 000 students enrolled annually Multiple Locations: Domestic and International

Online vs. F 2 F Trend (1) Number of Credit Hours Online Vs. F

Online vs. F 2 F Trend (1) Number of Credit Hours Online Vs. F 2 F 35000 32098 30000 29060 26633 Credit Hours 25000 20000 24548 21357 19382 21818 18526 18463 18260 16815 15000 F 2 F 15744 10000 5000 0 Fall 2003 Fall 2004 Fall 2005 Fall 2006 Fall 2007 Fall 2008 Online

Education Philosophy Ensuring academic quality Providing access to educational opportunities Adapting to the needs

Education Philosophy Ensuring academic quality Providing access to educational opportunities Adapting to the needs of students Responding to changes in society, professions, and the business community

Academic Model Centralized academic model Curriculum development: Team-based approach Fulltime faculty Design faculty Content

Academic Model Centralized academic model Curriculum development: Team-based approach Fulltime faculty Design faculty Content contributor Adjunct

Cascading Systems of Outcomes Program Outcomes Course Outcomes Module Outcomes

Cascading Systems of Outcomes Program Outcomes Course Outcomes Module Outcomes

Assessment - the “systemic collection, review and use of information about academic programs for

Assessment - the “systemic collection, review and use of information about academic programs for improving student learning and development. ” Each Academic Program has an Assessment Plan, which identifies outcomes, assessment methods, and implementation schedules

Assessment: Key Elements Multi-faceted assessment model Strong linkages between assessment and curriculum re-design Streamlined

Assessment: Key Elements Multi-faceted assessment model Strong linkages between assessment and curriculum re-design Streamlined process Transparency to all stakeholders

Multi-faceted Assessment Model Direct Capstone projects Selected course projects/assignments E-Portfolios Locally designed exams in

Multi-faceted Assessment Model Direct Capstone projects Selected course projects/assignments E-Portfolios Locally designed exams in capstone/other courses Nationally normed exams (Proficiency Profile, MFT) Indirect Current student survey Graduating student survey Alumni survey NSSE Grades

Assessment Process Make Improvement s Draft Assessment plans (Outcomes and assessment methods) Interpret and

Assessment Process Make Improvement s Draft Assessment plans (Outcomes and assessment methods) Interpret and Discuss Assessment Findings Gather & Analyze Evidence

Assessment Artifacts Collection https: //dropbox. franklin. edu/dropboxasmt/login. jsp

Assessment Artifacts Collection https: //dropbox. franklin. edu/dropboxasmt/login. jsp

Assessment Drop. Box Interface

Assessment Drop. Box Interface

Examples: Direct Assessment (Undergraduate) ACCT Outcome Assessment Data 2008 -9 (3 -point Scale) 3

Examples: Direct Assessment (Undergraduate) ACCT Outcome Assessment Data 2008 -9 (3 -point Scale) 3 2. 73 2. 65 2. 45 2. 5 2 1. 91 2. 56 2. 7 2. 4 2. 33 1. 93 1. 77 1. 5 f 2 f 1 Online 0. 5 0 Communicate effectively Conduct specific federal Analyze ethical issues in Analyze information financial accounting income tax research and the accounting systems through research and analyze tax issues profession evaluation of process financial accounting controls and issues organizational system risks within a business process?

Examples: Direct Assessment (Undergraduate) General Education Assessment Results 2. 5 2. 23 2. 2

Examples: Direct Assessment (Undergraduate) General Education Assessment Results 2. 5 2. 23 2. 2 2 1. 79 1. 87 1. 9 1. 71 1. 6 1. 5 1. 35 f 2 f online 1 0. 5 0 Communication Math Science Global Awareness

Examples: Indirect Assessment (Undergraduate) NSSE 2010 Results: Benchmarks 70 60 50 40 NOT FULLY

Examples: Indirect Assessment (Undergraduate) NSSE 2010 Results: Benchmarks 70 60 50 40 NOT FULLY ONLINE 30 20 10 0 LAC ACL SFI EEE SCE

Examples: Indirect Assessment (Undergraduate) NSSE 2010 Results: Individual Items 3. 45 3. 42 3.

Examples: Indirect Assessment (Undergraduate) NSSE 2010 Results: Individual Items 3. 45 3. 42 3. 4 3. 35 3. 33 3. 29 3. 3 NOT FULLY ONLINE 3. 25 3. 22 3. 15 3. 1 NSSE Q 12: Academic Advising Quality NSSE Q 13: Entire educational experiences

Examples: Indirect Assessment (Undergraduate) ACCT 225 DEWZ % 60 50 40 30 20 10

Examples: Indirect Assessment (Undergraduate) ACCT 225 DEWZ % 60 50 40 30 20 10 0 06/FA 07/WI UG Face-to-Face 07/SU UG Online 07/FA 08/WI UG Overall 08/SU F 2 F ACCT 225 08/FA 09/WI Online ACCT 225 09/SU 09/FA Total ACCT 225

Examples: Indirect Assessment (Graduate) MBA 726 (Finance) C-DEWZ % 20 18 16 14 12

Examples: Indirect Assessment (Graduate) MBA 726 (Finance) C-DEWZ % 20 18 16 14 12 10 8 6 4 2 0 06/FA 07/WI GR Face-to-Face 07/SU 07/FA 08/WI GR Online GR Overall 08/SU F 2 F MBA 726 08/FA 09/WI Online MBA 726 09/SU 09/FA Total MBA 726

Closing the Loop…. Major impacts of assessment findings: Curriculum Redesign Informing hiring plans Changes

Closing the Loop…. Major impacts of assessment findings: Curriculum Redesign Informing hiring plans Changes in assessment criteria Changes in assignment requirements, supporting materials Additional support services provided by the Student Learning Center

A Tale of Two Methods: Comparative Assessment of Faceto-face and Online Learning Questions or

A Tale of Two Methods: Comparative Assessment of Faceto-face and Online Learning Questions or Comments? Dr. Yuerong Sweetland Liuy@franklin. edu

Tale og skriftsprog Tale og skriftsprog Tale spontanTale og skriftsprog Tale og skriftsprog Tale spontan
Modern Comparative Methods Taxonomic Phylogenetic Modern Comparative MethodsModern Comparative Methods Taxonomic Phylogenetic Modern Comparative Methods
A Tale of Two Cities A Tale ofA Tale of Two Cities A Tale of
A Tale of Two Cities A Tale ofA Tale of Two Cities A Tale of
Comparative Government I Comparative Method 1 I ComparativeComparative Government I Comparative Method 1 I Comparative
THE comparative 1 Comparative with adjectives 2 ComparativeTHE comparative 1 Comparative with adjectives 2 Comparative
COMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives ComparativeCOMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives Comparative
Comparative Study 2016 Introduction to Comparative The comparativeComparative Study 2016 Introduction to Comparative The comparative
COMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives ComparativeCOMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives Comparative
Adjectives Comparative and Superlative Comparative Adjectives A comparativeAdjectives Comparative and Superlative Comparative Adjectives A comparative
Comparative and Superlative Adverbs Comparative Adverbs A comparativeComparative and Superlative Adverbs Comparative Adverbs A comparative
COMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives ComparativeCOMPARATIVE CONSTRUCTIONS II 5 Comparative Superlative adjectives Comparative
Comparative and Superlative COMPARATIVE AND SUPERLATIVE COMPARATIVE ADJECTIVESComparative and Superlative COMPARATIVE AND SUPERLATIVE COMPARATIVE ADJECTIVES
Phylogenetic comparative methods Comparative studies nuisance Evolutionary studiesPhylogenetic comparative methods Comparative studies nuisance Evolutionary studies
Comparative Method I Comparative methods deal primarily withComparative Method I Comparative methods deal primarily with
Comparative Method I Comparative methods deal primarily withComparative Method I Comparative methods deal primarily with
Comparative Method I Comparative methods deal primarily withComparative Method I Comparative methods deal primarily with
Comparative Public Administration Week Two PIA 3090 ComparativeComparative Public Administration Week Two PIA 3090 Comparative
Comparative Public Administration Week Two PIA 3090 ComparativeComparative Public Administration Week Two PIA 3090 Comparative
The Merchants Tale A Moral Tale January MayThe Merchants Tale A Moral Tale January May
Digestion An Absorbing Tale Digestion An Absorbing TaleDigestion An Absorbing Tale Digestion An Absorbing Tale