Assessment Tables in Verification Report Two tables meant

Assessment Tables in Verification Report • Two tables meant to replicate LCME DCI tables, including ‘summarizing’ assessment methods into an abbreviated list of LCME terms (see Crosswalk at www. aamc. org/cir under Training and Resources: • Methods of Assessment – Courses • Methods of Assessment – Clerkships • Two tables to show all Assessment Methods listed in CI Standardized Vocabulary document: • Summative Assessment Methods • Formative Assessment Methods

Assessment Tables in Verification Report • Issue in previous Verification Reports: double-counting of Assessment Events in Summative Assessment Methods • Solution: System Change for 2016 -2017: • Changed tallies of assessment methods in the Summative and Formative Assessment tables so events are counted in one or the other. • Basically, Methods of Assessment Table counts only Summative AMs in Assessment Events and Summative Assessment Table does NOT count Assessment Events

Assessment Tables in Verification Report • Unexpected Consequences: • Schools that were not experiencing the ‘double-counting’ issue or had adjusted data entry to avoid the issue are not seeing all of their Summative Assessment Methods counted • Miscommunication resulted in this change being made to the Formative Assessment Table in error • Since Formative Assessment tends not to be Summative, schools are reporting that the Formative Assessment table is not being populated as expected. • We are investigating both of these issues and will be working with you as you find problems. • We apologize for the confusion.

Verification Report User Guide Methods of Assessment: This table lists all non-Clerkship SBs and shows how Summative Assessment methods linked to Events in those SBs are mapped to the list of LCME DCI Educational Methods (see Crosswalk). The Total Number of Exams is calculated by totaling the number of Events for that SB that have Summative Assessment Methods in Assessment Events (Events that have Assessment Methods but do not have Instructional Methods). The Formative Column is checked If at least one event contains one or more Assessment Methods tagged as “Formative. ”

Verification Report User Guide Methods of Assessment: Clerkships: Sequence Blocks will only be included in this table if they are tagged as clerkships. Summative Assessment methods linked to Assessment Events in those SBs are mapped to the list of LCME DCI Assessment Methods (see Crosswalk). Academic Level is based on the AL referenced by each SB in the CI Upload.

Verification Report User Guide Summative Assessment Methods: This table shows the number of Events* linked to CI Assessment Methods tagged as Summative. * For Events to be counted in this table, both an Instructional Method AND an Assessment Method must be linked. Assessment Events are not shown in this Table.

Verification Report User Guide Formative Assessment Methods: This table shows the number of Events* linked to CI Assessment Methods tagged as Formative. * For Events to be counted in this table, both an Instructional Method AND an Assessment Method must be linked. Assessment Events are not shown in this Table.