NAEP Alliance NAEP Technology Based Assessments National Conference

NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2: 00 -3: 30

NAEP Alliance Introduction to e. NAEP 2

NAEP Alliance NAEP Model (2014 & beyond) • Administration on NAEP-provided touchenabled devices • 2 sessions of 25 students per school • e. NAEP delivery system § Web application § Compatible across various devices, operating systems, and web browsers (i. e. , future-proofed) § Can run on virtually any resolution (flexible layout) 3

NAEP Alliance e. NAEP Development • e. NAEP is built to support all NAEP subjects. • Provides a consistent user experience across all subjects. • Planning for a progressive rollout of functionality over the next few years: – 2014: Initial version (subset of item types & tools) – 2015: Enhanced version (more tools, features & item types) – 2016: Additional item types – 2017: Additional interactive item types 4

NAEP Alliance Summary of Planned e. NAEP System Features 2014 Proof of Concept 2015 TBA Startups & Pilots Volume Yes Tutorials No Yes In-System Help Yes Text-to-Speech No Yes Zoom No Yes Highlighter N/A* Yes Elimination Tool N/A* Yes Change Color Theme No TBD** *There are no discrete or questionnaire items in 2014 POC, so these tools are not applicable. **Some accommodations and potential universal design features require discussion by the AICC. 5

NAEP Alliance Additional Features 2015 & Beyond Additional Features 2015 & beyond Accommodations, e. g. , bilingual, magnification Universal Design features, e. g. , text-to-speech, zoom 508 compliance Observable data capture Discrete item types and survey questions Disconnected mode Updates in the field supported Subject-specific tools, e. g. calculator, equation editor Adaptive testing TBD Dynamic distribution of forms TBD Automated scoring TBD 6

NAEP Alliance NAEP 2015 TBA Start Up § January 26 – March 6, 2015 § 132, 000 students § Administered on tablets § Mathematics, reading, and science § Grades 4, 8, and 12 § Interactive computer tasks (ICTs) and hands-on tasks (HOTs) in science 7

NAEP Alliance Equipment § Surface Pro 3 tablets § Laptop server § Routers and Ethernet cables § Mi. Fi device § Extension cords, power strips, and tape § Earbuds and headphones § Styluses § Flash drives § Antibacterial wipes 8

NAEP Alliance Surface Pro 3 Tablets – 27 Tablets § 25 Student tablets § 2 Monitor tablets 9

NAEP Alliance e. NAEP Network Equipment § Laptop server § Router § Blue Ethernet cable 10

NAEP Alliance Mi. Fi Device § Wireless device to send student response files from the laptop server to the central server 11

NAEP Alliance NAEP Earbuds § NAEP students keep earbuds § Headphones available when requested 12

NAEP Alliance Styluses § 30 Styluses § Re-use for all assessments 13

NAEP Alliance Flash Drives § 2 Flash drives § Used for disconnected mode assessments 14

NAEP Alliance 2015 Feedback Did students report (or did you observe) any problems with using any of the following? Choice Number of schools 1 = Touchscreen (specify) Percentage of schools 117 3. 5% 22 0. 7% 363 10. 8% 4 = Keyboard (specify) 52 1. 5% 5 = None of the above 2811 83. 5% 2 = Touchpad (specify) 3 = Stylus (specify) Source: Field Staff Session Debriefing Form 15

NAEP Alliance 2015 Feedback In your observations, did more students use the touchscreen, touchpad, or stylus? Choice Number of schools Percentage of schools 1 = Yes 2322 67. 1% 2 = No – How many did you have to plug in? 1136 32. 9% Source: Field Staff Session Debriefing Form 16

NAEP Alliance 2015 Feedback Did all the tablet batteries last the entire group? Choice Number of schools Percentage of schools 1 = Touchscreen 130 3. 7% 2 = Touchpad 201 5. 8% 3 = Stylus 1839 52. 9% 4 – Used equally 1307 37. 6% Source: Field Staff Session Debriefing Form 17

NAEP Alliance 2015 Feedback Overall, how would you rate the students' engagement in the TBA Assessment? Response 1 = Very engaged 2 = Somewhat engaged 3 = Not at all engaged Number of schools Percentage of schools 3152 89. 8% 349 9. 9% 10 0. 3% Source: Field Staff Session Debriefing Form 18