Pathways Project Evaluation l Objective 1 To change

Pathways Project Evaluation l Objective #1: To change classroom pedagogy and improve the ability of faculty to effectively integrate Internet-based tools and curriculum resources into their courses. l Objective #2: To increase the ability of P-12 teachers to integrate these same resources in their courses when they begin to teach.

Evaluation Focus l Faculty: focus is on changing what happens in the classroom ü Content ü Pedagogy l Students: focus is on better preparation ü Content learning ü Pedagogy

Major indicators of success l l The percentage of faculty members in the 33 project Community Colleges who effectively integrate these resources into courses attended by pre-service P-12 teachers will increase. The percentage of pre-service teachers among Community College graduates who have themselves used (in their CC classes), and have observed others use (through observation and service learning), these resources will increase.

Impact on faculty will be measured by… ü Adaptation of existing, or creation of new, RWLOs for use in courses ü Increased use of RWLOs in courses ü Course redesign to accommodate use of RWLOs ü Changes in pedagogical practice (less directed, more inquirybased; less lecture, more exploration) to accompany use of RWLOs ü Development of new assessments of student work in order to evaluate effective use of RWLOs ü A demonstrated understanding of the role of Internet resources in the classroom ü Increased sharing and communication among SCP participants, both across colleges and within each college

Journey maps In addition to objective indicators of success, we will develop “journey maps” for selected SCP Participants to assess process and transformation. Journey maps are a series of benchmarks, placed on a timeline, that include critical moments as well as more “objective” indicators of success. Individual journey maps can then be compared to see where the gaps and break points occur.

Impact on P-12 teachers will be measured by… ü Increased use of RWLOs in classes they take ü Increases in learning through use of RWLOs as measured by embedded assessments ü A demonstrated understanding of the role of Internet resources in the P-12 classroom, as gained through coursework and pre-service learning experiences

Groups to include in evaluation ü ü ü Lead SCP Professors (2 -3 at 3 partner community colleges): develop RWLOs, develop SCP Sessions, and teach SCP Beta Cohort 1 Participants (3+ at 3 partner community colleges = 9+): take SCP Beta course; develop RWLOs as part of course; use RWLOs in own courses Cohort 2 Participants (24 at 3 partner CCs = 72): as Cohort 1 but more participants Cohort 3 Participants (4 at 12 new CCs = 48): as Cohort 2 but at new institutions Cohort 4 faculty (4 at 18 new CCs = 72): as Cohort 3 but at additional institutions Pre-service students of participating faculty

Data sources, 1 l Questionnaires ü SCP Professor, RWLO Developer, and Session Developer Baseline Survey (all Cohorts) ü SCP Professor Post-Session Evaluation (Cohort 1 - Beta) ü SCP Professor Final Course Evaluation (all Cohorts) ü ü ü SCP Participant Registration (all Cohorts) SCP Participant Baseline Questionnaire (all Cohorts) SCP Participant Post-Session Evaluation (Cohort 1 - Beta) SCP Participant Final Course Evaluation (all Cohorts) SCP Participant Follow-Up Survey (all Cohorts, annually)

Data sources, 2 l Interviews (in-person and phone) ü SCP Faculty (all): annually ü Cohort 1 and 2 Participants (all): at end of course and end of academic year (annually) ü Cohort 3 and 4 Participants (sample): at end of course and end of academic year (annually) l Site visits ü Years 1 and 2: Cohort 1 and 2 campuses ü Years 3 and 4: Sample of Cohort 3 and 3 campuses l Online learning community (content and network analysis)

Data sources, 3 l Artifacts/documents ü RWLO peer reviews ü SCP Participant course syllabi ü Logs of RWLO use l Student artifacts ü Internet use assessment (assessment of effective student use of Internet tools and resources)