APS Wikipedia Initiative Using Wikipedia Writing in Psychology

APS Wikipedia Initiative: Using Wikipedia Writing in Psychology Classes Rosta Farzan & Robert Kraut Human Computer Interaction Institute Carnegie Mellon University

Who we are l Robert Kraut Professor, Social psychologist & human-computer interaction, Carnegie Mellon – Used Wikipedia writing in two courses – l Rosta Farzan Assistant professor, Information sciences, University of Pittsburgh – Primary developer for Association for Psychological Science/Wikipedia Initiative tools – l Paula Marentette Professor of Psychology, University of Alberta – User Wikipedia writing in one class – l Jami Mathewson – Higher education initiative, Wiki. Media Foundation

Outline l Introduction to Wikipedia l The APS Wikipedia Initiative l Why use Wikipedia writing assignments in class l Tips for creating an assignment l Challenges l Resources – WMF Educational Initiative – APS Wikipedia Initiative Portal

Why use Wikipedia writing assignments in your class? l Improves what the general public knows about psychological science l Provides high quality learning experiences for students

Highly popular l Wikipedia is one of the top five visited web sites l Wikipedia has over 400 million unique visitors per month comprising 11. 7 billion page request a month, which represents 5% of the world population

Major source of information on most psychological concepts

Yet many Wikipedia articles on psychology were impoverished or out of date b t u t n e S t n A o c o n y l l a u s t r d i r s o e • V c w n 0 e r 5 e f • 3 e r o N •

Wikipedia: Behind the article covers

APS is calling on its Members to support the Association’s mission to deploy the power of Wikipedia to represent scientific psychology as fully and as accurately as possible and thereby to promote the free teaching of psychology worldwide.

Initiative is producing gratifying amounts of high quality work 126 Ph. D psychologists l 36 psychology classes with 752 students l Collectively improved more than 1, 250 Wikipedia articles (~18%) and wrote over 3, 000 pages of text l Users # editing articles Articles edited Words added All Ph. Ds Students 603 67 535 826, 636 107, 267 720, 021 l 1079 256 749 Students do more work than Ph. D psychologists at comparable quality

ew al n i g i bio • Or bing om c e l rtic • 1 a theory and ons: 7 cti • Se 831 : s d r 0 • Wo es: 5 g a es: 7 • Im c n fere links: • Re nal r e t Ex • • N bio ory ith the w s from e g pa ed 7 • 2 arat : 2 p s e n s 69 io t 6 , c e • S s: 5 d r 1 o 35 : • W ges: s e 18 a c : n m s I e • fer al link e • R n ter x • E

The assignment is valuable for students l Strongly motivating An authentic writing assignment – Their work is seen by thousands – l Learning opportunities Mastering a topic in psychology – Reading the research literature – Writing for the general public – Learning how Internet knowledge is produced –

Recognition – Did You Know?

Students found Wikipedia assignments effective in learning l Topic of the article they edited l Norms and culture of Wikipedia community l Technical aspects of Wikipedia

Quotes from faculty Students are highly motivated and proud that their work will be a public document that they can share with parents and friends and it is really beneficial for them to write it.

Quotes from faculty Majority of students take the assignment very seriously and they are very excited about the broad audience and they work really hard on the article…. The assignment helped them become more informed about how Wikipedia works and even though they were junior students their contribution improved the articles substantially (an important contribution to the field)

Wikipedia assignments came in a variety of formats l Class size & level Typical is upper-level undergrad lecture or seminar, with ~20 students – Graduate seminars – 1, 700 -student introductory class – l Small or substantial contributions l Write solo or in small team. – Some evidence that team writing is most effective

Typical Wikipedia assignments l Edit an article related to class Improve a poor quality psychology article to “good article” status – Write a new article – Add a new section – Add references – Review classmate’s work (in a minority of classes) l Write a reflective essay l The rationale for article edits – What you learned about psychology – What you learned about Wikipedia community –

Typical time-line Intro to Wikipedia & the assignment l Students get familiar with Wikipedia & editing l Create user page, write on a talk page – Read tutorials & policy pages – l Select article From list precompiled by instructor – Identified by student, with instructor’s permission – l Evaluate the selected article Analyze areas for improvement in the article – Identify the relevant, current literature – Propose plan for improvement – Describe plans on article’s talk page –

Typical time-line (cont) l Revise out of public view Wikipedia sandbox – Word or Google document – l Get feedback from peers & instructor In class – On-line – Explicit peer review –

Typical time-line (cont. ) Post updates to the public article l If appropriate, nominate for ‘Did You Know” review. l New article – Existing article expanded 5 x – If appropriate, nominate for ‘Good Article’ status l Respond to community comments & revise l Write self-reflection essay l Grade l

Typical grading rubrics l Letter grades for quality of contribution Final Article – Reflective essay – Relaxed grading: pass/fail for effort l Detailed grading for different pieces of the assignment l – E. g. , Points for creating account, creating user page, picking article, critiquing article, planning edits, reviewing peers, final article, reflective essay

Wikipedia editing can be hard l Students need to learn: A psychology topic in depth – Wikipedia technology for editing – Wikipedia norms & culture – l Faculty spend more effort than on a typical term-paper assignment Students receive the most feedback from their professor and less from other students or Wikipedia community – Since article is a public document, faculty feel some responsible –

Clash between academic and Wikipedia values over writing goal l Neutral point of view & no original content Terms papers and literature reviews should make an argument – Wikipedia articles should only include information from authorities sources – Editors shouldn’t draw conclusions or argue a position –

Clash between academic and Wikipedia values over reliable sources Scientists value peer reviewed journal articles l Wikipedians prefer secondary sources l “Articles should rely on secondary sources whenever possible. For example, a review article, monograph, or textbook is better than a primary research paper” – “Articles should be based mainly on reliable secondary sources, published sources with a reputation for factchecking and accuracy. This means that we only publish the opinions of reliable authors, and not the opinions of Wikipedians who have read and interpreted primary source material for themselves. ” – l If your students get this response, push back on an article’s talk page

Responding to feedback Follow the Bold-Revert-Discuss cycle l If feedback is reasonable, accept the criticisms & fix problems l If feedback is not reasonable, l Revert unwarranted changes – Argue your position on the article talk page –

DEMO 30

Signup

Signup

Your profile

Finding articles

Register a course

Tracking students’ activity

Tracking students’ activity

Constructing course timeline

Following editors/articles/classes

Help pages

Step by step tutorials

Support for research NSF funded project l We built tools to support classes in selecting articles, editing & interacting with the Wikipedia community l Our research evaluates their effectiveness l Surveys for you and your students – Random assignment experiments with tools – Some features might be available to a random set of students l Opt-out if you do not want your class to participate l

Questions? l Robert Kraut, robert. kraut@cmu. edu l Rosta Farzan, rfarzan@pitt. edu