The Open Science Framework Improving Openness and Reproducibility
The Open Science Framework: Improving Openness and Reproducibility of Scientific Research Matt Spitzer Community Manager Center for Open Science @matthewspitzer matt. spitzer@cos. io @OSFramework http: //cos. io/ | http: //osf. io
Today’s workshop 1. Plan for reproducibility before you start ● ● ● Create a project on the OSF Begin study documentation Preregister your project 2. Keep track of things ● ● Use version control Connect your research services 3. Archive + share your materials ● ● Make materials public Increase your impact
http: //osf. io free, open source
Open Workflows
Technology to enable change Training to enact change Incentives to embrace change
Free Open Inclusive
Open Workflow OSF More than just data access, sharing, and compliance
Manage + document research for: ● Single experiment or study ● Single publication ● Lab group or research organization ● Grant ● Meeting or conference ● Institution http: //osf. io free, open source
1. Create an OSF project
1. Wiki, file tree, components, citation, GUID
1. Giving contributors access
1. Creating a wiki
1. Adding organizational structure components
1. How to preregister
2. Version control
2. Version control
1. Add-ons
Put data, materials, and code on the OSF Check out “Fish Guy’s” Story: http: //www. wired. com/2016/01/print-an-army-of-giant-articulated-fish-from-this-3 -d-database/
Get a persistent identifier https: //osf. io/tvyxz/
Easy Collaboration control and granular permissions
3. Share your work
3. Increasing discoverability
See the impact File downloads
Other OSF features Managing Projects Sharing Projects Collaborating ● ● ● ● ● Creating a Project Creating Components Adding Contributors Uploading files Logs Using the project organizer Bookmarks Connecting Add-ons ● ● ● ● ● Enabling Add-ons Box Dropbox Github Mendeley Zotero figshare Dataverse 19 more coming soon Privacy controls View-only links Applying a license Citations with persistent IDs Metrics Tags - files and projects Files and Version Control ● ● ● Drag and drop interface Revisions and versions Folders Download Counts File checkout Wikis Notifications Commenting Forking and Linking projects User profile data Forums (Coming Soon) Registering Projects ● ● ● What are registrations Explanation of Registration Templates Embargoes DOIs/ARKs Retractions Security and Privacy ● ● ● 2 -factor authentication Backup scheme Security information (FAQs)
OSF Open. Sesame 29 grants to develop open tools and services: https: //cos. io/pr/2015 -09 -24/
OSF for Institutions https: //osf. io/ba 3 dy/ integration with local services
Institutional affiliation on project pages
OSF for Institutions Provide visibility for ongoing and unpublished research Insight and data on research collaboration Serve as a commons for interdisciplinary research Access point to public and private research workflows Evaluate impact of research investment beyond citations Connect services and eliminate silos
Connecting the workflow is critical to enabling change
Training to enact change
Stats + methods training http: //cos. io/stats_consulting free stats + methods training
Stats + methods training
Incentives to embrace change
TOP Guidelines Transparency and Openness Promotion Low barrier to entry Modular Agnostic to discipline http: //cos. io/top guidance on open policies
TOP Guidelines http: //cos. io/top 1. 2. 3. 4. 5. 6. 7. 8. Data citation Design transparency Research materials transparency Data transparency Analytic methods (code) transparency Preregistration of studies Preregistration of analysis plans Replication
Transparency & Openness Promotion Guidelines 1. 2. 3. 4. 5. 6. 7. 8. Eight Standards Data citation Design transparency Research materials transparency Data transparency Analytic methods (code) transparency Preregistration of studies Preregistration of analysis plans Replication Three Tiers 1. Disclose 2. Require 3. Verify Signatories 539 Journals 59 Organization Learn more at http: //cos. io/top
Signals: Making Behaviors Visible Promotes Adoption
% of Articles reporting that data was available 100% 75% 50% 25% 0% Reportedly available Available Correct Data Usable Data Complete Data
The $1, 000 Preregistration Challenge Endorse TOP Guidelines Badges for Open Practices Registered Reports http: //cos. io/prereg
What can you do?
1. Contact us about interest in using OSF for your lab or institution matt. spitzer@cos. io 2. Promote Prereg Challenge http: //cos. io/prereg/ 3. Contact editors in your field about the importance of implmenting Transparency and Openess Promotion Guidelines cos. io/top 4. Schedule OSF-Reproducibility Workshops https: //cos. io/stats_consulting/ 5. Your feedback on these efforts 6. Connect to relevant developer communities to connect services to your workflow
Connect your services to make it easier to be more open and reproducible
- Slides: 43
