Brief intro to Open Neuroimaging Verena Heise MRI
Brief intro to Open Neuroimaging Verena Heise MRI grad programme
What is Open Science?
Andreas E. Neuhold, Six Open Science Principles, https: //en. wikipedia. org/wiki/Open_science
Why do I care?
Fang and Casadevall, Infection and Immunity, 2011, 79: 3855 -3859
What can we do?
Open Science https: //osf. io/tvyxz/wiki/home/
Open Science https: //osf. io/tvyxz/wiki/home/
Open Data • WIN Open imaging data strategy is work in progress • Organise data according to BIDS format: http: //bids. neuroimaging. io/ • Publish summary stats results on https: //neurovault. org/
Open Science https: //osf. io/tvyxz/wiki/home/
Open Materials • FSL • Share your MR protocols • Share your tasks • Publish the analysis scripts (ALL of them and make them readable ) => WIN gitlab site (git. fmrib. ox. ac. uk)
Open Science https: //osf. io/tvyxz/wiki/home/
Pre-registration • Write up your hypothesis, study design and detailed analysis pipeline (introduction and methods) • Pre-register it online (e. g. on OSF) or use registered report • Registered report means your study will be published IRRESPECTIVE of results, purely based on scientific merit => you get feedback before you collect the data => you can put it on your CV before you have finished the study • More info on pre-registration: https: //tomstafford. staff. shef. ac. uk/? p=573 and registered reports: https: //cos. io/rr/
Pre-registration Munafo et al. , A manifesto for reproducible science, https: //www. nature. com/articles/s 41562 -016 -0021
Open Science Open Reporting
Open Reporting • Publish ALL the analyses you did (pre-registered and exploratory) • Publish ALL results (not just “significant” ones) • Publish according to best practice guidelines
Open Reporting
Open Reporting • Publish ALL the analyses you did (pre-registered and exploratory) • Publish ALL results (not just “significant” ones) • Publish according to best practice guidelines • Use preprints • Publish Open Access
Open Reporting https: //git. fmrib. ox. ac. uk/open-science/Documentation/wikis/home
Good Scientific Practice
Ask the right question • Do a proper literature review, look for systematic reviews and meta-analyses, where are the gaps? • Speak to clinicians • Talk to your colleagues • Via patient and public involvement (PPI) initiatives, e. g. James Lind Alliance • Find out priority areas for funders and policy makers
Good Scientific Practice
Design your study properly
Statistical power
Statistical power • Median statistical power in neuroscience: 21% • Median statistical power in animal studies: between 18 – 31% • Median statistical power in neuroimaging: 8% => chance of false negative = 1 -power => “the likelihood that any nominally significant finding actually reflects a true effect is small” (low positive predictive value)
Sample size calculation - example • Effect size = Cohen’s d of 0. 5 (medium effect) • Statistical power to find effect = 90% • alpha = 0. 05 • One sample one-tailed t test Þ 36 participants • Independent groups two-tailed t test Þ 86 participants per group
Sample size calculators • General statistical power: http: //www. gpower. hhu. de/en. html • f. MRI power tools: http: //neuropowertools. org/ http: //fmripower. org/
Do you need to collect new data? • UK Biobank • Human Connectome Project • Many other collaborations, e. g. in disease-specific areas
Good Scientific Practice Sidney Harris, What’s so funny about Science? (1977)
Reproducible workflows • Keep an electronic labbook • Script as much as you can • Helpful tools: R Studio: https: //www. rstudio. com/ R Markdown: https: //rmarkdown. rstudio. com/ Python: https: //www. python. org/ Jupyter Notebook: https: //jupyter. org/
Reproducible measures • Validity (Can I get the right answer? ) • Reliability (Can I get the same answer twice? ) Reliable Not Valid Not reliable Not valid Both reliable and valid
Robust Research - summary • Open Science • Data • Materials • Reporting (and pre-registration) • Good Scientific Practice • Relevant research question • Statistical power and procedures • Reproducible workflows • Reproducible measures (validity, reliability, QC procedures)
Robust Research - summary PRE-REGISTER (or use Registered Reports)
https: //en. wikipedia. org/wiki/The_Scream
Want to know more? • WIN Open Imaging website coming soon • Journal club @ New Radcliffe House, Fridays at 1 pm, @Reproducibili. T • Seminar series, Wednesdays at 4. 30 pm: http: //users. ox. ac. uk/~phys 1213/Repro. At. ASC. html • Software/ data carpentry workshops: https: //rroxford. github. io • Become a WIN Open Imaging Ambassador • Ask me (slides on https: //osf. io/5 rfm 6/)
Questions or comments? verena. heise@ndph. ox. ac. uk
- Slides: 40