Working towards research that is more reproducible and open
Luke W. Johnston
March 31, 2023
Who am I? 👋
- Team Leader at Steno Diabetes Center Aarhus and Aarhus University, Denmark
- Research/work:
- Teach researchers how to be reproducible
- Build software to automate/streamline research
- Do epidemiological research
Goals of this talk 🔈
Spread awareness of tools and resources for doing reproducible research (plus examples)
- Helper R 📦:
- Example projects:
What is reproducibility? 🤔
Question: If you had to explain reproducibility vs replicability to everyone, right now, could you?
Reproducibility: Same data + analysis = same result?
- Like baking: Data = ingredients, analysis = recipe
- HOW EXACTLY a result was determined in a study
- Independent reproduction = success
We don’t share as much as we should
Why are reproducible and open practices important right now? 🤷🤔
They are part of multiple large trends like team science, computing, meta-research, higher quality/rigor
Both reproducibility and open science are on a spectrum
🔑 Independently get the same result with same data and analysis
- Can someone else bake the same food without either of the ingredients or the recipe?
Simple, tangible steps to being more reproducible (in R)
- Use RStudio R Projects (
.Rprojfiles) and the{here}package - Use standardized project folder/file templates (e.g.
{prodigenr}package) - Using Quarto (or R Markdown)
Think 💭 then share 🗣️ activity
1 minute to think, after we’ll share 🤩
How do you work when doing data analysis? How do you try to be more open and reproducible?
What are some benefits to being more open and reproducible?
What are some challenges or barriers?
Revelant examples from my work
Reproducible Research in R courses
Main page at r-cubed.rostools.org
Introductory course: r-cubed-intro.rostools.org
Intermediate course: r-cubed-intermediate.rostools.org
Advanced course: r-cubed-advanced.rostools.org
Collaborative UK Biobank project at Steno
Scoping review on current literature on open collaboration
Seedcase: Software to improve transparency and openness of managing data
Licensed under CC-BY 4.0. Slides at slides.lwjohnst.com
Working towards research that is more reproducible and open Luke W. Johnston March 31, 2023