Data Carpentry values a culture of assessment, and we are consistently evaluating our workshops to understand the impact workshops have and how we can improve.
Dr. Kari L. Jordan, our Deputy Director of Assessment, leads our assessment efforts.
Dr. Erin Becker, our Associate Director serves as Principle Investigator for our research efforts related to assessing the effectiveness of our workshops. This work is carried out under supervison of the Institutional Review Board at University of California, Davis. Our faculty sponsor at UC Davis is Dr. Megan Welsh, Assistant Professor within the UC Davis School of Education.
We conduct pre and post workshop surveys for each workshop
Additionally, we began collecting data on the long-term impact our workshops are having on both Data Carpentry and Software Carpentry learners. The Carpentry Long-Term Feedback Survey was launched in March 2017, and data will be collected every 6 months.
Data sets to go along with assessment reports are provided as csv files in a GitHub repository, along with the version of the surveys that were in use at time of analysis.
We will be releasing regular reports from our survey results. These reports are published through Zenodo and can be accessed through the links below.
The analysis in this report serves the following purposes:
- To inform the community of the impact Data Carpentry workshops have made on its learners.
- To provide context for the survey responses as they relate to Data Carpentry learners.
- To discuss what Data Carpentry is doing well, areas of improvement, and questions we should be asking.
The report finds that learners are reporting that after a workshop, their level of data management and analysis skills have increased, they have increased confidence in their ability to use these skills and that the learners have increased appreciation for these skills (i.e. scripting) to improve and promote reproducible research. 95% of learners agree or strongly agree that they would recommend the workshop to a colleague.