Assessment

Data Carpentry values a culture of assessment, and we are consistently evaluating our workshops to understand the impact workshops have and how we can improve.

Dr. Kari Jordan, our Deputy Director of Assessment, leads our assessment efforts.

Dr. Erin Becker, our Associate Director serves as Principle Investigator for our research efforts related to assessing the effectiveness of our workshops. This work is carried out under supervison of the Institutional Review Board at University of California, Davis. Our faculty sponsor at UC Davis is Dr. Megan Welsh, Assistant Professor within the UC Davis School of Education.

Please see our IRB proposal and determination letter for more details about our research efforts.

Surveys

We conduct pre and post workshop surveys for each workshop

Data

Data sets to go along with assessment reports are provided as csv files in a GitHub repository, along with the version of the surveys that were in use at time of analysis.

Data for Assessment report 2016-10-20

Assessment results

We will be releasing regular reports from our survey results. These reports are published through Zenodo and can be accessed through the links below.

Assessment report 2016-10-20 DOI

The analysis in this report serves the following purposes:

  • To inform the community of the impact Data Carpentry workshops have made on its learners.
  • To provide context for the survey responses as they relate to Data Carpentry learners.
  • To discuss what Data Carpentry is doing well, areas of improvement, and questions we should be asking.

The report finds that learners are reporting that after a workshop, their level of data management and analysis skills have increased, they have increased confidence in their ability to use these skills and that the learners have increased appreciation for these skills (i.e. scripting) to improve and promote reproducible research. 95% of learners agree or strongly agree that they would recommend the workshop to a colleague.