University of Exeter revolutionises online assessment, reduces marking, and eliminates attainment gaps
The University of Exeter bioscience staff needed to redesign assessment in their Analytical Techniques in Biochemistry module when increasing cohort numbers were causing marking workloads to become unsustainable.
After partnering with LearnSci, they were able to offer more support, improve performance and utilise resources before, during and after the pandemic. Their unique approach to online assessment was celebrated by the community and their findings published in the Journal of Chemical Education.
The Challenge:
Increased assessment demands from growing student numbers
At the University of Exeter, Dr. Alison Hill and Prof. Nicholas Harmer have been running the Analytical Techniques in Biochemistry module for over ten years. The course - taken by Second Year Biosciences students - introduces state of the art methods used in biochemical research and the techniques used to examine protein structures and properties. When first introduced, the module would be taken by 30-40 students, who would all complete two lab reports.
However as student numbers grew, staff realised that it was unsustainable for them to manage the increased marking burden. They needed an approach that was scalable as each incoming cohort increased in numbers.
Initially, this involved replacing one lab report with a data processing section in the exam. Students would collect data in groups and analyse it in their assessments. This was challenging for students, particularly those who had no post-16 mathematics qualifications. The notable attainment gap between students with differing maths experience and the difficulty providing feedback on an individual basis revealed further intervention was needed.
.png)
The Solution:
Efficient feedback, multiple opportunities to practise, and future-proof assessments
The Biosciences team was able to develop digital resources alongside LearnSci to teach and assess students' understanding of techniques in the module. This offered benefits before, during and after the pandemic restrictions.
Before covid: Improving mathematics and data processing skills
In 2017, Dr. Hill was appointed as an Exeter Education Incubator Fellow. Her goal was to find ways in which the students' confidence with numbers and data processing could be improved. She began working with LearnSci to create a custom Smart Worksheet that focused on the data processing skills assessed in the module.
Students were invited to use the worksheets in computer labs to analyse and process their own data individually. These formed the basis of formative assessment, and staff were able to provide feedback to individual students based on their worksheet progression and scores.
Additionally, students would submit data that they had generated which was then added to the online dataset to be used for future years. This allowed students to practise their calculations repeatedly with historical datasets generated by real students.
After covid: Individual fair assessments and bespoke lab demonstration videos
During the summer of 2020, with no guarantee that students would have access to labs, Dr. Hill and Prof. Harmer put into place a series of course adaptations to ensure their students were still able to experience practical techniques throughout the module.
Bespoke videos were created of staff demonstrating the experimental techniques featured in the labs. With the help of a videographer, the videos showed details of processes from different angles and perspectives to ensure the best visualisation was available. Complementary LabSims were used alongside the videos, with students asked to complete simulations of the techniques shown. The combination of these methods allowed students to consolidate underlying theory, see how to perform techniques, and demonstrate each step in detail.
Assessments were moved online, but this caused two major problems. Firstly, students were no longer able to collect their own data to be analysed in the final exam. Secondly, there was a risk that supplying datasets to all the students and offering an non-invigilated exam would present opportunities for collusion.
Therefore, the historical datasets generated by previous years of students were used to create individual data, to be used by each student for their exam. Using an R script, the datasets and corresponding answer sheets were generated and randomly assigned, meaning each student would have their own tailored data that could be processed in the exam.
.jpg)
The Results:
Average performance increased from 46% to 72%
After introducing Smart Worksheets to the module, there was a significant increase in the average grade for the data processing part of the final exam. This stayed consistently high after the exam was moved online during the pandemic, with students still achieving an average grade of 69%.
Students rated LabSims 4.3/5
Attainment gap eliminated
The introduction of Smart Worksheets also had a huge impact on staff workloads and student performance. The immediate feedback and automated grading meant students became more confident in their skills and staff were able to devote more time to those that really needed it.
Introducing these digital approaches before COVID-19 future-proofed module assessment, and made the transition to online delivery that much easier. Adopting LabSims to use alongside bespoke recorded videos allowed students to become familiar with techniques and actively learn during restrictions.
Smart Worksheets helped students understand data processing as well as master skills needed in science, such as rounding and significant figures. The use of the historical datasets allowed students access to authentically generated data that was used to prepare and complete their final exam.
Now that students are back in labs, they’re saving time by completing labs faster. They’re arriving at labs asking better questions and are more confident. Moreover, students appreciate labs, understanding that the resources aren’t replacing practical labs but complementing them.
Spreading best practice and continuing student support
Dr. Alison Hill and Prof. Nicholas Harmer are planning to continue their work using individual datasets, and to introduce the Smart Worksheets in more topics across biosciences. Their novel approach to achieving robust and fair online assessments has been celebrated by numerous academics and their findings recently published in the Journal of Chemical Education and the JISC Digital Culture collection.
The LabSims have continued to be of use in preparing students for the lab. They have also provided staff the opportunity to expose students to more techniques that previously could not be explored due to expense of equipment and time consuming processes that aren’t feasible in teaching labs.
LearnSci resources can enhance your student’s learning experiences while reducing staff workload. Request a demo to learn more about how LearnSci can work with your institution.