Case Study: Marking using Turnitin Grademark

Turnitin Grademark example

Origin

Various, University of Bristol

Tools used

Contact

Roger Gardner  roger.gardner@bristol.ac.uk

Background

Grademark is an on-screen marking system which is part of the Turnitin suite, and can be accessed via Blackboard. In the academic year 2012-13 initial small-scale pilots were carried out to start evaluating the system, and this case study reports on these. Since then the use of Grademark has increased and expanded into other Schools.

Objectives

The objectives of these initial pilots were to start to identify benefits and limitations of Grademark, for markers and students, and to help assess potential levels of interest in such onscreen marking tools in the future.

Main features of Grademark

Grademark allows Instructors to mark work online, without the need for documents to be downloaded or feedback uploaded. Documents submitted can be annotated onscreen, including highlighting of text, adding embedded comments, shared comments (for example to address common issues), rubrics (for example to target feedback at specific assessment criteria) , general comments and audio feedback.  Markers can also refer quickly and easily to the associated Turnitin originality report whilst marking, if they want to check if text used matches other sources, to help identify possible plagiarism. Currently Grademark can only be used when connected to the Internet, although an ipad app has recently been released which does allow offline marking.

What was done

Pilots took place in the Schools of Modern Languages and Physiology and Pharmacology,and the Department of Aerospace Engineering. Work was submitted to Turnitin via Blackboard. Staff added their feedback, some using shared comment banks, others creating their own comments. Students then logged in to Blackboard to access their feedback.  Approximately 25 staff took part, and over 800 papers were marked. Feedback on the pilots was obtained from 14 staff.

Outcomes

What worked well

  • Students liked the legibility of feedback and being able to access it quickly
  • Markers found Grademark fairly easy to access and use
  • Markers liked being able to customise and re-use comments, being able to add audio feedback, seeing data on student performance and being able to see Originality reports whilst marking
  • Some markers said that using Grademark encouraged them to annotate scripts more fully than otherwise, adding more detail and providing what they saw as higher quality comments

Problems and/or issues

  • Some difficulties for markers when using particular browser versions especially Firefox, or older PC operating systems , e.g. XP
  • Occasionally Grademark can be slow and lags when scrolling through work onscreen or saving comments
  • Too much time spent looking at a screen, especially when marking longer pieces of work
  • Sometimes students did not realise that their feedback was online (not an issue with Grademark itself, but confirms that students need clear instructions on how and where to access their feedback)

Suggestions and tips

  • Grademark may be more appropriate for some when marking shorter pieces of work
  • Make sure you try it out on your PC / browser before using it for real
  • Make sure that students know that their feedback is online and how to access it.
  • If markers are using shared Quickmark comments, make sure that they know they can also create and use their own
  • Comments are easier to use than rubrics.

Further information

Note: If you are interested in using Grademark please contact us in the first instance.