{"id":578,"date":"2018-09-07T16:18:12","date_gmt":"2018-09-07T16:18:12","guid":{"rendered":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/?p=578"},"modified":"2018-09-07T16:18:12","modified_gmt":"2018-09-07T16:18:12","slug":"remaking-marking-conference-university-of-reading-4-september-2018","status":"publish","type":"post","link":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/posts\/578","title":{"rendered":"Remaking marking conference \u2013 University of Reading, 4 September 2018"},"content":{"rendered":"<p>I attended this conference with Tharindu. There was a lot of familiar discussion around the rationale for online marking over paper marking and the key themes that came out of the presentations and discussions, e.g.:<\/p>\n<ul>\n<li>better student experience<\/li>\n<li>availability of learning analytics &amp; data yield<\/li>\n<li>marking rubrics enabling consistency of feedback<\/li>\n<li>technology making feeding back easier<\/li>\n<li>discrepancies between how students learn (using online content, digital libraries, etc.) and then being tested on paper;<\/li>\n<li>handwriting being \u2018a dying art\u2019<\/li>\n<li>increased efficiencies\/sustainability<\/li>\n<li>political motivations.<\/li>\n<\/ul>\n<p>Presenters included Dr Rachel Maxwell from the University of Nottingham (UoN), who spoke about the pedagogical transformation around marking that had taken place at the institution. UoN used an \u2018assessment &amp; feedback matters\u2019 focus group to drive through the change based on JISC\u2019s \u2018<a href=\"https:\/\/www.jisc.ac.uk\/guides\/transforming-assessment-and-feedback\/lifecycle\">assessment and feedback lifecycle<\/a>\u2019. The group wanted to design \u2018future-focussed assessment that would be marked explicitly against LOs\u2019 (i.e. rubrics are optional at UoN and feedback is provided against the LOs). Their priority was to design \u2018pedagogically valid\u2019 marking, and then, secondly, to find the technology to deliver it.<\/p>\n<p>Rachel told the conference that a common complaint from students was that they didn\u2019t understand why they had to wait so long for their results and she showed a fantastic graphic created by UoN students to help explain to their peers what is involved in the process and why assessment marking took so long. I really like the idea of students being involved in finding solutions on their learning journey \u2013 this echoes the type of active learning and problem-solving skills we want to enable for our students at UCEM, that they can apply both to their modules and \u2018real world\u2019 issues.<\/p>\n<p><a href=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2018\/09\/how-we-assess-your-work-uni-of-northampton.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-579\" src=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2018\/09\/how-we-assess-your-work-uni-of-northampton-300x225.jpg\" alt=\"how we assess your work uni of northampton\" width=\"648\" height=\"486\" srcset=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2018\/09\/how-we-assess-your-work-uni-of-northampton-300x225.jpg 300w, https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2018\/09\/how-we-assess-your-work-uni-of-northampton-768x576.jpg 768w, https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2018\/09\/how-we-assess-your-work-uni-of-northampton-1024x768.jpg 1024w\" sizes=\"(max-width: 648px) 100vw, 648px\" \/><\/a><\/p>\n<p><em>Source<\/em>: UCEM (2018) \u2018 \u2018How we assess your work\u2019 graphic by University of Northampton students\u2019, shown by Dr Rachel Maxwell of UoN at University of Reading \u2018Remaking marking\u2019 conference, 4 September 2018 [photograph]. Reading: UCEM.<\/p>\n<p>This theme of students contributing to solutions came up again following a conversation around using rubrics and\/or marking to learning outcomes, enabling consistent marking at faculty level. This led on to a discussion around how students engage with rubrics \u2013 what\u2019s useful to them \u2013 what does good rubric look like? \u2013 and the need for research in this area. Dr Emma Mayhew of University of Reading (UoR) talked about research by the educational psychologist Dr Naomi Winston (University of Surrey) which showed that whilst students could broadly define words such as \u2018consistency\u2019 they then had trouble translating what these terms meant in the context of their assessment. University of Surrey therefore worked with students to help them develop their own glossary of assessment terms.<\/p>\n<p>Something I found really surprising (in my innocence!) was that there also seemed to be a consensus among lecturers in the room that students don\u2019t read their feedback, or don\u2019t act on it, which led to a discussion around the merits of getting students to feed back on their feedback before marks are released to them. I wonder, do we need to \u2018educate\u2019 students more around their responsibilities as students; and\/or work with them to define their responsibilities?<\/p>\n<p>Emma Mayhew also mentioned an interactive clickable rubric resource that UoR are currently developing as a time-saving device. She also talked about audio feedback, which she uses, and which she finds saves her time (unlike video feedback which she found was more time-consuming). She reported that students responded well to a \u2018warm\u2019 human voice and found it reassuring, but she pointed out there was training to be done around ensuring tutors use the right tone of voice if they are using audio feedback.<\/p>\n<p>Dr Simon Kent from Brunel University said that in their experience students reported liking audio feedback for practical tasks but not for written content. It was also reported that students felt that quick marks were useful for non-disciplinary content, e.g. referencing, but that it was not so welcome for essay-type answers.<\/p>\n<p>Simon also spoke about the \u2018Bring your own device\u2019 for exams scheme using locked-down browsers at Brunel. He said that he had initially thought it would revolutionise assessment and marking but had sadly come to realise that in reality BOYD means we have come only a short distance over a long period of time. He said that BYOD works on traditional written questions and MCQs and that webcams are used for diagrams\/artwork. He said there was no evidence of any increase in cheating and that no group is disadvantaged by digital exams, though there is some evidence that mature students returning to study after a break are less comfortable with the concept. Students with a disability were not considered, which gives rise to the question about diagnostics testing to check students are able to use the technology before they can access it, and the need to provide alternatives if not. Also, embedding skills development and support into the learning.<\/p>\n<p>Dr Pete Lonsdale from Keele University talked about how he had mapped out the whole assessment and feedback process and had produced software that tracked and enabled assessment through its many stages including submission and feedback. He talked about how involved the process and design had been and how it fell over at several stages because the finer details had been missed. He also discussed the need for an online policy that includes many eventualities, e.g. protocol if students send in a virus-ridden file or if a file is misplaced.<\/p>\n<p>It was an interesting to hear how other institutions are encountering similar problems\/solutions to us, and\u00a0particularly to learn about the examples where students had been directly involved in resolving issues.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I attended this conference with Tharindu. There was a lot of familiar discussion around the rationale for online marking over paper marking and the key&hellip;<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[56],"tags":[32,57,58],"_links":{"self":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/578"}],"collection":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/comments?post=578"}],"version-history":[{"count":1,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/578\/revisions"}],"predecessor-version":[{"id":580,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/578\/revisions\/580"}],"wp:attachment":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/media?parent=578"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/categories?post=578"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/tags?post=578"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}