{"id":1971,"date":"2021-09-06T13:26:37","date_gmt":"2021-09-06T13:26:37","guid":{"rendered":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/?p=1971"},"modified":"2021-09-09T08:38:14","modified_gmt":"2021-09-09T08:38:14","slug":"investigating-new-assessment-technologies","status":"publish","type":"post","link":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/posts\/1971","title":{"rendered":"Investigating new assessment technologies"},"content":{"rendered":"\n<p>Assessments matter to students. They are a way to demonstrate knowledge and mastery, and provide an invaluable learning experience. In 2020 due to necessity UCEM moved away from in-person real-time exams and delivered a mixture of computer marked assessments (CMA) and take-home exams. The results were positive and it is clear that the pandemic offers us the opportunity to rethink many of our ingrained and sometimes outdated approaches, in particular the idea that exams are the only way to assess.<\/p>\n\n\n\n<p>The UCEM Learning, Teaching and Assessment Strategy (2020 \u2013 2025) underpins the educational ambitions set out in UCEM\u2019s Vision and Strategy to 2025, and defines six strategic priorities for the upcoming five years:<\/p>\n\n\n\n<ul><li><strong>Student Centred<\/strong>: Putting students at the heart of everything we do<\/li><\/ul>\n\n\n\n<ul><li><strong>Industry Excellence<\/strong>: Creating built environment professionals of the highest calibre<\/li><\/ul>\n\n\n\n<ul><li><strong>Widening Access and Participation<\/strong>: Offering different pathways; welcoming more diversity; improving accessibility<\/li><\/ul>\n\n\n\n<ul><li><strong>Student Outcomes<\/strong>: Maximising every student\u2019s potential<\/li><\/ul>\n\n\n\n<ul><li><strong>Student Satisfaction<\/strong>: Providing a positive, engaging, and rewarding education<\/li><\/ul>\n\n\n\n<ul><li><strong>Strategic use of Technology<\/strong>: Using technology wisely to support our vision<\/li><\/ul>\n\n\n\n<p>Assessment and feedback are golden threads that weave their way through these strategic priorities. UCEM plans to transform assessment from the traditional use of summative examinations and assignments to fully integrated experiential assessment methodologies, utilising technologies to enhance the student assessment literacy and success.\u202fThe first step in this approach is to pilot a set of new assessment methodologies and tools on a group of pre-agreed modules.\u202f\u202f After consideration of the existing assessment process the team working on assessment redesign have been looking at the purchase of an assessment platform.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Assessment platform<\/h2>\n\n\n\n<p>UCEM makes considerable use of CMAs and they are a cost-efficient scalable assessment solution that can reduce marking resource (due to automation) and provide instantaneous feedback to students. Currently they are created and stored within the UCEM VLE (Moodle) using Moodle quiz and question banks. While Moodle has been an appropriate tool for this purpose, investigation identifies that the existing CMA writing process\u202fat UCEM\u202fis complex\u202fand time consuming; and that the CMAs created are limited in functionality. With this in mind the procurement of an assessment platform should\u202fbe seen as an opportunity to improve the assessment workflow process and ideally move beyond delivery of online tests to a new transformative assessment approach. A platform is much more than a CMA system and will help us streamline existing process.\u202f<\/p>\n\n\n\n<p>Earlier in the year through a process of research we short-listed four assessment platforms:<\/p>\n\n\n\n<ul><li><strong>Better examinations<\/strong>:\u202f<a href=\"https:\/\/www.betterexaminations.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.betterexaminations.com\/\u202f<\/a><\/li><\/ul>\n\n\n\n<ul><li><strong>Inspera<\/strong>:\u202f<a href=\"https:\/\/www.inspera.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.inspera.com\/\u202f<\/a><\/li><\/ul>\n\n\n\n<ul><li><strong>Wiseflow<\/strong>:\u202f<a href=\"https:\/\/europe.wiseflow.net\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/europe.wiseflow.net\/\u202f\u202f<\/a><\/li><\/ul>\n\n\n\n<ul><li><strong>Questionmark<\/strong>:\u202f<a href=\"https:\/\/www.questionmark.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.questionmark.com\/<\/a><\/li><\/ul>\n\n\n\n<p>The assessment tools were selected for their potential in a number of areas including writing, delivery and grading workflow; increased question types (calculations, video, drawing, labelling images, graphing, classification etc.), the ability to use existing tools (like excel) in assessment, use in of the tool when student has a poor or limited connection; the ability to set up different sittings for the same exam for students with disability packages, improved moderation and branching in questions.<\/p>\n\n\n\n<p>Two of these platforms have recently been considered in more detail through a formal systematic testing and evaluation process. During this process we have utilised the expertise of many UCEM staff. We won\u2019t name individuals but would like to make particular mention of the Digital Education team (Digital Education, Learning Technology, Core Services, SITs team, Editorial and quality, IT, information governance and library, media team), Academic registry (Assessment team, academic standards and timetabling) and our academics.<\/p>\n\n\n\n<p>We are now pleased to announce that we have now signed a contract to pilot the assessment platform Inspera over the forthcoming year.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Inspera<\/h2>\n\n\n\n<p>Inspera is a Scandanavian assessment platform and is used by a growing number of UK HE institutions including Bath, Oxford, BPP and Newcastle.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"670\" height=\"337\" src=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/image.png\" alt=\"Inspera logo\" class=\"wp-image-1965\" srcset=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/image.png 670w, https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/image-300x151.png 300w\" sizes=\"(max-width: 670px) 100vw, 670px\" \/><\/figure>\n\n\n\n<p>The platform has an impressive amount of functionality at all stages of the assessment process. There are over 20 types of questions, the vast majority of which are automatically marked. Rubrics can be added at the question level and question sets can be shared and tagged. Test\u202fsittings can be built specifically for learners with additional needs and saved as templates. Templates can be set up to\u202fchoose questions from a question pool and\u202fbranch depending on scores.\u202fStudents can be given a question choice\u202fwhich allows them to view all available questions and then select which\u202fquestion\u202fthey wish to answer. The test environment can be\u202fcustomised\u202ffrom the admin side and there are multiple accessibility options for the student.\u202fThere is strong student support and while a test is\u202fin progress Inspera\u202fallows Admin users to\u202fsend notifications to candidates.\u202fCandidates taking tests are shown on the admin\u2019s monitoring\u202fpanel and if a candidate is disconnected for more than couple of minutes\u202fit is indicated as such.<\/p>\n\n\n\n<p>Where\u202fInspera\u202fexcels is in its handling of workflows in relation to authoring and marking. The use of committees allows marking groups and moderation options. Inspera allows efficient marking of open question types, with precise annotations and criteria-based marks, tailored by workflow configuration allowing for double-blinded marking. Notes can be written when marking and kept private or shared with other markers or students. Markers can mark entire tests or just\u202fparticular questions\u202ffor all students. Feedback is comprehensive and can take various forms. The analytics for questions and for tests are comprehensive. They include scores, time on questions, question order, attempts and correlation between question and total score.\u202fThe system is continually evolving as their openly available roadmap indicates.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"560\" height=\"348\" src=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/insperainterface2.jpg\" alt=\"\" class=\"wp-image-1978\" srcset=\"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/insperainterface2.jpg 560w, https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-content\/uploads\/2021\/09\/insperainterface2-300x186.jpg 300w\" sizes=\"(max-width: 560px) 100vw, 560px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">The bigger picture<\/h2>\n\n\n\n<p>The assessment platform and other related technologies chosen are only one piece of the puzzle in the move towards authentic, high-quality assessments that are appropriate for students and for staff. Other work streams will consider the assessment process in more detail, data connected to assessments and the infrastructure ramifications of implementing the described systems. There may also be policy implications of changes in our approach. Later on there will also be opportunities to consider continuous assessment, through ePortfolios and other reflection approaches, and student assessment literacy through the use of peer review. In delivering any new technologies we are keen to ensure that we include the student-voice in decisions and involve (and inspire) academics, especially in future assessment design approaches. Watch this space for more on how to get involved.<\/p>\n\n\n\n<p>There is still much work to do but UCEM are now taking a more holistic and student-focused view of assessments that encompasses academic integrity, building of competencies and digital innovation. It is a really exciting time for the institution!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Assessments matter to students. They are a way to demonstrate knowledge and mastery, and provide an invaluable learning experience. In 2020 due to necessity UCEM&hellip;<\/p>\n","protected":false},"author":25,"featured_media":1978,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[56],"tags":[186],"_links":{"self":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/1971"}],"collection":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/users\/25"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/comments?post=1971"}],"version-history":[{"count":9,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/1971\/revisions"}],"predecessor-version":[{"id":1983,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/1971\/revisions\/1983"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/media\/1978"}],"wp:attachment":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/media?parent=1971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/categories?post=1971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/tags?post=1971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}