{"id":869,"date":"2019-03-25T14:24:24","date_gmt":"2019-03-25T14:24:24","guid":{"rendered":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/?p=869"},"modified":"2019-03-26T11:47:21","modified_gmt":"2019-03-26T11:47:21","slug":"automatic-transcription-software-2-6-synote","status":"publish","type":"post","link":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/posts\/869","title":{"rendered":"Automatic Transcription Software (2\/6) \u2013 Synote"},"content":{"rendered":"

This is the second post of this series about the project\u00a0Evaluation of Transcription Software<\/a>\u00a0 looking at Synote.\u00a0 You can read the previous blog in this series from\u00a0\u00a0Automatic Transcription Software (1\/6) \u2013 Zoom<\/a>.<\/p>\n

I tried automatic transcription with eight voice recordings from a purposely selected sample of UCEM employees reading a script of 1000 words containing\u00a0\u00a0paragraphs relating to various subject disciplines in the built environment.<\/p>\n

Synote is a transcription software that can be used collaboratively. So, if all students have accounts they are able to make corrections in the transcripts should there be any errors. However, at UCEM we used Synote in a\u00a0 slightly different\u00a0 way where we did not provide all students with accounts. In this model,\u00a0 the collaborative corrections of transcripts that happen in the way Synote is built to be used is taken away hence there has to be an intermediary , an admin, between students and Synote to\u00a0 correct any reported errors.<\/p>\n

As I have already mentioned in my previous blog post I used\u00a0Word Error Rate (WER),\u00a0 as a measure of accuracy:<\/p>\n

WER = (Substitution + Deletion + Insertions) \/ N<\/strong><\/p>\n

where N is the total number of words in the reference transcript (Apone, Botkin, Brooks, & Goldberg, 2011).<\/p>\n

However, WER is not a great way to check accuracy as it considers all words as equal.\u00a0 Here I have calculated the WER and one minus WER as a percentage taken as the accuracy rate.<\/p>\n

Synote worked really well for some users but not so for others.<\/p>\n

The highest accuracy rate was recorded for a native British\u00a0 speaker’s recording. However, for non-native speakers the accuracy rate was much lower than what we hoped for.\u00a0 With just above 30% accuracy rate for some transcripts this was not going to be accurate enough as an accessibility aid.<\/p>\n

\"Synote<\/a>
Synote Transcription Accuracy Rate<\/figcaption><\/figure>\n

I will blog about the other automatic transcription software in due cause.<\/p>\n

Reference<\/h2>\n

Apone, T., Botkin, B., Brooks, M., & Goldberg, L. (2011). Caption Accuracy Metrics Project: Research into Automated Error Ranking of Real-time Captions in Live Television News Programs. Retrieved from http:\/\/ncam.wgbh.org\/file_download\/136<\/p>\n","protected":false},"excerpt":{"rendered":"

This is the second post of this series about the project\u00a0Evaluation of Transcription Software\u00a0 looking at Synote.\u00a0 You can read the previous blog in this…<\/p>\n","protected":false},"author":10,"featured_media":843,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36,30,1],"tags":[26,93,94],"_links":{"self":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/869"}],"collection":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/comments?post=869"}],"version-history":[{"count":3,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/869\/revisions"}],"predecessor-version":[{"id":873,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/posts\/869\/revisions\/873"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/media\/843"}],"wp:attachment":[{"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/media?parent=869"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/categories?post=869"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ucem.ac.uk\/onlineeducation\/wp-json\/wp\/v2\/tags?post=869"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}