{"id":28,"date":"2020-05-29T23:28:48","date_gmt":"2020-05-30T06:28:48","guid":{"rendered":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/?page_id=28"},"modified":"2021-03-04T14:18:13","modified_gmt":"2021-03-04T21:18:13","slug":"remote-proctoring","status":"publish","type":"page","link":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/academic-integrity\/remote-proctoring\/","title":{"rendered":"Remote proctoring tools"},"content":{"rendered":"<div>Online remote proctoring involves having a student complete an assessment (usually write an exam) while being monitored with the aid of some form of technology.\u00a0 Technology either assists or replaces human invigilators that would have monitored an assessment in person.\u00a0 The use of remote proctoring is primarily intended as a deterrent to reduce the opportunity to engage in misconduct, and should be viewed as only one element of an <a href=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/academic-integrity\/strategies-for-promoting-academic-integrity\/\">overall academic integrity strategy<\/a>.\u00a0 There are several options available for remote proctoring ranging from the use of video chat tools (like Zoom), to sophisticated autonomous tools that use artificial intelligence (AI) to detect misconduct.<\/div>\n<h3>Uses<\/h3>\n<p>There are four main functions a remote proctoring system addresses:<\/p>\n<ol>\n<li>To verify it is the intended student completing the test and not someone else.<\/li>\n<li>To ensure the student only uses permitted materials during the exam (e.g. does not access notes or the textbook during a closed-book exam).<\/li>\n<li>To ensure the student completes the exam on their own, without assistance from others (including both others they know as well as through online services such as <a href=\"https:\/\/www.chegg.com\/tutors\/\" target=\"_blank\" rel=\"noopener noreferrer\">Chegg<\/a>).<\/li>\n<li>To ensure the exam materials remain secure, and are not duplicated or shared (this is especially important if different students write the exam at different times, perhaps according to time zone)<\/li>\n<\/ol>\n<h3>Limitations<\/h3>\n<p>Be<img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-184 alignleft\" src=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-300x200.jpg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-300x200.jpg 300w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-1024x683.jpg 1024w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-768x512.jpg 768w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-1536x1024.jpg 1536w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-100x67.jpg 100w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-150x100.jpg 150w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-200x133.jpg 200w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-450x300.jpg 450w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-600x400.jpg 600w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay-900x600.jpg 900w, https:\/\/blogs.ubc.ca\/assessmentguidebook\/files\/2020\/05\/TumisuPixabay.jpg 1920w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>fore summarizing remote proctoring tools and options, it is important to recognize that no tool is perfect.\u00a0 There are ways that individuals intent of committing misconduct can defeat any system.\u00a0 As some individuals exploit a vulnerability in a particular tool, the tool developers address that weakness, then the individuals identify new and more creative ways to cheat, and the misconduct arms race continues.<\/p>\n<p>Importantly, each remote proctoring approach has costs, both actual and in terms of impacts on students and effort required.\u00a0 As remote proctoring is unfamiliar to most students, it can create feelings of anxiousness during an exam as they may feel they are being watched more closely than normal.\u00a0 In addition, these tools can give the perception that the instructor does not trust students to behave ethically (although, curiously, you don&#8217;t hear of students questioning why we stay in the classroom to invigilate a written exam).\u00a0 In addition, remote proctoring almost always requires the student use a webcam, and often a microphone as well, and it requires that they have a reasonably fast and stable internet connection.\u00a0 It is ideal if students have a quiet, private space where they can complete their exam.\u00a0 Not all students will have all of these things, which will require finding solutions to support and accommodate those students.\u00a0 There is a lack of information in terms of the propensity for automated remote proctoring tools to falsely identify (or miss) behaviours as suspicious based on factors such as skin colour, ethnicity, headdress, glasses, and so on. Finally, there are privacy concerns as the use of remote proctoring gives others visual and audio access inside students&#8217; homes in ways that would otherwise not occur.<\/p>\n<h3>Tools<\/h3>\n<div>There are three broad approaches to remote proctoring: video surveillance, live proctoring services, and automated proctoring services.<\/div>\n<div><\/div>\n<div id=\"random-accordion-id-730\" class=\"accordion-shortcode  accordion-container\">\n<h3 ><a href=\"#simple-video-monitoring-0\" >Simple video monitoring<\/a><\/h3><div id=\"simple-video-monitoring-0\" class=\"accordian-shortcode-content \" ><\/p>\n<p><strong>Description<\/strong><\/p>\n<p>Using existing video chat tools such as Zoom, MS Teams, Skype, etc., instructors have students complete their exam in view of their webcam.\u00a0 This is likely only suitable for pen-and-paper exams as most webcams are integrated within a device (and cannot show the screen).\u00a0 A human invigilator watches multiple screens with students assigned to breakout rooms.\u00a0 <a href=\"https:\/\/skylight.science.ubc.ca\/lt\/guides\/zoom\">UBC SKYLIGHT<\/a> has a very detailed guide on proctoring using Zoom.<\/p>\n<p><strong>Pros<\/strong><\/p>\n<ul>\n<li>Essentially no addition up-front cost for a proctoring system<\/li>\n<li>Of the options, this may be the most familiar to students (and therefore the most comfortable)<\/li>\n<\/ul>\n<p><strong>Cons<\/strong><\/p>\n<ul>\n<li>In larger classes, a large team of invigilators will be required watch all students simultaneously, even with multiple students on an invigilator's screen.\u00a0 (For reference, live proctoring services monitor 16-32 students at a time, which suggests a 150-student course would require at least 5-10 invigilators, and likely more given that this will likely be a new experience for them too.)<\/li>\n<li>This is the least secure option as it lacks most of the other checks and features with the other specialized systems (for example, locking the browser on a computer, scanning for suspicious noises, tracking eye movements, etc.)<\/li>\n<li>All students still require webcams<\/li>\n<\/ul>\n<p><strong>Notes<\/strong><\/p>\n<ul>\n<li>Ensure any system used satisfies all applicable privacy protection requirements for your jurisdiction; there may be restrictions at the institution level regarding the use of various tools, the ability to record the session, and so on<\/li>\n<li>Consider how students will identify themselves on their video (how will the invigilators know who is who, and whether the person in the video is actually who they claim to be?); options may vary by institution, but consider that you might need to take a student to a separate (private) breakout room before asking that they show their personal ID<\/li>\n<li>Consult with your institution regarding possible recording of the exam session, as this may not be permitted.\u00a0 If you are permitted to record sessions and wish to do so, you will need a plan in terms of where those recordings will be stored, how they will be encrypted and secured, who will have access and for how long, how they will be securely deleted, and more.\u00a0 Also consider how you will inform students of all of this information.<\/li>\n<li>Consider how you will manage cases where a students video is disrupted (they may have an unstable internet connection, or some individuals could even intentionally turn off their webcam)<\/li>\n<li>Consider how you will manage technical support issues (e.g. a student or invigilator cannot connect during the exam); clearly communicate this to all parties well in advance of the exam<\/li>\n<li>Here is an example set of instructions to accompany exams invigilated by Zoom, prepared by <a href=\"https:\/\/skylight.science.ubc.ca\/lt\/guides\/zoom\" target=\"_blank\" rel=\"noopener noreferrer\">UBC Skylight<\/a>.<\/li>\n<\/ul>\n<blockquote>\n<p>This is an invigilated exam. You must turn on your camera and leave it on throughout the examination. You will be asked to hold up your student card for identification purposes, and an invigilator may also ask you to share your screen at any point during the exam.<\/p>\n<p>Your privacy is important to us. The camera feed will not be recorded. If you have any questions about how your privacy is protected while using Zoom, please consult with your instructor.<\/p>\n<\/blockquote>\n<p>\n<\/div><\/p>\n<p><h3 ><a href=\"#live-proctoring-1\" >Live proctoring<\/a><\/h3><div id=\"live-proctoring-1\" class=\"accordian-shortcode-content \" ><\/p>\n<p><strong>Description<\/strong><\/p>\n<p>Paid live proctoring services such as <a href=\"https:\/\/www.proctoru.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">ProctorU Live<\/a> and <a href=\"https:\/\/examity.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Examity Live<\/a> use a human to verify the identity of the test taker before providing access to the examination.\u00a0 Basic options then use AI (see next section) to invigilate the examination and to intervene if suspicious behaviour is detected, and premium options have live proctors to oversee the entire test session.<\/p>\n<p><strong>Pros<\/strong><\/p>\n<ul>\n<li>The most rigorous and secure remote proctoring option of those considered here<\/li>\n<li>Sessions (even with AI) are recorded<\/li>\n<li>Live proctors are able to provide some technical support, if needed<\/li>\n<\/ul>\n<p><strong>Cons<\/strong><\/p>\n<ul>\n<li>These systems can be expensive for the institution (roughly $10-16 per exam for the basic services, and $35 or more for premium)<\/li>\n<li>The live proctors are often located outside of North America, and privacy protection requirements may not be met<\/li>\n<li>Some students report live proctors not following exam instructions or possessing poor language skills<\/li>\n<\/ul>\n<p><strong>Notes<\/strong><\/p>\n<ul>\n<li>Ensure any system used meets applicable privacy protection requirements<\/li>\n<\/ul>\n<p>\n<\/div><\/p>\n<p><h3 ><a href=\"#automatic-proctoring-2\" >Automatic proctoring<\/a><\/h3><div id=\"automatic-proctoring-2\" class=\"accordian-shortcode-content \" ><\/p>\n<p><strong>Description<\/strong><\/p>\n<p>Many automated online proctoring systems make use of AI to monitor students during an exam and automatically detect and report suspicious behaviour.\u00a0 <a href=\"https:\/\/examity.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Examity<\/a>, <a href=\"https:\/\/www.proctoru.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">ProctorU<\/a>, <a href=\"https:\/\/www.proctortrack.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Proctor Track<\/a>, <a href=\"https:\/\/proctorio.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Proctorio<\/a>, and many other services exist.\u00a0 Most services include options to verify a student's identity, to record webcam, audio through a microphone, and the computer screen, to control or limit access to programs and the internet on a computer, and so on.\u00a0 Students can be requested to do a room scan (i.e., sweep the room with their webcam) at random or if suspicious behaviours are noted.\u00a0 These services are well suited to exams completed online using the quiz tool in an LMS, but can also be adapted for use with pen-and-paper exams where students later scan and upload their work.<\/p>\n<p><strong>Pros<\/strong><\/p>\n<ul>\n<li>Dedicated proctoring systems that provide broad detection of misconduct (e.g. student consistently looking off-screen,<\/li>\n<li>Sessions are recorded (usually the webcam and the screen)<\/li>\n<li>After the exam, instructors are given a report of suspicious behaviours to investigate (often by highlighting specific incidents to review in a video timeline)<\/li>\n<li>Systems often provide a detailed report at the end, including the quality of the student's internet connection, video quality, hardware issues (e.g. not enough storage space), and so on.<\/li>\n<\/ul>\n<p><strong>Cons<\/strong><\/p>\n<ul>\n<li>There is a cost to the institution<\/li>\n<li>Some systems only work with certain browsers (e.g. Proctorio currently only works with Google Chrome, which can be problematic for students in China, for example)<\/li>\n<\/ul>\n<p><strong>Notes<\/strong><\/p>\n<ul>\n<li>Create a practice exam, not for marks but using the full features of the system as you plan for the actual exam, for students (and you) to test out the system, work out kinks, and to become more familiar with it.\u00a0 This is very important to help lower student anxiousness.<\/li>\n<\/ul>\n<p>\n<\/div><\/p>\n<p><\/div><!-- #random-accordion-id-730end of accordion shortcode -->\n<p>For more information, consider these resources:<\/p>\n<ul>\n<li><a href=\"https:\/\/library.educause.edu\/resources\/2016\/5\/7-things-you-should-know-about-remote-proctoring\" target=\"_blank\" rel=\"noopener noreferrer\">EDUCASE: Seven Things You Should Know About Remote Proctoring<\/a><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<table style=\"width: 100%; border-collapse: collapse; border-style: none;\" border=\"1\">\n<tbody>\n<tr>\n<td style=\"width: 50%;\"><a href=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/academic-integrity\/strategies-for-promoting-academic-integrity\/\">Previous (Enhancing Academic Integrity)<\/a><\/td>\n<td style=\"width: 50%; text-align: right;\"><a href=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/academic-integrity\/remote-proctoring-tips-and-suggestions\/\">Next (Remote Proctoring Tips and Suggestions)<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Online remote proctoring involves having a student complete an assessment (usually write an exam) while being monitored with the aid of some form of technology.\u00a0 Technology either assists or replaces human invigilators that would have monitored an assessment in person.\u00a0<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/blogs.ubc.ca\/assessmentguidebook\/academic-integrity\/remote-proctoring\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":4901,"featured_media":0,"parent":23,"menu_order":5,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-28","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/pages\/28","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/users\/4901"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/comments?post=28"}],"version-history":[{"count":19,"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/pages\/28\/revisions"}],"predecessor-version":[{"id":574,"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/pages\/28\/revisions\/574"}],"up":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/pages\/23"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/assessmentguidebook\/wp-json\/wp\/v2\/media?parent=28"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}