{"id":1910,"date":"2016-09-23T05:02:28","date_gmt":"2016-09-23T13:02:28","guid":{"rendered":"https:\/\/blogs.ubc.ca\/iiqbal\/?p=1910"},"modified":"2017-02-18T09:58:19","modified_gmt":"2017-02-18T17:58:19","slug":"calibrated-peer-review-an-introduction","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/iiqbal\/2016\/09\/23\/calibrated-peer-review-an-introduction\/","title":{"rendered":"Calibrated Peer Review: An introduction"},"content":{"rendered":"<p><a title=\"Student\" href=\"https:\/\/www.flickr.com\/photos\/83633410@N07\/7658219802\/in\/photolist-cEJnWs-73m9y2-eKrcYT-oAwFxA-nj3Xnt-9xh62u-73m9wn-fajrfc-4Vc87N-i9Kyz4-dQwVB1-88Sub5-p9jrzT-dQxd6u-bU9AVR-fPxGqz-bDCR5w-9xiabV-d6fcxs-pp7kgY-9gL2FY-dCGsN5-pozHqk-mLxcjR-dQxcTf-p4YNfV-dQriPF-dQrk7x-r1jcSN-djdCop-dJvgNh-iexdFt-q6AMAU-dQwSi9-7FMo7y-dQrhQ4-qfXSuh-ewtr7k-dQrF8P-jfB2a2-qHSN9E-gZVTUQ-q9gf6G-dKkHic-aB8MNy-fb2t7u-nJCghx-pt4ERA-ibPN36-jS1CrM\" data-flickr-embed=\"true\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/c3.staticflickr.com\/9\/8020\/7658219802_47c3c12d9d.jpg\" alt=\"Student\" width=\"500\" height=\"333\" \/><\/a><\/p>\n<p>I am enthusiastically involved in a project in which I am helping instructors implement writing assignments that use student peer feedback into their courses (see note 1). I am loving this initiative and the learning; plus, it is a neat extension of the work I have been doing on peer review of teaching.<\/p>\n<p>Today\u2019s post is a brief introduction to <a href=\"https:\/\/serc.carleton.edu\/sp\/library\/cpr\/index.html\"><strong>Calibrated Peer Review<\/strong><\/a> (CPR), a web-based writing and peer review tool that is being used in one of the re-designed courses.<\/p>\n<p><span style=\"font-weight: 400;\">Calibrated Peer Review (CPR) automates the process of distributing writing assignments to the students and then manages a peer review process that involves four steps, in which students:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Submit a writing assignment<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Undergo a process whereby their review skills are calibrated<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Review peers&#8217; writing, and <\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Assess their own writing assignment<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">The instructor need not grade the assignments and the CPR system automatically compiles grades (Likkel, 2012; Schneider, 2015). <\/span><\/p>\n<p><span style=\"font-weight: 400;\">According to the <a href=\"http:\/\/cpr.molsci.ucla.edu\/Overview.aspx\">CPR website<\/a>, compelling reasons to use CPR include that it:<\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400;\">Allows students to hone their writing skills<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Helps student learn to use higher-order thinking skills (in the writing and review process)<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Promotes students\u2019 critical thinking abilities <\/span><\/li>\n<li><span style=\"font-weight: 400;\">Encourages students to gain a deeper understanding of the topic and discipline<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Reduces time needed by instructors to grade<\/span><\/li>\n<\/ul>\n<p>With the exception of the last point, research on the CPR has drawn varied conclusions about the effectiveness of CPR for the above.<\/p>\n<p><span style=\"font-weight: 400;\">Some of the questions that remain inconclusive in the literature are:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Do the students\u2019 writing skills improve?<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Does engaging in the process promote students\u2019 conceptual understanding of X?<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Do students feel more confident as writers?<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Do students\u2019 believe the CPR process helped them augment their conceptual understanding of X and\/or become better writers?<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">I cannot yet comment on the above from personal experience because the CPR assignment I have been working on launches next week. \u00a0I can attest to the fact that, though instructor load may be lightened overall (i.e., when CPR is used in multiple assignments and\/or in next iterations of the same course), the time involved in getting to know CPR and setting up the assignment has been significant. <\/span><\/p>\n<p>Note 1: The project I am working on is a Teaching and Learning Enhancement Fund granted initiative. See <a href=\"http:\/\/tlef.ubc.ca\/previously-funded-proposals\/2016-funded-proposals\/\">here<\/a> and search for &#8220;Bradley&#8221; (the principal investigator) for brief information about that TLEF.<\/p>\n<p><span style=\"font-weight: 400;\"><strong>References<\/strong>:<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Likkel, L. (2012). Calibrated Peer Review\u2122 essays increase student confidence in assessing their own writing. Journal of College Science Teaching, 41(3), 42-47.<\/span><\/p>\n<p>Schneider, S. C. (2015). Work in progress: Use of Calibrated Peer Review to improve report quality in an electrical engineering laboratory. \u00a0Paper presented at the 2015 American Society for Engineering Education Zone III Conference, Springfield, MO.<\/p>\n<p><span style=\"font-weight: 400;\">Overview of Calibrated Peer Review (2016). Retrieved from <a href=\"http:\/\/cpr.molsci.ucla.edu\/Overview.aspx\">http:\/\/cpr.molsci.ucla.edu\/Overview.aspx<\/a><\/span><\/p>\n<p>Photo by\u00a0<a class=\"owner-name truncate\" title=\"Go to CollegeDegrees360's photostream\" href=\"https:\/\/www.flickr.com\/photos\/83633410@N07\/\" data-track=\"attributionNameClick\" data-rapid_p=\"83\">CollegeDegrees360<\/a>\u00a0https: \/\/flic.kr\/p\/cEJnWs, CC BY-SA 2.0<\/p>\n<h2><\/h2>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I am enthusiastically involved in a project in which I am helping instructors implement writing assignments that use student peer feedback into their courses (see note 1). I am loving this initiative and the learning; plus, it is a neat extension of the work I have been doing on peer review of teaching. Today\u2019s post [&hellip;]<\/p>\n","protected":false},"author":792,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[60,573],"tags":[1484152,3129,1484151],"class_list":["post-1910","post","type-post","status-publish","format-standard","hentry","category-blog","category-teaching","tag-calibrated-peer-review","tag-peer-review","tag-student-peer-feedback"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/posts\/1910","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/users\/792"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/comments?post=1910"}],"version-history":[{"count":4,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/posts\/1910\/revisions"}],"predecessor-version":[{"id":1971,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/posts\/1910\/revisions\/1971"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/media?parent=1910"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/categories?post=1910"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/iiqbal\/wp-json\/wp\/v2\/tags?post=1910"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}