{"id":1071,"date":"2014-07-22T16:14:22","date_gmt":"2014-07-22T23:14:22","guid":{"rendered":"https:\/\/blogs.ubc.ca\/catherinerawn\/?p=1071"},"modified":"2017-11-19T10:07:52","modified_gmt":"2017-11-19T17:07:52","slug":"two-stage-exam-introduction-and-resources","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/catherinerawn\/2014\/07\/22\/two-stage-exam-introduction-and-resources\/","title":{"rendered":"Two-Stage Exam: Introduction and Resources"},"content":{"rendered":"<p>Time to dive in! After thinking about\u00a0them for a long time, this term\u00a0I&#8217;m converting my exams into\u00a0two-stage exams.<\/p>\n<ul>\n<li>Step 1. I shorten the exam so it&#8217;s doable in about 2\/3 of the testing time slot.<\/li>\n<li>Step 2. Students\u00a0write the exam individually.<\/li>\n<li>Step 3. Students immediately &#8212; during the same class period &#8212; write the same exam again in groups of 4.<\/li>\n<li>Step 4. Grade the exams as usual, but 90% of the score comes from individual, and 10% from team, with a guarantee that if you do better than the team score you get 100% weight for the individual (which very rarely happens, so I&#8217;m told).<\/li>\n<\/ul>\n<p><strong>Why am I making this change?<\/strong><\/p>\n<p>Four\u00a0key\u00a0reasons:<\/p>\n<ol>\n<li>Data. A growing pool of evidence is showing that team tests help students learn.\u00a0See references\u00a0below.<\/li>\n<li>Feedback. My classes are very large, so I struggle to give any personalized feedback at all, especially timely feedback. By re-doing the test\u00a0immediately\u00a0with peers,\u00a0they get\u00a0to immediately discuss\u00a0the questions and come to the right answer (according to\u00a0data).<\/li>\n<li>Exam improvement. Based on my evaluations, a small but consistent group of students find my exams very difficult and\/or too long.\u00a0Because I still only have 50 minute classes to work with, this change will force me to shorten my exams,\u00a0culling and distilling to just the\u00a0most effective questions that measure deep learning.<\/li>\n<li>Community. I <a title=\"about this site\" href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/about\/\" target=\"_blank\" rel=\"noopener noreferrer\">value <\/a>collaboration and building a supportive community. Research papers and instructors\u00a0who have used this method report extra\u00a0benefits beyond learning:\u00a0students have more rapport with each other and are more\u00a0willing to participate with their peers in class throughout the term. Also, <a href=\"http:\/\/www.psychol.cam.ac.uk\/directory\/gs488\">Gillian Sandstrom<\/a> and I have\u00a0a research paper in press showing the more students talk in class, the more they feel like part of a community and interested in the class.\u00a0So&#8230; back to data.<\/li>\n<\/ol>\n<p><strong>Interested? Here are some quick and effective\u00a0resources for implementation:<\/strong><\/p>\n<ol>\n<li><a href=\"http:\/\/www.cwsei.ubc.ca\/resources\/SEI_video.html\" target=\"_blank\" rel=\"noopener noreferrer\">Videos<\/a> by the CWSEI team depicting Two-Stage Exams in action.<\/li>\n<li>Jones, F., Gilley, B., Harris, S. (2013). Tips for successful two stage exams.\u00a0<em>The EOS-SEI Times, 6<\/em>(9). Retrieved\u00a0<a href=\"http:\/\/www.cwsei.ubc.ca\/Files\/EOS\/EOS-SEITimes_4.1_GroupExams.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">http:\/\/www.cwsei.ubc.ca\/Files\/EOS\/EOS-SEITimes_4.1_GroupExams.pdf<\/a><\/li>\n<li>Jones, F., Gilley, B., Lane, E., Caulkins, J., &amp; Harris, S. (2011). Using group exams in your classes.\u00a0<em>The EOS-SEI Times<\/em>, 4(1). Retrieved\u00a0<a href=\"http:\/\/www.cwsei.ubc.ca\/Files\/EOS\/EOS-SEITimes_4.1_GroupExams.pdf\">http:\/\/www.cwsei.ubc.ca\/Files\/EOS\/EOS-SEITimes_4.1_GroupExams.pdf<\/a><\/li>\n<li>PHAS-CWSEI Team. (2012). Two-stage (group) exams.\u00a0<em>CWSEI&#8211;PHYS &amp; ASTRO Newsletter.<\/em> <a href=\"http:\/\/www.cwsei.ubc.ca\/Files\/PHAS\/PHAS-CWSEI_Newsletter_Summer-2012.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Retrieved\u00a0http:\/\/www.cwsei.ubc.ca\/Files\/PHAS\/PHAS-CWSEI_Newsletter_Summer-2012.pdf<\/a><\/li>\n<li><a href=\"http:\/\/www.eos.ubc.ca\/about\/faculty\/B.Gilley.html\">Brett Gilley<\/a>, aka\u00a0<a href=\"https:\/\/twitter.com\/ModernHydra\" target=\"_blank\" rel=\"noopener noreferrer\">@ModernHydra<\/a><\/li>\n<\/ol>\n<p><strong>Data<\/strong><\/p>\n<p>Dahlstrom, O. (2012). Learning during a collaborative final exam.\u00a0<em>Educational Research and Evaluation: An International Journal on Theory and Practice, 18<\/em>, 321-332.<\/p>\n<p>Eaton, T. T. (2009). Engaging students and evaluating learning progress\u00a0using collaborative exams in introductory classes.\u00a0<em>Journal of Geoscience Education, 57<\/em>, 113-120.<\/p>\n<p>Gilley, B. H., &amp; Clarkston, B. (2014). Collaborative testing: Evidence of learning in a controlled in-class study of undergraduate students.\u00a0<em>Journal of College Science Teaching, 43<\/em>, 83-91.<\/p>\n<ul>\n<li>A particularly well-designed example.<\/li>\n<\/ul>\n<p>Leight, H., Saunders, C., Calkins, R., &amp; Withers, M. (2012). Collaborative testing improves performance but not content retention in a large-enrollment introductory biology class.\u00a0<em>CBE&#8212;Life Sciences Education, 11,\u00a0<\/em>392-401.<\/p>\n<ul>\n<li>The title might be alarming here&#8230; they showed no effect of the 2-stage exam on final exam performance (compared with material that had been previously tested only with individual\u00a0tests). I&#8217;m ok with this. Not every study is going to find the same effect (particularly ones with some execution oddities\u00a0like this one), yet this is still a &#8220;no-change&#8221; effect with no evidence that student\u00a0learning\u00a0decreases. Moreover,\u00a0students still enjoyed the process and found it less stressful than the individual-only tests. No harm done, potential benefits.<\/li>\n<\/ul>\n<p>Rieger, G. W., &amp; Heiner, C. E. (2014). Examinations that support collaborative learning: The students&#8217; perspective.\u00a0<em>Journal of College Science Teaching, 43<\/em>, 41-47.<\/p>\n<p>Roediger, III, H. L., &amp; Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing.\u00a0<em>Journal of Experimental Psychology: Learning, Memory, &amp; Cognition, 31<\/em>, 1155-1159.<\/p>\n<ul>\n<li>Two-stage tests might\u00a0help to fight the negative consequences of MC tests: you remember\u00a0what you answered (and thought was right), not what actually was right.<\/li>\n<\/ul>\n<p>Sandstrom, G. M., &amp; Rawn, C. D. (in press\/2014). Embrace chattering students: They may be building community and interest in your class. <em>Teaching of Psychology.<\/em><\/p>\n<p>Zipp, J. F. (2007). Learning by exams: The impact of two-stage cooperative tests.\u00a0<em>Teaching Sociology, 35<\/em>, 62-76.\u00a0<span style=\"color: #333300;\">doi:\u00a0<\/span><span class=\"slug-doi\" style=\"color: #333300;\">10.1177\/0092055X0703500105<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><span class=\"slug-doi\" style=\"margin: 0px; padding: 0px; border: 0px; outline-style: none; font-weight: bold; font-size: 9px; font-family: Arial, Helvetica, sans-serif; line-height: 12.600000381469727px; vertical-align: baseline; color: #333300;\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Time to dive in! After thinking about\u00a0them for a long time, this term\u00a0I&#8217;m converting my exams into\u00a0two-stage exams. Step 1. I shorten the exam so it&#8217;s doable in about 2\/3 of the testing time slot. Step 2. Students\u00a0write the exam <a class=\"more-link\" href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2014\/07\/22\/two-stage-exam-introduction-and-resources\/\">Continue reading <span class=\"screen-reader-text\">  Two-Stage Exam: Introduction and Resources<\/span><span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":679,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4281,4282,4309],"tags":[4805,939,4806,416546,89,8225,676920],"class_list":["post-1071","post","type-post","status-publish","format-standard","hentry","category-reflections-from-professional-development-activities","category-reflections-from-the-classroom","category-on-course-design","tag-cwsei","tag-exams","tag-interactive-engagement","tag-learning-assessments","tag-summer","tag-the-big-picture","tag-two-stage-exams"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/1071","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/users\/679"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/comments?post=1071"}],"version-history":[{"count":5,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/1071\/revisions"}],"predecessor-version":[{"id":1449,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/1071\/revisions\/1449"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/media?parent=1071"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/categories?post=1071"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/tags?post=1071"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}