{"id":2049,"date":"2026-08-17T14:19:35","date_gmt":"2026-08-17T21:19:35","guid":{"rendered":"https:\/\/blogs.ubc.ca\/catherinerawn\/?p=2049"},"modified":"2026-08-17T14:20:28","modified_gmt":"2026-08-17T21:20:28","slug":"learning-from-my-past-students-in-psyc_v-218-analysis-of-behavioural-data","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/08\/17\/learning-from-my-past-students-in-psyc_v-218-analysis-of-behavioural-data\/","title":{"rendered":"Learning from my past Students in PSYC_V 218 Analysis of Behavioural Data"},"content":{"rendered":"<p>This post continues from\u00a0<a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/07\/15\/learning-from-my-previous-students-psyc_v-217-research-methods\/\">Learning from my previous Students PSYC_V 217 Research Methods<\/a>, in which I discussed my student evaluations from my last two iterations of PSYC 217. I began writing today by revisiting my post from July 2021 <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2021\/07\/26\/reflecting-on-statistics-emergency-pivot-and-mid-pandemic\/\">Reflecting on Statistics (Emergency Pivot and Mid-Pandemic)<\/a>, which was the last time I deeply interrogated my Student Evaluations. <em>Wow<\/em> that&#8217;s a powerful post. The bigger picture takeaways (bold font toward the end) warm my heart and add fuel to my excitement for returning to the classroom <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/04\/21\/tales-of-a-sabbatical-on-becoming-a-student-of-drawing-part-1\/\">post-sabbatical<\/a>. As I look ahead to 2026\/27, it is time to revisit this practice of sharing my reflections on student evaluations.\u00a0<strong>Please see my\u00a0<a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/07\/15\/approach-to-analyzing-qualitative-student-evals-data-2026\/\">Approach to Analyzing Qualitative Student Evals Data 2026<\/a>\u00a0and as well as\u00a0<a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/teaching\/student-evaluations\/\">Student Evaluations of Teaching<\/a> for quantitative results and the survey instrument, and my <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/teaching\/courses\/\">Courses<\/a>\u00a0page for all my syllabi.<\/strong><\/p>\n<p><em>Thank you\u00a0<\/em>to every student who took the time to share feedback over the years.<\/p>\n<h1>Quantitative Data<\/h1>\n<p>First I look to quantitative results for the last three times I taught this course. W2021 started January 2022 online; we first met each other in person for the second half of the course. W2023 started January 2024, which was the last year I had 3 midterm tests. W2024 started January 2025, which was the first year I tried 2 midterm tests. Below is the graph of the <em>interpolated medians <\/em>for each University Module Item (UMI). Overall, results are fairly high and consistent, particularly <strong>clear expectations<\/strong> and my <strong>interest in supporting student learning<\/strong>. Showing interest in supporting student learning is one of my strengths (because I am indeed interested!), and I find expectations in a statistics course a little easier to articulate than in other courses. Last time I taught the course, Sec2 ratings were quite a bit lower than Sec1 in <em>presenting for understanding<\/em> and <em>providing useful feedback<\/em>. I treat both sections the same, so I&#8217;m always puzzled when that happens! Overall: Nothing of concern (or huge interest) here.<\/p>\n<p><a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/files\/2026\/08\/SEoT-PSYC-218-2021W-to-2024W.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-2046 alignnone\" src=\"https:\/\/blogs.ubc.ca\/catherinerawn\/files\/2026\/08\/SEoT-PSYC-218-2021W-to-2024W-300x199.jpg\" alt=\"\" width=\"300\" height=\"199\" srcset=\"https:\/\/blogs.ubc.ca\/catherinerawn\/files\/2026\/08\/SEoT-PSYC-218-2021W-to-2024W-300x199.jpg 300w, https:\/\/blogs.ubc.ca\/catherinerawn\/files\/2026\/08\/SEoT-PSYC-218-2021W-to-2024W-768x509.jpg 768w, https:\/\/blogs.ubc.ca\/catherinerawn\/files\/2026\/08\/SEoT-PSYC-218-2021W-to-2024W.jpg 918w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<h1>Qualitative Data<\/h1>\n<p>For qualitative analysis, I am experimenting with assistance from Microsoft CoPilot, as I explain <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/07\/15\/approach-to-analyzing-qualitative-student-evals-data-2026\/\">here<\/a>. Results below integrate both W2024 and W2023 comments, except where noted. Key strengths echo those from earlier years, and align with intentional approaches to the way I teach students:<\/p>\n<ul>\n<li><span style=\"font-size: 15px; font-weight: 300;\"><strong>enthusiasm and energy,<\/strong> example student quotes: <em>she makes statistics interesting; contagious levels of enthusiasm; even a Monday morning stats class felt motivating; shows up every day with passion; raises the energy of the whole room;<\/em><\/span><\/li>\n<li><strong style=\"font-size: 15px;\">caring, supportive, and student-centred,<\/strong><span style=\"font-size: 15px; font-weight: 300;\"> for example:\u00a0<\/span><em style=\"font-size: 15px; font-weight: 300;\">she genuinely cares about students; extremely patient and welcoming; the most supportive instructor I have ever met; always giving hope to students;<\/em><\/li>\n<li><strong>create belonging and psychological safety,<\/strong> for example:\u00a0<em>every voice in the class is heard; she reminds us we belong here; creates a safe and friendly environment; fostered acceptance unlike anything I have experienced before; the only course where I felt belonging.\u00a0<\/em>CoPilot adds: &#8220;Interestingly, while a few students felt the inclusion messages took class time away from content, many others specifically identified this as a defining strength worth nominating you for an award.&#8221;;<\/li>\n<li><strong>making statistics accessible and less intimidating,\u00a0<\/strong>for example:\u00a0<em>made an intimidating course exciting; made statistics less intimidating; broke overwhelming concepts into manageable pieces; I actually enjoyed the course;<\/em><\/li>\n<li><strong style=\"font-size: 15px;\">active learning and practice-based teaching<\/strong><span style=\"font-size: 15px;\">, for example:\u00a0<\/span><em style=\"font-size: 15px;\">hands-on opportunity to learn; learning by doing; lots of demos; self-testing was extremely helpful; examples during class helped understanding;<\/em><\/li>\n<li><strong>accessibility and availability<\/strong> (W24), for example:\u00a0<em>lots of office hours; many opportunities to ask for help; recorded lectures were very helpful; very accessible;<\/em><\/li>\n<li><strong>strong learning community<\/strong> (W24)<strong>,\u00a0<\/strong>for example:\u00a0<em>talking to peers helped to solidify understanding; discussion helped me understand concepts.<\/em><\/li>\n<\/ul>\n<p><strong>Most common suggestion for improvement was the same in both datasets: <em>More practice questions and sample exams.<\/em>\u00a0<\/strong>Students made this request directly, such as: <em>more specialized practice tests; practice questions would be helpful; offer practice questions; more practice exams<\/em>. I&#8217;ve struggled with this feedback for years for a few reasons: I think I <em>do<\/em> offer a *lot* of practice questions. Every class period we have clicker questions, and I often add extras at the end of slides before tests. Textbook resources offer hundreds of questions through Achieve LearningCurve and end of each chapter. I link to a bunch of free online resources for example question generation. And most Assignment and Practice Lab questions are similar to those found on exams. But, these aren&#8217;t (all) written by me, and\/or they aren&#8217;t formatted and sequenced to look like one of my timed tests. Notably, this <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/07\/15\/learning-from-my-previous-students-psyc_v-217-research-methods\/\">came up in 217 recently too<\/a>, and I noticed it from <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2021\/07\/26\/reflecting-on-statistics-emergency-pivot-and-mid-pandemic\/\">previous 218 course offerings<\/a>. It&#8217;s time to address this. I&#8217;m going to use two strategies. One strategy will be the same as I mentioned in my recent 217 reflection: look at past tests and see if\/what I can relinquish, as an explicit example of a past test. The second strategy I&#8217;ll use is to give a practice test in place of a 3rd midterm.<\/p>\n<p>The major change I made from W2023 to W2024 was to cut the third midterm. So I asked CoPilot, &#8220;what can you tell me about how students felt about three versus two midterm tests?&#8221; CoPilot responded:<\/p>\n<blockquote><p>&#8220;The overall student response suggests that: 2023 students generally wanted more low-stakes opportunities to practice and get feedback before high-stakes assessments. <strong style=\"font-size: 15px;\">2024 students were somewhat divided about the move from three midterms to two. <\/strong><span style=\"font-size: 15px;\">A noticeable group of 2024 students <strong>actually\u00a0<\/strong><\/span><strong style=\"font-size: 15px;\">missed the third midterm<\/strong><span style=\"font-size: 15px;\"> because it would have created another checkpoint for studying and feedback before the final. <\/span><span style=\"font-size: 15px;\">Another group appreciated the reduction because it <strong>lowered stress and created more time<\/strong> to consolidate learning. <\/span>So the change from three to two midterms did\u00a0<strong>not<\/strong> produce a unanimous &#8220;this is better&#8221; response. &#8230;\u00a0The pattern I notice is that\u00a0<strong>students seem to want the benefits of a third midterm without necessarily wanting another high-stakes exam.&#8221;<\/strong><\/p><\/blockquote>\n<p>This was an interesting and unexpected interpretation. So I revisited my calendar planning, and instead of a general &#8220;catch-up and review&#8221; class period (instead of the old Test 3), I&#8217;m going to try something new, a bit of a hybrid approach. We&#8217;re going to have a timed, in-class <strong>Practice Test 3<\/strong>. Not for marks, but looks and feels like a test. It&#8217;ll probably be shorter to create room to take it up (maybe in groups?).<\/p>\n<p>Other suggestions for improvement included simpler, <em>clearer and more concise slides<\/em>; clarifying learning from textbook versus in class; more practice <em>time with formulas<\/em> and\u00a0<em>calculation examples<\/em>; consider completion-only clicker questions (divided feedback). Fair enough. I&#8217;ll do my best to keep listening on these, while focusing on the practice exam\/test as the major area for improvement this year.<\/p>\n<p><em>We can&#8217;t do everything, but we can do something.\u00a0<\/em><\/p>\n<h1>On Transformation<\/h1>\n<p>As one final note, while I&#8217;ve been working on my new teaching statement, I&#8217;ve been exploring themes of transformative growth (see <a href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/04\/22\/on-becoming-a-student-of-drawing-part-5-transformation\/\">On Becoming a Student of Drawing, Part 5: Transformation<\/a>). I asked CoPilot if there was any evidence of <em>transformation<\/em> in these two 218 student feedback datasets. CoPilot offered:<\/p>\n<blockquote><p>I would summarize it this way:<\/p>\n<p>Across both years of PSYC 218, students frequently described transformative shifts in their relationship with quantitative methods. Many entered the course reporting fear, anxiety, or low confidence regarding statistics, but subsequently described developing competence, confidence, and even enjoyment. <strong>Students repeatedly reported increased self-efficacy, stronger feelings of belonging in psychology and academia, greater resilience when facing challenging material, and a deeper understanding of how statistical reasoning supports psychological science.<\/strong> Several students explicitly stated that the course changed their perception of their own capabilities and, in some cases, influenced future academic or career interests.<\/p>\n<p>The strongest transformation theme across both PSYC 218 datasets is:<\/p>\n<p><strong>Students move from seeing themselves as &#8220;people who are bad at statistics&#8221; to seeing themselves as capable learners who can understand, use, and even enjoy quantitative methods.<\/strong><\/p><\/blockquote>\n<p>Well that&#8217;s pretty amazing to think I might play a role in all that. Of course, there are students who wouldn&#8217;t be represented by these statements. I hope and work to support all students in their transformation, however small or large, instrumental or personal that may be.<\/p>\n<p>Thank you so much to everyone for your time and engagement with this feedback process!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This post continues from\u00a0Learning from my previous Students PSYC_V 217 Research Methods, in which I discussed my student evaluations from my last two iterations of PSYC 217. I began writing today by revisiting my post from July 2021 Reflecting on <a class=\"more-link\" href=\"https:\/\/blogs.ubc.ca\/catherinerawn\/2026\/08\/17\/learning-from-my-past-students-in-psyc_v-218-analysis-of-behavioural-data\/\">Continue reading <span class=\"screen-reader-text\">  Learning from my past Students in PSYC_V 218 Analysis of Behavioural Data<\/span><span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":679,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4282],"tags":[9017,2225,8405],"class_list":["post-2049","post","type-post","status-publish","format-standard","hentry","category-reflections-from-the-classroom","tag-sotl","tag-statistics","tag-student-evaluations-of-teaching"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/2049","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/users\/679"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/comments?post=2049"}],"version-history":[{"count":5,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/2049\/revisions"}],"predecessor-version":[{"id":2054,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/posts\/2049\/revisions\/2054"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/media?parent=2049"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/categories?post=2049"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/catherinerawn\/wp-json\/wp\/v2\/tags?post=2049"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}