Tag Archives: student evaluations of teaching

Midterm time already?

I can’t believe it’s almost October! This month has flown by! Yesterday I gave my first midterm tests in both my Research Methods (Psyc 217 Sections 001 and 002) and Intro (Psyc 100 Section 002) courses. That’s always a stressful day trying to ensure the most consistent and quality conditions for all 600 students. Overall I think they went smoothly.

In this post I described my plan to concentrate this semester on revamping the exams in my research methods courses. I’m pleased to report that I considered and re-considered each question, and ensured that each question was related to a learning objective either from the texts or class. To make this possible I created learning objectives for each chapter in the Stanovich text that I shared with my students and used as a starting point when creating/reconsidering exam questions. This strategy was in response to feedback from students who reported that the most important points in the Stanovich book were sometimes difficult to discern (he tends to go on a bit). If you’re in this course I’d love to hear feedback from you about how the exam went. Drop by my office hour or send me an email (or leave a comment here).

What I re-experience every September is how much I enjoy getting to know my students. When I know who you are and a bit about you it makes preparing for class and our time during class more fun. I’ve really enjoyed our conversations so far, and I look forward to getting to know as many of my 600 students this term as possible!

Reflecting on Student Evals, 2010-2011

Because I pour so much of my heart and soul, sweat and tears (never blood, yet anyway) into each course, I find it necessary to wait a while after a course is over to view the student evaluations of those courses. It can be very emotional to read them, full of breathtaking highs and, occasionally, devastating lows (I appreciate criticism, but not one worded disrespectfully). I have posted summary graphs of my scores and some commentary here, and will share some further reflections in this blog post. Links to all my course syllabi are available here.

The first thing I noticed was how students rated my introductory psychology course overwhelmingly positively. Those ratings are the highest I have ever received. This was absolutely thrilling! I had felt throughout the year a special rapport with this class, despite its large size (N=260). Their energy, curiosity and astute questions continually kept me on my toes, and this in turn fueled my own passion and excitement. I want to share with you a particularly thorough–and not 100% positive!–comment that might give you a feel for what to expect from me (if you’re shopping for courses):

At first, I didn’t like the way Catherine Rawn taught. She was a little too flamboyant and enthusiastic. I felt like she babied us a little. But as the year went on, I really began to appreciate it. I found that I paid attention even to the material I wasn’t particularly interested in. I appreciated her invitational office hour. I never would have gone to her were it not a “requirement,” and that was actually the point that caused me to like her better. I realized that she actually cares about her students (enough to LEARN OUR NAMES, which impressed me) and she was willing to be challenged and she was very respectful to students with opinions different than hers. I have to say that she is one of the better professors I have had in my first year of university. She was interesting, prepared, open, enthusiastic, and positive. She may have babied us a little, but only in the sense that she was so open to help. She still gave challenging and stimulating assignments. Overall, I would say, I thank her for doing a good job.

It’s an interesting comment, to me anyway, in part because it uses a term I’ve received in evaluations before: “babied.” This always intrigues me because I suspect it has something to do with people’s notions about what learning should look like in the university classroom: It should be serious! I attempt to infuse some fun in my courses (e.g., cheering!), I enjoy and find value in exploring with my students, and starting with the basics is important especially in an introductory course. My intention is never to baby, but I also want to dispel the notion that learning has to always be serious. Learning can be fun! Overall, I’m very pleased with the ratings of this course, and will not be making major changes to it next year… with one fabulous exception: the introduction of Peer Tutors! Ten fantastic “grads” of my course from last year have volunteered to help answer questions and act as role models as new students transition to my course and university more broadly. Looking forward to introducing them soon!

The second thing I noticed was that although my scores for Psyc 217 Research Methods are solidly and largely positive, I’m still having a challenge as students are perceiving my evaluations to be less fair than is average across campus (though not unfair per se; see the means on my “evaluating teaching” page, linked above). It is possible that this is simply perception given that this is a very tough course (which is true for all Psyc 217 sections), as it should be because it provides the foundation for all further study in psychology and other behavioural sciences. Yet it’s also possible that my evaluations are in fact less fair than is average across campus. In order to address this consistent rating, I am vowing to critically re-evaluate my exams and assignments this fall. One of those, the group research project, is common to all sections and has a common grading key/rubric, so there’s little to change there. My action plan for evaluating my exams and assignments is to gather all my learning objectives together from every lesson of the course, as well as the broader course objectives stated in the syllabus, and the readings for each unit. I will then consider every question on every evaluation, specifically in terms of how well it links to one or more objectives. Then I will consider whether any question isn’t measuring any objective, and toss it. Then I will consider whether any objective isn’t being addressed, and consider whether the objective should be changed/tossed or measured. After I conduct this analysis of content validity, I will use data from previous years (as I often do) to inform changes to the individual questions to improve their ability to accurately measure learning in my course. I expect my students to use my stated objectives as a road map; it’s time to re-check that they’re aligned with the way I’m evaluating that learning.

Third, I was pleased to see that my scores for Psyc 208 Section 2: How Social Psychology Can Help You Succeed (Special Topics) have improved much from the first time I offered it in 2009, as I used the feedback from 2009 as well as inspiration from a talk by Michael Wesch last summer to make substantial changes. It’s an unconventional course, with lots of teamwork and interaction. For one, I implemented the validity analysis process for exams I explained above (for Psyc 217), which resulted in much fairer exams. As for improvements based on this year’s feedback, I will shorten the midterm a little, and make some small adjustments to the grading of the team project so that individual work related to the team project is weighted more heavily relative to the team grades. Also, I’m considering making grading keys available for the team assignment to improve the clarity of what’s expected for each. Given this feedback, I’d like to share one of my favourite comments from this course, because it reflects my intention in creating this course and in how I structure each and every lesson/experience. Of course they’re not all this positive, but indulge me:

Easily the best teacher I have had at UBC. She should hold workshops for other professors! Or publish a book, or work w ith the Chapman Learning Commons to develop a free, non-credit version of the course that students can take to learn how to improve their university experience. I would recommend her course in Social Psychology and its application to academic success to any student regardless of faculty or major and consider it an invaluable tool to my success. Catherine was always helpful, expected the best of her class and demonstrated an unparalleled concern for the personal and academic development/wellbeing of her students.
I have offered these (lengthy!) reflections to you as evidence that I take student evaluations very seriously, and make real changes to my courses in response to them. Teaching psychology to learners is my passion and, I believe, my calling. I am delighted that so many students report valuing the way I teach and what I contribute to their university experience.

Alternative to ratemyprofessors.com

Hello! Did you know that there’s a better alternative to ratemyprofessors.com? Former students of mine will know the dangers of relying on the website ratemyprofessors.com for information about faculty teaching. One quick example of why it’s dangerous to rely on such data: One time on ratemyprofs I had ratings from a student who had never taken a course from me! That student went on and on about my teaching a course that I’d never taught before! Not exactly a great source of data, eh?

Here is a much more sound alternative: the official UBC results http://teacheval.ubc.ca/results/. Average responses to the first six items are there. These are the six overall items, called University Module Items (UMIs) that are asked about every faculty member on campus (the rest of the questions are faculty or department specific). If you would like help interpreting the numbers, let me know! And rest assured, everyone who had access to rate instructors via this site was a student in that course!

Because I’m working on my book pretty furiously these days, I haven’t yet had a chance to deeply think about and post my results and reflections on this site… but that’s coming! In the mean time, my mean ratings are available on the above website. Happy course-hunting!

pearls of wisdom

Today Sunaina and I had the pleasure of lunching with Russ Day, Senior Lecturer and head of the Intro Psych program at SFU. Of the many insightful ideas he shared with us, a few stand out for me in particular. Most potently, he built on the idea of of 20-60-20: 20% of students will learn in spite of you, 20% may not be sufficiently motivated to learn from you at all, but that middle 60% is where our biggest impact can be as instructors. So if I pitch my course at the 80th percentile of students, the top 20% won’t be too bored, the bottom 20% will be disengaged, but I have the potential to truly engage and challenge 60% of my students. This is interesting on its own, but he pushed it further into what this would mean for student evaluations. The students in the, say, 21st-25th percentiles will be pushed too far if I’m pitching for the 80th percentile. A psychologically healthy response to failure is an external attribution: i.e., to blame me. So if I’m not getting about 2-3% of students feeling frustrated by my course, I may be pitching my course at too easy of a level. Wow!!! That is powerful! (I’m reminded here about something else we discussed: Chickering & Gamson’s 7 Principles, one of which is “communicate high expectations.”) So often I (and others) ruminate about those few extremely critical comments in the student evaluations, and have to find ways to cope with them… but Russ offered such a thoughtful and realistic perspective on those comments! Instead, I should be ruminating on the positive comments, trying to figure out exactly what I did to connect with that student so I can do more of it.

The second idea that really stands out for me was our discussion about being a scholar. As a scholar, there is no choice but to keep up with the literature. For me, that means content, but also as a teaching-focused scholar, the education literature. This is a challenge to me, one that’s been in the back of my mind for a while now. One thing I do to help with this is that I attend the Carl Wieman Science Education Initiative (CWSEI) reading group weekly during the summer months. This is one step in the right direction. Where can I build more literature into my life?

Course Evaluation Season Arrives!

My plans for working on revisions to a manuscript were derailed this morning by the news that our Student Evaluations of Teaching from last term were released. Reading these evaluations is an emotional event for me, and this is particularly true on the first look (of many!). As always, I’m filled with anxiety and hesitation: Did my students like me? Did they appreciate the risks I took in class? In testing? Did I push them to learn — just enough or too much or not enough? Did they take the time to complete the evaluations? (fyi: 583 did — which represents 54% of all my students.)

For the first look today I examined the numbers, particularly the six UBC University Module Items (UMIs), just to get a feel for what they’re saying. Here are my impressions of these numbers for 2009/2010: Overall, I’m satisfied, with some exceptions (both high and low). Psyc 217, Research Methods, is a course I love and have now taught 4 times — and I’m pleased to report that my students rate it highly. Students in my Intro Psychology courses, both terms, rated me well but not exceptional, and I think that’s totally fair. It was my first time teaching those courses, and the numbers are in the range of those I received the first time I taught Psyc 217. Onward and upward!

Across all 6 courses I taught this year, my highest scores come from the “Concern for Students” UMI. This tells me that my deep value of caring for students and their learning is being witnessed in the eyes of my students, through my efforts to this put this value into action (e.g., see my teaching philosophy). Wonderful news!

My lowest ratings come from the “Fair Evaluations” item, and this concerns me. These numbers, particularly for this of all items, are difficult to interpret: Are my students perceiving the learning assessments to be very challenging (which I don’t mind), or are assessments perceived to be so demanding that success is unattainable (which I do mind)? I definitely need to ponder this one further as I dive more deeply into the data. I already know that my evaluation strategy for 208 will change considerably next year (e.g., the midterm was much too difficult and/or lengthy; peer evaluations of papers didn’t work as smoothly as I’d hoped). Of all my courses this year, 208 was the course rated most poorly by my students. I think a large part of that had to do with the complications with evaluations. It was a brand new, custom course that I designed, and although lots went well (I have loads of data on what great things students learned!), there is a lot of room for improvement.

Overall, I’m feeling pretty good about my student evaluations. They help me to see from students’ perspectives what I do well and where I need to focus my improvement efforts. Thanks to everyone who completed them! I will share further insights as I consider them further. Note that I’ll be working on revising my courses over the summer months. If you were a student in any of my courses this year, and are interested in giving some specific, constructive  feedback on any aspect of the course, please feel free to contact me to set up an appointment.