Category Archives: Uncategorized

Responding to Student Evals 2011/2012 Part 3: Psyc 208 Special Topics

Welcome to part three of my reflections on student evaluations of teaching from 2011/2012. Please see my earlier posts for a general introduction and reflection on feedback from my Psyc 217 research methods and Psyc 100 intro course. I have also posted graphs that facilitate comparison across all my courses and years I have taught them.

First, as always, I would like to thank each of my students who took the time to complete a student evaluation of teaching this year. I value hearing from each of you, and every year your feedback helps me to become a better teacher. Please note that with respect to the open-ended responses, I appreciate and consider every thoughtful comment. The ones I write about are typically those that reflect common themes echoed by numerous students.

Psyc 208 Section 2 Special Topics: How social psychology can help you succeed

This special topics course is one that’s near and dear to my heart. I developed it with the goal to help students learn to learn. It’s an applied social/sport/positive psychology course, where I have hand-picked the topics and consistently encourage their application to each student’s personal learning journey. This course includes a group project for which the ultimate goal is to learn to identify a problem in your life, then find and evaluate research-based ideas to address it, then share your findings with others. See the syllabus for more information.

Last year in 2010/2011, I almost completely revamped the course based on students’ feedback and my own experiences the year before. You’ll see a major improvement in students’ perspectives on this course when you look at the graph comparing the quantitative data from the first offering in 2009 to last year. This year, I didn’t change much after that total revamp the year before. The evaluations from 2011/2012 are very close to those from 2010/2011, which supports my hypothesis that the revamp was a very positive change. Both “fair evaluations” and “clarity of expectations” are lower than where I’d like to see them, and they’re actually the lowest of all my courses last year. This warrants action.

Two main themes came out of the comments. First, the midterm was perceived to be too long. This surprised me, given that I shortened it from last year based on similar feedback, and do not recall that sentiment being shared with me during the semester. It seems that again I need to reduce the length of that midterm. Related to the midterm topic, a number of students reported being unsure about how the textbook material would be represented on the midterm. One student made the helpful suggestion that I note which parts of the readings are “need to know” parts. I’m not sure how I can do that and not compromise the test, but it’s definitely worth some strategizing about how I can better prepare students to integrate that material.

The second consistent theme was the groupwork. A few people seemed frustrated by it, some appreciated its place in the course and still others enjoyed it. I’ve often received such mixed feedback about groupwork. One comment about groupwork that I found particularly interesting was this:

Overall, your class and you were very engaging and I learnt a lot in the class, I enjoy the material quite a lot and find myself spreading the knowledge outside of class. I always enjoyed going to class and I liked seeing the team projects. I however do not particularly like team projects but it was useful for this course and in our future lives. I feel  team projects just take so much longer than doing it yourself and that when you get some classmates that do not care about their marks, it really puts more weight on the rest of us.

This comment stood out for me because it takes a common sentiment–that people often dislike groupwork because of relying on others–but recognizes its appropriateness in this course. Not too many people took this perspective, but it’s one that I hope to cultivate more. Its practical value is exactly why I designed this team project in the first place. Based on this and other feedback, I need to work on communicating that intention and the expectations of it more clearly. I think after using this assignment twice now (including tweaking it for 2011/2012), I have an even clearer idea of what I expect from these projects. I will do my best to communicate those expectations more clearly. One of the changes I made based on last year’s feedback was to adjust the proportion of the grade devoted to the group versus individual components. Interestingly, no one mentioned this individual/group grade proportions, suggesting this weighting is no longer an issue.

Last, quite a few people made comments suggesting that my overall intentions in creating this course are being realized (well, getting there at least!). Here a couple of examples:

Awesome course! I enjoyed the emphasis on active learning. It was a nice change from the classes I usually take.

Clearer guidelines for assignments and groupwork would be helpful. Otherwise, I really enjoyed this course- it was helpful both academically and personally.

I have enjoyed the setting of “team environment” throughout this course. Engaging students in the subject encouraged me to learn more effectively and study more efficiently.

Thank you for your thoughtful feedback. I will definitely work on clarifying those expectations, and will shorten the midterm for next year. I’m glad that many of you found the active learning emphasis helpful for your learning!

Stay tuned for one more…!


Intro psych section is full!

I’m starting to receive a few emails from people who are interested in my section of intro psych (Psyc 100 Section 002, MWF 1-2pm), but it’s full! First, thanks for your interest in my course! Second, don’t panic, there’s still a good chance you can make it in. There is always some shuffling around during the first week or two of class. If you don’t happen to make it in on your first try, then I recommend coming to class and treating it as if you’re enrolled, then watching the registration carefully so when a spot opens you can jump in. Good luck, and hope to see you in September!

Update: Please note that waiting lists *do not exist* for any psychology courses. Based on feedback from our admin staff, apparently they’re a logistical nightmare and we have way too many people interested in psychology courses to be able to manage them.

Reflecting on Student Evals, 2010-2011

Because I pour so much of my heart and soul, sweat and tears (never blood, yet anyway) into each course, I find it necessary to wait a while after a course is over to view the student evaluations of those courses. It can be very emotional to read them, full of breathtaking highs and, occasionally, devastating lows (I appreciate criticism, but not one worded disrespectfully). I have posted summary graphs of my scores and some commentary here, and will share some further reflections in this blog post. Links to all my course syllabi are available here.

The first thing I noticed was how students rated my introductory psychology course overwhelmingly positively. Those ratings are the highest I have ever received. This was absolutely thrilling! I had felt throughout the year a special rapport with this class, despite its large size (N=260). Their energy, curiosity and astute questions continually kept me on my toes, and this in turn fueled my own passion and excitement. I want to share with you a particularly thorough–and not 100% positive!–comment that might give you a feel for what to expect from me (if you’re shopping for courses):

At first, I didn’t like the way Catherine Rawn taught. She was a little too flamboyant and enthusiastic. I felt like she babied us a little. But as the year went on, I really began to appreciate it. I found that I paid attention even to the material I wasn’t particularly interested in. I appreciated her invitational office hour. I never would have gone to her were it not a “requirement,” and that was actually the point that caused me to like her better. I realized that she actually cares about her students (enough to LEARN OUR NAMES, which impressed me) and she was willing to be challenged and she was very respectful to students with opinions different than hers. I have to say that she is one of the better professors I have had in my first year of university. She was interesting, prepared, open, enthusiastic, and positive. She may have babied us a little, but only in the sense that she was so open to help. She still gave challenging and stimulating assignments. Overall, I would say, I thank her for doing a good job.

It’s an interesting comment, to me anyway, in part because it uses a term I’ve received in evaluations before: “babied.” This always intrigues me because I suspect it has something to do with people’s notions about what learning should look like in the university classroom: It should be serious! I attempt to infuse some fun in my courses (e.g., cheering!), I enjoy and find value in exploring with my students, and starting with the basics is important especially in an introductory course. My intention is never to baby, but I also want to dispel the notion that learning has to always be serious. Learning can be fun! Overall, I’m very pleased with the ratings of this course, and will not be making major changes to it next year… with one fabulous exception: the introduction of Peer Tutors! Ten fantastic “grads” of my course from last year have volunteered to help answer questions and act as role models as new students transition to my course and university more broadly. Looking forward to introducing them soon!

The second thing I noticed was that although my scores for Psyc 217 Research Methods are solidly and largely positive, I’m still having a challenge as students are perceiving my evaluations to be less fair than is average across campus (though not unfair per se; see the means on my “evaluating teaching” page, linked above). It is possible that this is simply perception given that this is a very tough course (which is true for all Psyc 217 sections), as it should be because it provides the foundation for all further study in psychology and other behavioural sciences. Yet it’s also possible that my evaluations are in fact less fair than is average across campus. In order to address this consistent rating, I am vowing to critically re-evaluate my exams and assignments this fall. One of those, the group research project, is common to all sections and has a common grading key/rubric, so there’s little to change there. My action plan for evaluating my exams and assignments is to gather all my learning objectives together from every lesson of the course, as well as the broader course objectives stated in the syllabus, and the readings for each unit. I will then consider every question on every evaluation, specifically in terms of how well it links to one or more objectives. Then I will consider whether any question isn’t measuring any objective, and toss it. Then I will consider whether any objective isn’t being addressed, and consider whether the objective should be changed/tossed or measured. After I conduct this analysis of content validity, I will use data from previous years (as I often do) to inform changes to the individual questions to improve their ability to accurately measure learning in my course. I expect my students to use my stated objectives as a road map; it’s time to re-check that they’re aligned with the way I’m evaluating that learning.

Third, I was pleased to see that my scores for Psyc 208 Section 2: How Social Psychology Can Help You Succeed (Special Topics) have improved much from the first time I offered it in 2009, as I used the feedback from 2009 as well as inspiration from a talk by Michael Wesch last summer to make substantial changes. It’s an unconventional course, with lots of teamwork and interaction. For one, I implemented the validity analysis process for exams I explained above (for Psyc 217), which resulted in much fairer exams. As for improvements based on this year’s feedback, I will shorten the midterm a little, and make some small adjustments to the grading of the team project so that individual work related to the team project is weighted more heavily relative to the team grades. Also, I’m considering making grading keys available for the team assignment to improve the clarity of what’s expected for each. Given this feedback, I’d like to share one of my favourite comments from this course, because it reflects my intention in creating this course and in how I structure each and every lesson/experience. Of course they’re not all this positive, but indulge me:

Easily the best teacher I have had at UBC. She should hold workshops for other professors! Or publish a book, or work w ith the Chapman Learning Commons to develop a free, non-credit version of the course that students can take to learn how to improve their university experience. I would recommend her course in Social Psychology and its application to academic success to any student regardless of faculty or major and consider it an invaluable tool to my success. Catherine was always helpful, expected the best of her class and demonstrated an unparalleled concern for the personal and academic development/wellbeing of her students.
I have offered these (lengthy!) reflections to you as evidence that I take student evaluations very seriously, and make real changes to my courses in response to them. Teaching psychology to learners is my passion and, I believe, my calling. I am delighted that so many students report valuing the way I teach and what I contribute to their university experience.

Looking for the Instructor Network?

Visit https://blogs.ubc.ca/instructornetwork/ to log in, if you’re a member. If not, but you are a UBC Instructor-1 or Senior Instructor, please feel free to email me for access (cdrawn@psych.ubc.ca).

Collage!

Check out the collage I made yesterday! See yesterday’s post for details. Ok… now back to the to-do list!

Office Collage June 2011