Category Archives: from the classroom

Responding to Student Evals 2011/2012 Part 2: Psyc 100 Introductory Psychology

Welcome to part two of my reflections on student evaluations of teaching from 2011/2012. Please see my earlier post for a general introduction and reflection on feedback from my Psyc 217 research methods course. I have also posted graphs that facilitate comparison across all my courses and years I have taught them.

First, I would like to thank each of my students who took the time to complete a student evaluation of teaching this year. I value hearing from each of you, and every year your feedback helps me to become a better teacher. Please note that with respect to the open-ended responses, I appreciate and consider every thoughtful comment. The ones I write about are typically those that reflect common themes echoed by numerous students.

The first thing I did to start reflecting on my intro student evals was to consider the numerical results (I am a quantitative scientist, after all!). After creating the graph below (click on it to enlarge), I noticed a small drop from last year’s intro psych class. This doesn’t surprise me a great deal for a couple of reasons: (1) last year’s results were the highest evaluations I ever received ever across any course, suggesting they’re a bit of an outlier, and (2) my class size increased by 42% this year relative to last year. An increase in class size from 270 to 370 students makes it that much more challenging to connect with students as individuals. All this said, I was pleased to note that students rated my teaching above 4 across all six of these questions. Compared with the first three bars, which denote my (relatively less positive) ratings during my first year of teaching these courses, I seem to be maintaining my ability to reach my students effectively. In sum: no concerns arose from the numerical data.

 

As I read the qualitative data, I was humbled. The most common comments noted appreciation for the enthusiasm I bring to each class. Here’s an example:

Dr. Rawn is one of the most engaging professors I’ve ever had – and she really made the class something that people became excited about, which is especially hard to do with a lecture hall consisting of 300+ students. Her passion was contagious! Great course, great instructor.

Given student feedback from this class and over all my years of teaching, I have learned that enthusiasm is one of my greatest strengths as a teacher. I try my best to bring enthusiasm for my students, for teaching, for the discipline to class every day. Without such consistent student feedback I would not necessarily know this about myself as a teacher. Therefore, over the years I have learned to cultivate that enthusiasm each day. Sometimes it takes work (I’ve been known to rev myself up to, ahem, Britney Spears or Pink from time to time…), but I find it’s always easier when I actually know at least some of my students personally. To this point, about a dozen students reported appreciating the Invitational Office Hour on Friday afternoons, which I will definitely keep given two consecutive years of positive feedback.

Exams Many students mentioned the exams and coverage of material, but unfortunately there wasn’t a consistent theme that I could use to make changes. Some people reported that there were too many/too detailed/covered too much, but others felt they were just right or too straightforward/easy. Of the three types of comments about exams, reports that exams were challenging in some way were the most frequent. Although I frequently make lots of changes to my teaching practice based on student feedback, making the exams in this course easier isn’t one I’m comfortable doing. The main reason is that I’m not getting feedback that the tests are unfair or unreasonable, either in qualitative responses or in the numerical data (in fact, this class’s rating on “fair evaluations” item is my highest of all my courses). It seems that a minority of students find them especially challenging, but the sentiment coming through is not one of unfairness (which was the case in my research methods course a couple of years ago, and I’ve been working to address it. Read more.). Here’s an example:

She is a good lecturer but her exams are very difficult even if you read the textbook and show up to each class you will find it very difficult to do well.

I have high expectations for my students — and my department does too. Our class average must be in the mid-60s, and over the past few years I’ve created exams that hit that mark. What I will think more about is how I can better reach this minority group of students who report struggling and feeling discouraged because of the exams. Given the above and similar comments, I’m wondering if part of what’s happening is that study strategies for high school are not working in university. I cover strategies in my syllabus and a bit at the start of the year, including in the memory unit, but I wonder if I/our TAs could develop some sort of  extra special study strategies workshop to help reach out to these students who may need a bit more assistance. Maybe I can partner with the Learning Commons on this.

Finally, I’d like to share a few of the quotes that touched me deeply because they signal that my role in these students’ lives was bigger than simply being their intro psych prof. Notes like these are humbling, and fuel my passion for this challenging career.

Overall amazing instructor that taught us through example how to respect others, care about the science of psychology, and take initiative with our learning.

Although I initially thought I would not enjoy being taught by Dr. Rawn, mostly due to her excitedness, I actually felt that her passion for psychology made it more interesting to learn, and the obvious effort she put into teaching was superb. If she sees this I just want to say Thanks!

Really impressive to watch Dr. Rawn work. She knows an incredible number of students’ names, puts in a lot of effort to get to know them individually, and can really hold her own in a 400-seat hall. Her enthusiasm for the subject is matched by an effective and accessible teaching style, and she manages to incorporate an impressive amount of discussion and classroom activities for such a large class. I think it wouldn’t hurt to lay down the smack a bit harder with the kids at the back of the hall, even to the point of kicking them out. Why put up with that? Nonetheless, a really inspirational role model as a scholar, teacher, and an intelligent and talented woman.

Many thanks to each and every one of you for helping me to improve my teaching by signalling both strengths and areas in which I can grow. I wish you the best.

Stay tuned for more course reflections…!

Responding to Student Evals 2011/2012 Part 1: Psyc 217 Research Methods

Thank you to each of my students who took the time to complete a student evaluation of teaching this year. I value hearing from each of you, and every year your feedback helps me to become a better teacher. Based on last year’s feedback (upon which I reflected here) and my additional professional development, I made quite a few changes to my teaching in 2011/2012. I have created graphs depicting results from the University Module Items, which are 6 questions that are asked about every instructor across campus. I have posted those graphs (and the precise wording of each question) here for your consideration.

Please note that with respect to the open-ended responses, I appreciate and consider every thoughtful comment. The ones I write about are typically those that reflect common themes echoed by numerous students.

I am in the process of writing reflections on the feedback I received from each of my courses. After writing about Research Methods, I realized I should probably break up this post, as it was getting quite long! More is to come!

Psyc 217 Research Methods

As noted in last year’s reflection, my major goal this year was to address head-on the fact that on average, students rated the fairness of my evaluations as notably lower than my other UMIs, and many students discussed evaluations in the written feedback. In response, I made four key changes to the course: (1) instead of one long midterm that spanned two classes, I restructured the course so one shorter midterm came earlier and one came later; (2) I revisited every single exam question and ensured I could tie it closely to at least one learning objective in class and/or in the texts; (3) I re-read the assigned chapters in one of the two textbooks and wrote learning objectives I shared with my students (because that particular text has none); (4) I added extra emphasis on the importance of studying from the learning objectives.

I noted two interesting differences in students’ feedback this year relative to last year. First, ratings of fair evaluations jumped by a third of a point. What also jumped by a third of a point was ratings of clear expectations. It seems that the changes I made to the course could have increased both clarity of expectations and perceived fairness. It hadn’t occurred to me before that these two items seem reasonably related to each other: having evaluations that align with clear expectations is one way to operationalize fairness. I wonder about the extent to which these items are correlated (but I don’t have access to the raw data, so can’t test that).

It was especially interesting to read the comments in light of this mean-level analysis. Some students reported that the midterms were too challenging (especially the 2nd), requiring advanced application of concepts. At the same time, other students reported appreciating the challenge. For example, someone wrote,

The midterms were the best written midterms I have wrote at UBC. They were challenging but unlike in some other psyc courses, they went far beyond mere memorization and into deep understanding. Thanks Catherine!

The mixed set of comments suggests to me that I’m on the right track toward an appropriate level of challenge, but I could still be clearer in warning students about the need to apply concepts on exams. I’m not quite sure how to do that, but I’ll give it some more thought for sure. I just looked back at the midterm means and noted that the 2nd midterm average was about 7% lower than the first. I will be aiming to make that one a bit easier (while remaining consistent our departmental requirements). It will still be challenging, but I’ll aim to align it more closely with the first midterm in difficulty.

Many students reported appreciating my enthusiasm for the material and for designing engaging lessons that were interactive. Many students noted learning effectively from interactive elements including the clicker questions, “what’s in the bag?” activity, and groupwork (although a minority of others mentioned they didn’t feel like they learned from these elements). In fact, some people recommended using even more interactive learning activities! Here’s a representative comment that focuses on my interactive style:

I really enjoyed how Catherine broke up class with activities rather than just lecturing all the time. This engaged the students and made concepts easier to learn. I also enjoyed the lab component, although I was nervous for it in the beginning. Iclickers are a great idea, they make you pay attention and try to comprehend the concepts as they come at you, also if you don’t get one right, you know what to focus on while studying! Overall, the active, cheerful, outgoing attitude of professor Rawn encouraged me to want to do well in this class, and in my future!

Thanks for all of your feedback! Even though I’ve now taught this course 8 times, every time is a new adventure, and there is always room to grow!

Stay tuned for reflections on more courses…

Review Session Success!

Today’s Psyc 208 class was, by far, the most successful review session I’ve ever held. For the past two years I’ve tried to hold review sessions in this course. Each year, most people get up and leave. I have to admit that one way I’ve interpreted this behavioural feedback is students’ lack of willingness to participate and engage. This year, inspired by an Observer article by Gurung & Bond (2011), I decided to give the review session one more shot. And it was fantastic!

Here’s what I did differently: I forced myself to re-evaluate what I was asking the students to do, in terms of real usefulness, specificity of directions, and pacing to maintain engagement. Instead of something like “choose to make a concept map or elaborate on a learning objective” for an indeterminate amount of time, I planned a series of four specific “learning opportunities” which I timed and moved students through quickly. I made sure they were able to be completed by people who hadn’t studied yet as well as those who had, and I emailed everyone yesterday to ask them to bring their texts and notes if possible.

Now for a brief overview of the “learning opportunities.” Students  (N=105; 77 present today) are already divided into teams in this course, which at this point in the term made natural  groupings. #1 “Mapping the Territory” involved picking one broad topic/unit from a list I’d prepared and working with 2-4 others to develop a map of definitions, related concepts and studies, ways to apply the concepts, and so on. #2 “Pass your questions” invited everyone to write a question – or even just a key term – at the top of a blank page, and then pass it to the left. The next 2-3 minutes involved writing down whatever they could recall/find to address their neighbour’s question. We did this “passing” three times before returning the sheet back to its original owner. #3 “Application Challenge!” divided the teams into 2 subteams. Pick a topic/concept/theory to challenge the other subteam. Switch papers, and write a thorough scenario that accurately applies the topic/concept/theory. Then switch back and evaluate how well the other team did at generating an application. #4 “Study Plan” involved setting out the specifics of their studying between now and the test on Thursday, including what/when/where/how/with whom.

During this 80 minute period, students got about 15 minutes for each of the four learning opportunities, although the earlier ones spilled over that and the last one was reduced to about 6 minutes (which was all it really needed). I milled about, answering specific questions about the content as they arose, handing out paper, timekeeping and generally being impressed by the strong efforts my students were putting forth.

What I think worked really well about this process was that it moved everyone along, keeping the energy up. Students knew there were four learning opportunities coming, and I stated up front that they were going to be different, so if one wasn’t working for them I asked them to play along and hope the next one spoke to them. All but two people stayed the whole period (a new record!), and the vast majority of spirited conversations I overheard were spot on task.

I asked for feedback at the end. Although I haven’t formally entered it yet, I have quickly read it all. On a 1-5 scale (1 being “not useful for helping me learn” and 5 being “very useful for helping me learn”), the vast majority of responses were 4s and 5s, with only a few 3s and nothing below that. People reported enjoying the activities, feeling more motivated to study now, being able to better tell what they know and what they don’t (yay for metacognition!), and feeling like they covered a lot of ground (although not much in depth). Some spontaneously reported that they’d use some of these techniques when studying, and all activities were nominated by some students as their favourite. The one consistent recommendation for next year that came through was adding more of a warning. Some students reported wishing they’d prepared more ahead of time so they could get more out of this session.

Thanks to all my students who participated today! You have inspired me to keep on taking risks to build increasingly meaningful learning opportunities!

And… GO!

What a start to the term! It’s so easy to forget how much energy and stamina is needed to teach with enthusiasm. One month away from the classroom and after 2 days I’m exhausted! But I’ll find a new rhythm soon enough.

All my classes have now been started. It’s been fun getting to meet new students and to welcome back familiar faces… and only, um, a tad hectic behind the scenes.

Both my new courses started off with some activities that seemed to engage and intrigue… and maybe even relieve! (Comment below with your thoughts if you were there!) For example, yesterday in 218 (stats), I brought a bunch of Psychological Science journals and asked people to flip through results sections and find statistical concepts that were familiar at least a little. There were concepts from the whole course! Really helped to show that we’ll just be building off familiar ideas, which (I hope) made it not so scary. Thanks for participating, everyone! Looking forward to another adventure tomorrow.

Happy Holidays!

I hope this holiday season has brought you much joy and peace. Last week was quite hectic for me as I finished up grades for term 1 while preparing syllabi for term 2 (I’ll finalize and post those in a couple of days). But then I had a wonderful long weekend celebrating Christmas with my husband. For the past few years we’ve had friends in town to share festivities, and that’s always lovely fun. This year it was just the two of us, and it was perfect too 🙂 One of the things we love to do together is cook. We just love the teamwork! So this weekend we spent ages cooking together… and then eating our delicious results!

I still can’t believe how quickly Term 1 went by! The end of November brought our 2nd Annual Psyc 217 Research Methods Poster Session: this year with over 130 posters and over 600 students across 7 sections of the course. The energy about research projects was exciting! I think we developed a good system this year too, smoothing out some of the registration kinks from last year. Next year we’ll be ready to bring in a larger audience and media — how exciting!

Our Psyc 100 Section 002 is coming along swimmingly in my opinion. The larger size (about 375) compared with last year (about 270) presented a few disruptions at the beginning of the term, but I think those are subsiding for the most part. A unit that stands out for me this past term was Language and Thinking: We had great fun exploring how babies learn one language and two. Such fascinating research is being done on this front! Take a look at this TedTalk by Dr. Patricia Kuhl for a taste of what we learned. If you are in this course, what was your favourite unit from Term 1?

Thanks to everyone for an interesting Term 1. It has been great getting to know many  of you, and I hope to meet everyone else in Term 2. I look forward to another exciting term of leading you on your learning journey!