Tag Archives: Intro

2013/2014 Student Evaluations Response Part 1/4: Intro Psych

Thank you to each of my students who took the time to complete a student evaluation of teaching this year. I value hearing from each of you, and every year your feedback helps me to become a better teacher. As I explained here, I’m writing reflections on the qualitative and quantitative feedback I received from each of my courses.

 

After teaching students intro psych as a 6-credit full-year course for the past three years, in 2013/2014 I was required to transform it into 101 and 102. Broadly speaking, the Term1/Term2 division from the 6-credit course stays the same, but turning Term 2 of Psyc 100 into a semi-standalone Psyc 102 proved more challenging than converting Term 1 into 101. Because these two courses really still form one unit in my mind, and I structure the courses extremely similarly, I will discuss them in tandem.

Across both courses, quantitative feedback was similar (albeit a bit higher in 101 than 102). Students rated the textbook equally high (4.2 & 4.3/5), which makes sense because I use the same text for both, and many students have told me informally that they enjoy reading the book (some qualify this endorsement with “for a textbook”). Check out my overall UMI scores from this year and all previous years here (click to enlarge, and click here for further discussion of UMIs):

IntroPsycHistoricUMIs.2009.2014

 

In the qualitative feedback, many of the same positive and helpful features were highlighted by students in both courses. Overall, students report enjoying and finding valuable the clickers, classroom discussions (often tied to clicker questions), films, opportunities to apply what is being learned, the 3-midterm format that helps stay on top of things even if it’s slightly annoying to be so frequently tested, music before class, the organization of class periods, my enthusiasm and energy, my effort to learn many students’ names, and the Invitational Office Hours. Capturing many of these commonly-mentioned features, one student from Psyc 102 wrote,

It was incredibly impressive how she tried to learn the name of every single student that she interacted with, despite the size of the class. The IOH were also a surprisingly fun experience. The class was very interactive, which definitely helped me learn, and even though I was unhappy about having three midterms at first I think I have to conclude it made studying for each one much easier and less stressful.”

One new element I added to both courses this year were five mini-papers which I called “Writing to Learn” (W2L) assignments (replacing a single 500 word paper I used to assign to be marked by TAs; see last year’s reflection for rationale). Students picked a topic from each of the two chapters about to be tested, wrote a paragraph explaining and applying the concept to their lives, then read 5 peers’ papers and gave feedback to them using peerScholar software. Students received feedback from their peers, and were able to choose any two topics to improve and reproduce on the final exam (no notes!). Overall, students reported finding the Writing to Learn assignments helpful for learning, and some mentioned that reading others’ work was helpful as well (both of these results are consistent with past research on similar writing assignments and peer review). My TAs have reported being able to grasp whether students knew what they were talking about from the writing section on the exams – and my test scores were higher than in previous years, so the goal of increasing learning seems to have been met! However, of the students who mentioned the W2L assignments, many noted that quality of peer feedback received was low. Dr. Peter Graf and I are just starting a project to deal with this very issue of enhancing peer feedback. It may take a couple of years to figure it out in a way that’s scalable to 300-400 students at a time, but we’re working on it.

Interestingly, a couple of students in each course noted my responses to student incivility. In one case it was failing to follow instructions to complete the bubbles during the exam time given, and another case (mentioned a few times in 102, actually), was my response to students talking in class. Side chatter is really only a problem in my first year courses – and it’s a consistent one that varies in severity year-to-year with different cohorts. Interestingly, Gillian Sandstrom and I have a paper about to come out in Teaching of Psychology showing that some chatter is a good thing: it can build a sense of community in a large class. But it can feel disrespectful and distracting to me. Perhaps I should consider building in even more opportunities for structured conversation, because clearly it’s going to happen anyway.

In 102 this year, rather than devoting a whole week to Chapter 2 Research Methods – which I do in 101 in the same place I did back when I taught the 6-credit version – I decided to split it up and cover topics as they came up throughout the term. For example, I used intelligence testing as a chance to discuss measurement and survey designs, and social psychology (specifically Milgram’s studies) as a chance to address the ethics of deception in research designs. Although I think this was a solid solution in theory, in practice there were definitely times when I felt like I was awkwardly wedging topics in to 102. Indeed, a few students mentioned this flow problem too – and it seems to be students who took both 101 and 102 with me who noticed the difference. Hopefully next year I’ll be able to smooth topics out a bit more effectively, perhaps cutting even more material to make more room for these new topics and ensuing discussions.

Although I still would prefer to teach intro psych as a unified whole with the same students over the whole year, apparently that’s not an option any longer. I have begun the process of converting this course into two halves effectively, and given the feedback above, I think I’m heading in that direction.

Term 2 Exam Period Drop-In Office Hours

Please note that my regular office hours as stated on my syllabi are on hold for the summer. During the exam period, my drop-in office ours are as follows.

Psyc 218: Friday 11 April 2-3 and Tuesday 15 April 11:30-12:30

Psyc 102 and 208: Tuesday 22 April 11-12

Or, please email me for an appointment.

I wish you thoughtful and thorough preparations for your final exams, while remembering that those finals — any grades — do not define who you are or what you can contribute to this world.

Have a fabulous summer!

My Fall 2013 Syllabi

Check out my Fall 2013 syllabi! After spending a lot of time thinking about these courses this summer, I’m excited to share my new syllabi. Psyc 217 features heavily revised Course Goals, new supplemental readings, and a References section listing research that I used to make decisions about this course (e.g., design, policies). Psyc 101 features revised Course Goals and new regular small writing assignments to replace a paper I assigned in years past. I also developed a graphic to help explain the new short writing assignment process.

Psyc 101 Section 005

  • MWF 12-1pm in CIRS 1250
  • 360 students
  • Teaching Assistants: Sara Knauft and Stef Bourrier

Psyc 217 Research Methods Sections 001 and 002

  • MWF 9-10am (Section 1) and 10-11am (Section 2)
  • 92 students per section
  • Teaching Fellows: Allison Brennan, Julia Kam, Jennifer Lay, and Eleni Nasiopolous

See you at Orientations and Imagine on Tuesday, and in class on Wednesday!

Student Evaluations of Teaching 2012/2013: Part 1 Intro Psych

Thank you to each of my students who took the time to complete a student evaluation of teaching this year. I value hearing from each of you, and every year your feedback helps me to become a better teacher. As I explained here, I’m writing reflections on the qualitative and quantitative feedback I received from each of my courses.

Introduction to Psychology

Overall, I was very pleased with my introductory psychology students’ assessments of my teaching this year. Quantitative data were all highly positive (see the orange bars here).  In the qualitative responses, many students highlighted my enthusiasm, organization, strong communication skills, and care for getting to know them as individuals. Because these themes emerge regularly, particularly from my introductory students, I have learned to embrace them and lean into them – a strategy that seems to be working! Specific features of our course/my teaching that many students noted as particularly effective include i>clickers as a way to engage attention and reinforce learning, invitational office hour as a way to connect personally with students, videos and demonstrations in class to make points memorable, and having three midterms (rather than two, as we did in 2nd term) as helpful for keeping on top of readings. For next year, I’ll switch term 2 (which will be a separate course, Psyc 102) to a three-midterm format.

Mid-way through the year, I was discussing the use of Learning Objectives with students at an IOH. During that discussion, someone suggested I keep the Learning Objectives posted somewhere throughout the class, to serve as a reminder of what students need to especially focus on understanding and doing. In response, I committed to posting the LOs before each class period on our Vista course website. That way, students can consult them throughout the class (provided they have a device to do so… which many do). Many students noted that they found this cumulative list of LOs helpful during class as well as later as an exam study tool. There are many reasons why I can’t post my slides before class, but I can commit to posting LOs. Because this simple thing seemed to be so helpful for at least a subset of students, I will continue doing this in the fall (and perhaps extend to all my courses).

Exams and papers were two discussion points that were noted in various ways in quite a few posts. Regarding exams, many students noted they were challenging (which I embrace), yet a few added that they felt unprepared for this level of difficulty. One of the things I will consider doing next year is holding an optional review session outside of class time before at least the first midterm. I’m not willing to simply re-teach material (as if coming to the review session would be enough studying, or would substitute for coming to class thrice weekly), so I’ll have to think more about how to approach them (see Regan Gurung’s Observer article). Logistically this could be tricky, especially if there are many students who attend. I’ll have to give this possibility some more thought.

For the past four years I’ve required students write a 600 word paper each term on one of two or three topics each term. All papers have in common a requirement to do something to apply a course concept, summarize what they did or saw, and explain how that event illustrates that concept (e.g., write a study plan applying principles of memory). A handful of people gave really thoughtful feedback on the main challenge this paper poses: 600 words isn’t long enough to dive deeply into the material. I haven’t been thrilled with the quality of the papers recently… in part because I simply can’t offer a scaffolded process with meaningful feedback to 250-350 students a term. To help address this feedback issue, I turned it over to the students this year. I added a requirement to the paper that people give peer feedback to four of their peers’ papers using peerScholar software, and gave people a week to incorporate the feedback they received (if they chose to do so) before final submission. To my surprise, not a single person mentioned peerScholar in their qualitative feedback. Was it just not memorable? Not helpful? I can’t tell. I recall having called a vote using i>clickers at the end of term 1 during which people endorsed it as useful and wanted to use it again… but it didn’t show up at all in student evals! I’m really not sure what to make of that, but I presume students didn’t hate it or else I’d have heard about it. I’m considering a new approach to the papers, inspired by this ToP article I wrote about a few weeks ago, while incorporating peer ratings through peerScholar as a study tool. I think that could work to satisfy both my writing-to-learn and peer feedback goals.

Notably, the graph highlights the fact that my classes of ~250 (2010/2011, 2012/2013) seem to be rated more highly than my classes of ~350 (2011/2012). Given this pattern, I am a bit nervous heading into next year. For the past three years I have been fortunate to teach some of the last three 6-credit sections of Introductory Psychology (Psyc 100). From now on, admin has decided that all sections will split into 101 and 102. The content mostly mirrors the first half and second half of Psyc 100, respectively, but with two huge differences: it’s not (entirely) the same group of students, and because neither is a prereq for the other, 102 students might not have had 101 at all (let alone with me). Having the same group of students all year has afforded me the rich opportunity to establish relationships across eight months with the same group of students. I can invite every single student to an Invitational Office Hour over that length of time – which has led me to personally meet 70% of my intro students in each of my last three cohorts. In 2013/2014, with 350 students in Psyc 101 and potentially an entirely different crew of 250 students in Psyc 102, there is logistically no way I can invite everyone. Because IOH has been so enormously successful, I will continue it. But it will need to be by random selection (plus an open invite to keen students), and I will no longer be able to offer 1% for coming and “engaging in learning” because I can’t offer that opportunity to everyone. I’ve met such interesting students and established great relationships and community through IOH… I hope people still come!

My advice if you’re choosing intro psych for 2013/2014: sign up for Psyc 101 and 102, in that order… with me J (or someone else, but I’d love to meet you!). Then, if you’re in my sections, come to IOH so we can get to know each other!

Many thanks to all my Psyc 100 students in 2012/2013 students who completed this evaluation. The response rate this year was 62%, which is among my higher rates. And thanks to the whole class for a fun year of learning about psychology!

Reflecting on APS

Last week I attended the Association for Psychological Science Convention for the first time, including the Society for the Teaching of Psychology  (STP) Teaching Preconference. I am grateful to STP for awarding me an Early Career Travel Grant to help me offset the cost of my flight all the way from Vancouver Canada to Washington DC.

One of my nerd-tastic highlights was seeing the actual apparatus Milgram used to examine obedience to authority back in the ’60s.

 

Beyond the obvious awesomeness depicted above, I can point to three key ways I benefited from attending this conference.

1. Networking

I have elaborated on how I went about networking in my previous post. Who I connected with was also critical. At the Teaching Preconference, I met two other research methods textbook authors, including the always-inspiring Beth Morling, and my US-Edition Cozby counterpart Scott Bates. Scott gave an insightful talk on how he is using the APA guidelines for psychology majors to steer his course (re)designs; it was fun to talk with him afterward about course design and how he came to work on the Cozby text too. Turns out both our stories share a similar right place/right time theme. Also, I was delighted to meet a fellow regional representative of the STP’s Early Career Psychologist Council, Ali O’Malley at Butler University.

For the rest of the conference, my networking opportunities were largely driven by Twitter conversations and chance encounters. For example, I happened to sit next to my UBC colleague Eric Eich during the good data practices symposium (see below). He’s the editor in chief of our field’s top journal, Psychological Science. Sitting next to him meant I met Bobbie Spellman, editor in chief of Perspectives On Psychological Science (PoPS). As speaker after speaker pointed to journal editors as the key to improving our field, it was interesting to consider their perspectives too. Tweeting regularly meant that people recognized me, I could learn what was happening in other symposia, and I had conversations in person and online that would not have been possible otherwise. Check out this Twitter feed for what was said by everyone using #aps2013dc.

2. Insight into Good Data Practices, Replicability, and Data Ethics

One of the major reasons I wanted to attend APS this year was the theme program on Building a Better Psychological Science. These speakers built on their contributions to a recent issue of PoPS focusing squarely on this topic.  It was fascinating to hear Daniel Kahneman recall his early days as a psychologist, during which he gave up on a line of research that seemed profitable but he couldn’t replicate to his high standards. Apparently, his own introspection on how he could have been so convinced his small sample studies would replicate became the basis for his later revolutionary and Nobel Prize-winning work with Amos Tversky. Seems to have been a good choice.

Collectively, this lengthy line-up of speakers helped me reconsider the big-picture costs of the way our field has under-valued exact replications in favour of conceptual replications, and how we’ve been chasing p-values below .05. The arguments weren’t really new, but packaging them together in this symposium was impactful for me. Now that I’m a textbook author preparing for my 2nd edition, I found myself constantly considering how we can help our 2nd year psych majors learn best practices. For example, why not include an ethics unit in a statistics course? There’s usually one in research methods… but why not stats too, dealing with data management and reporting and fraud? Also, I’ll be changing the way I discuss the value of exact replications in my next edition. In courses, we could require our students to submit their data and analyses along with their final papers, to be able to reward data archiving and get our students into the habit of submitting raw data to back up claims. So much to (re)consider…

Talking to colleagues about the teaching-related implications of the Good Data Practices symposium was a fascinating exercise. It seems obvious to me that we should be “raising” our majors on best practices, yet there was more variability in reactions to this idea than I had expected. Many colleagues seemed to have simply not considered implications at an undergraduate level, but agreed with me that it’s a good place to start. In a couple of cases, I was challenged about whether such efforts would have any effect. These challenges have compelled me to consider writing a why bother/how-to piece to submit for publication. (Oh summer, could you give me an extra month?)

3. Ideas for my classes

Throughout the entire conference and preconference, I had tons of ideas for my courses! I mentioned a few above regarding methods and stats. In addition, Laura King helped me re-think how I approach Personality Psychology in intro: “you wouldn’t spend a full day discussing phrenology in the biological psychology unit, so why spend a full day on Freud in the personality unit?” Wow. That hit home. I do incorporate modern science of personality in intro, but I will be making major changes to that unit next year.

In her preconference keynote address, Beth Morling offered a ton of specific ideas for intro and methods, centred on her priority of creating effective consumers of psychological research. Specifically, she promotes teaching students to identify the type of claim being made (frequency, association, or causal), and asking four questions about the validity of the study (construct, internal, external, statistical). Which of the four validities is most important depends on the type of claim. See her blog for a bevy of excellent examples. This consumer-oriented approach will inform how I teach methods in intro in particular, where I’m not training psych majors.

Talks by Scott Bates and Keith Stanovich prompted me to strongly consider changing my supplemental readings for research methods. In addition to his course design process, Bates offered a great resource on the purpose of APA style as an indicator of values in the discipline. This article dovetails with conversations a colleague and I have had about this very topic (Jaclyn Rea of our Arts Studies in Research and Writing department). I am strongly considering incorporating this discussion into methods this fall. Usually, I assign parts of Stanovich’s text How to Think about Psychology. I’ve always known it’s unpopular with many students due to its long-windedness and general lack of pedagogical features to help students learn from it. I value his ideas, which was why I’ve been assigning it for years, but the packaging just doesn’t compel my students to read it. I must say that hearing him speak convinced me that although his ideas are insightful he seems to have little sense of audience–a feature reflected in his book, too. Although I’ll still draw from and cite his book, I may be replacing those readings with the APA style article and some other big-picture perspectives on replicability/methods.

Another idea came to me at a talk by Jason Priem, who is promoting his altmetrics approach to measuring scholarly impact. I’d like to create a shareable library for each course in Zotero including all the papers I cite during class. Students can follow up on any article they want, and I can always find what I’ve cited. It’ll be a lot of work to set up, but once it’s there, it’ll be a rich resource that’s easy to update and share.

****

What a fun exercise this was to reflect on my notes and memories from this conference! I highly recommend this process to anyone hoping to actually follow up on rich conference experiences. I am pleasantly surprised by how much I gained from going to APS. I had feared it would be just too big and overwhelming to extract anything meaningful, but that fear was wholly unfounded.

Thanks for reading. Have an experimint.