Tag Archives: summer

Two-Stage Exam: Introduction and Resources

Time to dive in! After thinking about them for a long time, this term I’m converting my exams into two-stage exams.

  • Step 1. I shorten the exam so it’s doable in about 2/3 of the testing time slot.
  • Step 2. Students write the exam individually.
  • Step 3. Students immediately — during the same class period — write the same exam again in groups of 4.
  • Step 4. Grade the exams as usual, but 90% of the score comes from individual, and 10% from team, with a guarantee that if you do better than the team score you get 100% weight for the individual (which very rarely happens, so I’m told).

Why am I making this change?

Four key reasons:

  1. Data. A growing pool of evidence is showing that team tests help students learn. See references below.
  2. Feedback. My classes are very large, so I struggle to give any personalized feedback at all, especially timely feedback. By re-doing the test immediately with peers, they get to immediately discuss the questions and come to the right answer (according to data).
  3. Exam improvement. Based on my evaluations, a small but consistent group of students find my exams very difficult and/or too long. Because I still only have 50 minute classes to work with, this change will force me to shorten my exams, culling and distilling to just the most effective questions that measure deep learning.
  4. Community. I value collaboration and building a supportive community. Research papers and instructors who have used this method report extra benefits beyond learning: students have more rapport with each other and are more willing to participate with their peers in class throughout the term. Also, Gillian Sandstrom and I have a research paper in press showing the more students talk in class, the more they feel like part of a community and interested in the class. So… back to data.

Interested? Here are some quick and effective resources for implementation:

  1. Videos by the CWSEI team depicting Two-Stage Exams in action.
  2. Jones, F., Gilley, B., Harris, S. (2013). Tips for successful two stage exams. The EOS-SEI Times, 6(9). Retrieved http://www.cwsei.ubc.ca/Files/EOS/EOS-SEITimes_4.1_GroupExams.pdf
  3. Jones, F., Gilley, B., Lane, E., Caulkins, J., & Harris, S. (2011). Using group exams in your classes. The EOS-SEI Times, 4(1). Retrieved http://www.cwsei.ubc.ca/Files/EOS/EOS-SEITimes_4.1_GroupExams.pdf
  4. PHAS-CWSEI Team. (2012). Two-stage (group) exams. CWSEI–PHYS & ASTRO Newsletter. Retrieved http://www.cwsei.ubc.ca/Files/PHAS/PHAS-CWSEI_Newsletter_Summer-2012.pdf
  5. Brett Gilley, aka @ModernHydra

Data

Dahlstrom, O. (2012). Learning during a collaborative final exam. Educational Research and Evaluation: An International Journal on Theory and Practice, 18, 321-332.

Eaton, T. T. (2009). Engaging students and evaluating learning progress using collaborative exams in introductory classes. Journal of Geoscience Education, 57, 113-120.

Gilley, B. H., & Clarkston, B. (2014). Collaborative testing: Evidence of learning in a controlled in-class study of undergraduate students. Journal of College Science Teaching, 43, 83-91.

  • A particularly well-designed example.

Leight, H., Saunders, C., Calkins, R., & Withers, M. (2012). Collaborative testing improves performance but not content retention in a large-enrollment introductory biology class. CBE—Life Sciences Education, 11, 392-401.

  • The title might be alarming here… they showed no effect of the 2-stage exam on final exam performance (compared with material that had been previously tested only with individual tests). I’m ok with this. Not every study is going to find the same effect (particularly ones with some execution oddities like this one), yet this is still a “no-change” effect with no evidence that student learning decreases. Moreover, students still enjoyed the process and found it less stressful than the individual-only tests. No harm done, potential benefits.

Rieger, G. W., & Heiner, C. E. (2014). Examinations that support collaborative learning: The students’ perspective. Journal of College Science Teaching, 43, 41-47.

Roediger, III, H. L., & Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, & Cognition, 31, 1155-1159.

  • Two-stage tests might help to fight the negative consequences of MC tests: you remember what you answered (and thought was right), not what actually was right.

Sandstrom, G. M., & Rawn, C. D. (in press/2014). Embrace chattering students: They may be building community and interest in your class. Teaching of Psychology.

Zipp, J. F. (2007). Learning by exams: The impact of two-stage cooperative tests. Teaching Sociology, 35, 62-76. doi: 10.1177/0092055X0703500105

 

 

 

Olympics are over!

Time to get to serious work!

I have spent the last two weeks thoroughly distracted by the Games — almost as badly as when they were here in Vancouver! While I realize that there are economic and social problems with the Olympics, I find myself inspired by the accomplishments and even the disappointments our athletes face. (And I say “our” to reflect my fierce Canadian pride that especially swells at times like this.) From Rosie MacLennan’s first (and Canada’s only!) gold medal performance, our women’s soccer team pulling themselves up from last place in the world last year to win bronze, *so* many top 10 but out-of-medal performances, the heartbreaking DQ in the men’s 4×100 relay after a shocking rise from off-radar to bronze position… and many many other inspiring moments. Our athletes showed their pride of achievement, and sadness while striving for dignity in defeat. Watching people strive for amazing and challenging achievements inspires me. Such performances highlight the risk involved in devoting your life to a goal, especially a competitive goal defined by social comparisons. It’s possible you’ll never achieve it — and it might be because of simple bad luck, or the fact that someone else just outperforms you (imagine competing in a cohort that just happens to include Michael Phelps or Usain Bolt!). It must take tremendous strength of character to say, “I did my very best, and I’m proud of my accomplishment” after off-podium, far off-podium, or defeat finishes in a domain in which you stake your identity.

Of course, it wasn’t just the Canadian’s who inspired me. There were some incredible “firsts” of these Games that will have an important legacy: Oscar Pistorius, who blurred the boundaries between Olympics and Paralympics; every country competing sent at least one woman; every sport was open to women and men — even boxing; and best all-round female gymnast went to a woman of colour, Gabby Douglas, for the first time ever. Some of these firsts seem bizarrely delayed, it being 2012 and all, but I suspect that feeling is more a product of my sheltered Canadian vantage point than reality.

Thanks, London 2012, our Canadian Olympic Team, and all Olympians, for giving me an excuse to pause and reflect on achievement, failure, competition, national pride, women’s rights, the meaning of physical ability and disability.

Now really, it’s time for me to get back to work!

Networking, Celebrating, and New Ideas

This week has been a busy one, in a good way! Here are some highlights:

Accomplished a Goal: the Instructor’s Manual

On Monday I was relieved to finish the instructor’s manual to accompany my research methods textbook. Not every textbook has one, and from my own experiences I’ve noticed they vary in usefulness. The point of an instructor’s manual is to give instructors ideas for ways to engage their learners in the material. The prompts most often include demonstrations, in-class and out-of-class activities, discussion starters, and sometimes include assignments and references to other resources. It was fun to go back through my own lessons and add my teaching techniques, along with ideas for assignments and grading keys, course sequencing, and other tips. I hope instructors find it useful for engaging students in learning research methods!

Networking and Socializing Events

Members of our Instructor Network gathered on Tuesday afternoon for an informal meet-and-greet. In addition to reconnecting with colleagues I know well, it was fun to get to know some new (to me) teaching-focused people from across campus, including fellow long-distance runner and chair of Critical Studies in Sexuality Janice Stewart, and Computer Engineer Paul Davies. Also, I learned more about the Coordinated Arts Program from newly tenure-tracked Instructors Laurie McNeil and Kathryn Grafton. I had known about the program before, but hadn’t heard about the instructor’s perspective. It sounds like a creative opportunity to engage in collaborative teaching while thinking about the different perspectives one’s own and others’ disciplines offer on a particular topic. Sounds wonderful!

Friday morning was one of my favourite events of the entire year: Graduation! In addition to cheering on all of the psychology bachelor’s degree graduates, I had the pleasure of welcoming two friends to PhD status. It was wonderful catching up with each of them; I was honoured to be able to share in their achievements. Lara Aknin is heading across the city to Simon Fraser University to start an Assistant Professorship this fall, and Jen St. Onge has moved back to her hometown of Regina to work in making industry-research partnerships, including training industry folks in research methods. After the graduate ceremonies and coffee, the faculty who attended all went out for lunch with our Department Head, Alan Kingstone. I had a lovely informal afternoon catching up with colleagues/friends.

Saturday morning I had the pleasure of participating in the Alumni Weekend 15 Minute Degree. Along with some friendly colleagues from across campus, I met with alumni, their precocious children and friends, as well as some current UBC students, to chat informally about what’s new in psychology and teaching it. I enjoyed some delightful conversations including how I use clickers to engage my learners in the classrooms of 100-500 students, how memory works, theories of self-control, what makes modern psychology a science, and how to evaluate therapists when seeking help. And I have to add the weather was amazing!

Professional Development Activities

One of the many things I love about my career is the opportunity to collaborate with other people. This week, I met with the amazing Negin Mirriahi, the Manager of the Arts Learning Centre at Arts ISIT. We met to start analyzing our data from a scholarship of teaching and learning project we started last year. We’re exploring the relationships among students’ attitudes and beliefs about Team Based Learning (specifically the Readiness Assurance Process) and their team project and course grades. We still have a long way to go on that project, but we’re having fun getting there!

On Thursday I led a workshop for the Teaching Assistant Training Community of Practice (through CTLT). Our CoP is a group of people from way across campus (think physics, biology, psych, land and food, french/hispanic/italian studies, english, geography, math, statistics…) who meet monthly with the goal of improving the TA training we offer within our departments (funded by the Provost). Over the past two years we’ve really grown into a supportive community; it’s really a pleasure to make time for this group in my schedule. Anyway, it was my turn to lead a session, this time on cross-discipline/department Standards for TA training. This sounds like an impossible task, but over the course of an hour and a half we discovered that Eison and Vanderford (1993) is a really useful tool for reflecting (and helping each other reflect) on whether we are offering comprehensive programs. Of course, not every item is relevant for every department/discipline. Moreover, the way I address an item can look very different from the way someone else does. We considered the idea that perhaps rather than a common set of standard elements, what might be the best standard would be asking a common set of questions, and having thoughtful answers to them (whatever those may be). Rich discussions throughout!

Last but not least, I had the pleasure of meeting with one of the many graduate students on this campus who inspire me, Natasha Holmes from physics. I met her through the TA Training CoP (above), and she sat in on my Psyc 218 class last term to brush up on her small sample statistics for behavioural sciences (she’s conducting scholarship of teaching and learning for her PhD). Two exciting opportunities came from our meeting: (1) it looks like I’ll be offering a couple of workshops for the STLFs who are doing similar work, and (2) we may be collaborating in her new capacity, as co-director of the Let’s Talk Science program. In LTS, Graduate students go into elementary school classes to lead demonstrations of scientific phenomena. Psychology is science. Let’s get psychology (e.g., understanding of the brain, memory, social influence) into elementary schools! Just an idea at this point, but exciting!

Wow, that was a way longer entry than I expected it to be! Hope you’ve gathered some insights into what I’ve been up to, as an example of what some professors do in their off-season (i.e., often it’s lots!).

Recovering, Reconnecting, Resting

The first few weeks of summer term have been glorious. The weather has cooperated for the most part, and I have been able to take some time to breathe. March and April were more hectic than I anticipated they would be, including a surprise “proofread the entire textbook in the next four weeks” while teaching 8 different classes a week, including a new prep (stats), on top of the two full-textbook reads I expected to complete. [If you don’t know what I’m talking about, I’ve been working for about a hear and a half on adapting the Cozby research methods textbook into a Cozby and Rawn Canadian Edition.] I’ll write more about my reflections on the year later, but for now I wanted to simply express how thankful I am that I’m in such a peaceful place right now.

After running the Vancouver Marathon two weeks ago, I’ve taken some time off of running. Instead, I’ve been doing a bit of swimming (our condo has a pool) and I signed up for an intro pass at Open Door Yoga. I’ve practiced yoga sporadically since moving to Vancouver 9 years ago (!), but never regularly. It seems like a wonderful way to develop strength, balance, and peace – both inside and out – so I’m giving it a whirl this summer. I’ve also been reconnecting with my friends and husband. It’s challenging for me during the school year to fully, truly relax. There’s always another lesson to prepare, another email to deal with. It’s been lovely just enjoying unscheduled time and laughter and wine with these lovely people once again.

Wherever you are in the world, I hope your summer is starting off at least as enjoyably as mine has.

Gearing up for September!

This summer has flown by! Guess that’s what happens when you update an entire textbook, read another one to prep for a new course, revise multiple syllabi, attend two conferences, write a program evaluation report… and a few bits of R&R every now and again including a lovely, wine-filled weekend in Osoyoos, BC. So that’s what I’ve been up to this summer. How about you?

To students and faculty: Welcome (back!) to UBC! If you’re in my intro psych class (Psyc 100 Section 002, MWF 1-2 in CIRS 1250), you may be interested in checking out the syllabus. You’ll get a hard copy when we meet on Wednesday, but you can get the sneek peek here: Intro Syllabus. I had a ton of fun in this course last year and I’m looking forward to it again!

If you’re in either of my research methods classes (Psyc 217 Sections 1 or 2), you can find the syllabus here: Research Methods Syllabus.  I’m looking forward to this course — yes it’s a lot of work for all of us but it can be extremely rewarding and will prepare you well for all  your future studies (and for generally being an informed citizen). We start at 9am (Section 1) or 10am (Section 2) — and you *must* come to the section for which you are officially registered. Yes, it’s early, but let’s have fun anyway! I’m looking for a DJ for the first 5-10 mins before class starts to get us all energized… if you’re up for it let me know!

Looking forward to a fabulous year ahead, full of challenges, learning, new people, new experiences, and fun times 🙂  See you next Wednesday if not before — I’ll be co-facilitating Psychology TA Development Day on Friday, anda couple of Student Success Workshops on Imagine Day on Tuesday — come say hi if you see me around!