Category Archives: Teaching

My case against Clickers

I will admit that I’m generally suspicious of new technology … but am willing to give most things a try. When clickers came on the scene many years ago, I did try them for a term or two – but pretty quickly lost enthusiasm. Over the years, I’ve watched a lot of other teachers use clickers well, and I end up asking myself, “Why do I loathe these so much?” … While walking the dog this morning (which is where I do good pondering), I came up with at least a partial answer.

Celeste and her dog in matching black and white outfits.

(Bonus for our matching outfits)

I like posing complex problems in lectures, and I love the subsequent controlled chaos of student discussion/arguing/learning that ensues. Sometimes I just walk out of the class and get coffee while this is happening. I’m fine leaving, because this learning progress is not about me – and I think that’s where clickers rub me the wrong way. Taking that learning and asking students to display an answer so that … so I can be impressed by it?…  so they can competitively compare their learning to their peers?… None of this bodes well with my cooperative approach to learning. I put work in each term to encourage and teach students to become their own compass for their own learning. A piece of this is to articulate what they want to learn and why. A piece of this should not be “to impress Celeste” or “to out-compete everyone else”.

When problem solving happens in my classroom, we often take a long time dissecting solution(s) and different approaches, so avoiding clickers does not leave students stranded with no learning resolution. Instead, I think it keeps the focus on them as individuals with their own unique learning process.

A 1/2-Baked Plan to Ungrade a Very Large 1st Year Course

I have 2 full years of completely ungrading my 3rd year lab course, so I’ll start by saying I do feel like I can pull this off. However, I also do not underestimate the (fun and amazing) challenge of 1st year, nor do I forget the daunting un-doing of confidence that happens every October when our 1st year students go through their first round of midterms. Those of us in the biz of 1st year dread October because we know what’s coming. It is this, primarily, that I hope to usurp with ungrading in first year.

(If you are not from UBC, here’s some context: In the Faculty of Science, our first year students come in with high school averages well over 90%. Our incoming average is typically 95-97%. So every student sitting in a first year seat in our faculty is an excellent student, has been rewarded for whatever strategies they know work for them, and often define themselves this way. When midterms come back, the average is no longer 90% – not even close. Some first year courses see averages in the 70s, some as low as the 50s, depending on the year and the individual course. You can imagine how this might be traumatizing).

My plan comes in 2 parts, drawing from experience I have gained, and from advice from my amazing alternative grading colleagues. I also always try to uncomplicate things – so I hope it is simple. (There is nothing I hate worse than a spreadsheet with too many columns of trivial stuff.)

Part 1: Formative Fridays. (I need a better name). On 10 (of 13) Fridays, students will answer 1 problem based on the curriculum of that week. (This may happen on Mondays, from the curriculum of the previous week, but you get the idea). These problems will not be graded with points, but will instead by tiered (following Dr. Lindsay Masland’s tiered feedback protocol  ). A student could earn a ✅ emoji, signifying that the student has mastered that concept and can move along. (Mastered does not mean perfect. Minor errors like arithmetic or minor vocabulary are ok). They could also earn a ❤️ emoji, which means that they are on their way, but have not mastered this concept – there are some errors that need addressing. If a student is nowhere near mastering a concept, they will earn a ☕️, emoji. There will be 3 weeks of designated Formative Fridays where students get no new problem, but can instead re-try a previous week (different problem, same concept) to improve their emoji. From here, this portion will be contractual – ie/ “If you earn a total of 8 or more ✅, you will receive an A for this portion of the course”. This portion will be about 75% of their mark.

Part 2: This will combine personalized learning, self-assessment, and a creativity project. At the start of the term, each student will choose 1 individual tree to study all term. Each week they will blog (or post on the discussion board?) relating their tree to the curriculum of the week following a broad prompt. For example, when we study food webs, the prompt could be “How does your tree fit into a food web of the immediate biological community?“. From here, a student can be pointy or broad in their answer. They could focus in on one interaction and trace how much energy is going into a specific population of herbivores, or they could broadly estimate if their tree is a net carbon sink. The term project will be to combine all of their tree posts into a creativity project – some sort of story of their tree. The “final exam” would be a more directed version of the self-assessment that I use in the third year course. (Based on the cummulative project, students will be lead through each week and asked to justify their engagement with and mastery of the particular curricular items.) This will be about 25% of their mark. (Note: If a student does not have easy regular access to a tree, I do have a backup accessibility plan.)

As always – I appreciate any hot tips, suggestions, and feedback! Thank you for reading.

How to Build-Up a Little Community Pantry, a Memoir

A few months ago, my friend Pam responded to a study suggesting that 40% of our students are food insecure (https://foodhub.ubc.ca/food-security/) by suggesting that we start a Little Community Food Pantry. We launched our little pantry the same week in a small cabinet with a few things we brought from home and a few things we bought.

Our little pantry was utilized quickly and with gusto. We kept track of what most-used items were and we put a suggestion bag for anonymous feedback. These are our top 5 items:

1. Protein bars or granola bars (protein bars are the holy grail)

2. Ramen or other quick soups

3. Canned fish (tuna etc)

4. Fresh fruit (oranges and apples)

5. Other proteins, including shelf stable milks

 

Our suggestion box asked for more protein and quick things ✅. We also had many expressions of thanks.

Following our first successful week, we advertised to the community. Donations came in from faculty and staff and other students and use increased.

We had outgrown our little cupboard, so with the help of admin and staff, we secured a larger set of cabinets and moved down the hall.

One of my students who works for the AMS Food Bank helped me move into the  new pantry and she had some great advice, such as leaving the top shelf for duplicate items because the top shelf would be less accessible. Someone brought by menstrual supplies, which we now keep in one of the drawers. Another drawer is stocked with condiments and cutlery. This week we will be adding a microwave. This Little Community Pantry project has been a huge success all around. We are currently working on ways to accept monetary donations, recognizing that shopping is another chore for folks that would like to donate.

If you would like to donate to or access the pantry, it is on the second floor of the BioSciences building near the East Wing elevators.

Personalized Learning, Ungrading, and a Tree

Personalized learning is loosely defined as a customized educational approach. For me, personalized learning came hand-in-hand with Ungrading. As I was designing my Ungrading approach, it seemed true that I should extend power to the learners at the beginning of the learning cycle as well as at the end. (This project was wildly successful and I have kept both Ungrading and Personalized Learning in my third year lab course – I am currently finishing my second year of both). I am now thinking of how we can bring Ungrading to our first year courses, and I am once again considering how Personalized Learning fits into this puzzle.

Our first year biology course spans the breadth of ecology, evolution, and genetics. As much as I love my lab course, first year is my favourite! I am excited to be back in the world of first-year students. Here’s my idea: I am considering personalizing the course the first week by asking students to go outside and identify a tree that will be their own for the entire term. As we move through the curriculum, their Personalized Learning task would be to correlate concepts from lecture to their specific tree. (What organisms are living on your tree this week? Who are your tree’s closest relatives? What is happening in the soil around your tree? What microclimate is your tree providing? What adaptations does your tree have that helps it survive here? How does it reproduce? What kind of variation exists in the population? Etc.) With a broad prompt each week, students will be asked to set specific individual learning goals and journal their way through the term correlating curriculum with their tree. What I am considering is a creativity project highlighting this process as a final course submission. (In the past, I have done creativity projects with this course and they are generally beautifully done – I’ve received board games, children’s books, podcasts, movies, sculptures, etc. What I know is that students are motivated when they have their own agency and they work hard when they have the freedom to be creative.) This is a work in progress – stay tuned!

Embracing AI: A prologue to ChatGPT

Well, here we are just a few months into the ChatGPT world and I have to say – I kind of like it. As a science teacher, demonstrating the trying and testing new things essentially mimics what  science is fundamentally about in an effort to better understand our world. ChatGPT emerged in earnest just at the start of this term, and this is how I’ve used it in my class.

ChatGPT was full (overloaded?) during work hours at the start of the term. For our first introduction, I explained what these types of AI tools are. Some students had not yet heard of this emerging technology, and some were very interested. I asked ChatGPT to generate one paragraph on a topic tangential to, but not directly part the curriculum of our class. I pasted the response into a Google Doc that I shared with the class during lecture. The first 3 minutes were spent simply reading the paragraph. I then asked students to list on the Google Doc the things that they felt were done well. They felt the basic content was accurate. The writing style was good (solid paragraph). Then they listed things that were not done well. They thought it was very repetitive. They noticed that it lacked specific detail. They then live edited the paragraph and the result was a much better version.

Our second look at ChatGPT was to synthesize background information to use in one of our group projects. This followed a similar process to the above, with an expanded set of explicit information. I invited students to take these paragraphs and edit as they see fit, or to not use them at all. We decided that ChatGPT was a good tool and should be allowed for submissions, with acknowledgement. (This follows current guidelines of journals like Science and Nature, which do not allow AI as authors, but do allow acknowledgement). At this stage, we noticed that ChatGPT does not cite sources well or accurately. We specifically asked it to include 5 references. It did. I then asked it, “are these references real?” and it replied that they probably weren’t – but also advised on how to check if they were, which we thought was a nice touch. At this point, we proceed with caution. (It’s exact words were, “As an AI language model, I cannot browse the internet and check if these references exist or not. However, I generated those references based on my training data and knowledge, and they are based on real scientific articles and journals. If you want to check the validity of these references, you can search for them on Google Scholar or other academic databases.”)

My students are currently analyzing data – most are running ANOVA. This morning, I asked ChatGPT to run an ANOVA on a fake data set. Interestingly, it did a nice job – it told me what program it was using (R), and showed me the code as it was generating results. The narration along the way was quite good. At the end, I asked if it could graph the results for me. It replied “Certainly!” but then produced an image that I could not see.

We are just in the infancy of this new tool – very likely the problems we currently see will improve as AI advances. I’m excited for what this new era will bring – and I appreciate how it must have felt to mathematicians when calculators became widely available. Was there an immediate fear that no-one would learn math anymore? Where would we be today if calculators had been somehow permanently banned from higher education? As we move forward, this is the perfect opportunity to pause and remember that our students are not inherently out to game the system. They are here to learn and we should be partners in their efforts.

What does “falling behind” mean in teaching?

I gained my teaching training wheels in Science One, where we have no (or very little) curriculum tied to any other course. I spent well over a decade teaching almost exclusively in this program. Especially this time of term, when nerves are frazzled and snow days come unexpectedly, I would often hear colleagues frantically complain about “falling behind.” I honestly had no idea what this meant. Behind what?

When I teach lecture courses, I rarely plan anything specific beyond a week out.

How am I supposed to know in advance what student prior knowledge is? What they want to learn more about? What will interest them?

I don’t, and so I don’t plan much beyond some key targets until the topic bubbles up and we decide as a team (the students and I) where we want to go specifically. This “falling behind” is such an interesting statement that I’ve started probing. What do you mean by that, exactly? I’ve decided that “falling behind” falls into 2 camps:

1. The Story Tellers. Some folks have a clear epic novel to tell. (I’m in Science, so not a literal novel, but a big tale about the evolution of algae – for example – from beginning to current). I respect these story tellers. I want to sit in their classes and hear the tales. (On the same note, I’d like to remind these story tellers that it is their responsibility to figure out how to shorten their story in a meaningful way and “falling behind” is not an invite to cram a bunch of material in at the last second that is not absolutely essential to the story, and students won’t remember it anyway).

2. The “What is Everyone Else Doing” Teachers. These people are typically teaching a section in multi-section courses, or are teaching the same course multiple terms and have some vague sense of keeping up with someone else (or their own self from other terms.) To these folks, I would ask… why? Is there evidence that quickly sprinting through material is more beneficial to your students than pausing and covering something in depth? (This is a real question and a real discussion in teaching circles.) More commonly, I suspect this “falling behind” sadly means getting through material because it will appear on a pre-written exam. In this context, our exams become no better than any other standardized exams that teachers are forced to teach to at many levels of education.

I challenge us to do better.

 

The very first slide of the very first lecture

In my ungraded course, my students assess themselves formatively and summatively, which is no small task and takes some practice. I have a great colleague/friend on Twitter (Rebekah @grrrlmeetsworld) who used this in her course(s), and I stole it (with permission) and used it as the very first activity, right out of the gates.

The slide asks students to chose what role they’d like to play in this course. I offer no judgement – any choice is perfectly fine, including “hostage”, which is the reality of our educational system sometimes. The word that the vast majority of students chose – so many that you can no longer read the word – is “explorer”, which feels exactly right. Because my students make and reflect on their own learning goals, defining their role in the course matters, and it’s also flexible. We will revisit this as a grounding exercise every few weeks.

What does the word “grades” feel like?

My first lecture was this morning. I borrowed an activity from David Buck (dbuckedu on Twitter) and asked students to respond to the question, “What do you feel when you see the word “grades?”” This is a wordcloud of their responses:

Image

I have roughly 100 students who contributed a total of 22 different words. Thirteen people contributed the word “stress”. We did this activity before any mention of grading in this course, and it simply validates work of others and illustrates the primary reason I practice ungrading.

The letter that mattered most

Once I wrote a reference letter for a student who had never been in any of my classes. In fact, she was not in my program and was applying to a very prestigious graduate school in a totally different field. Her grades were mediocre at best. I enthusiastically said yes, but had to sit with it a while and contemplate my strategy. In the end, I wrote her a knock-your-sock-off academic reference letter, and she got in. (I like to pretend that my letter mattered.) Here’s the gist of the letter.

Her grades were maybe not great. (In fact, they were unarguably not great). But. BUT. She chose extremely hard classes as electives. Like – really hard classes. Her foreign language was Japanese. She took the real physics instead of the “not for majors” physics. When I asked her why, she said it was simply because she didn’t want to miss out on something the science kids were learning. She has an amazing work ethic. (In fact, she worked almost full time throughout her undergraduate career). She is a humanitarian at heart, a constant learner. She traveled the world truly making a difference – working at international consortiums. She is an amazing team player – one of the best. She nurtures relationships. I could confidently say these things about her – in an academic letter – because every one of these traits matters in academia. And yet they very rarely become part of a course grade. Writing this letter taught me a lot about grades and what they don’t say.

During my first year of ungrading, I saw students justify their grades with things like:

“…I really held this project together for weeks when 2 of my teammates were out with Covid and one had to work overtime…”

“…I’ve always been so nervous to speak in front of peers. I had to glance at my cards, but I did it. I’m so proud…”

“…we had a safe project we were going to do that was just something modified from what another group did before. Instead, we designed something that was really hard and probably wouldn’t work…”

This year I have learned the nuances of what self-reflection and assessment can capture. Every student in my classroom is their own whole human with a unique experience they are reflecting on. I have decided that I am OK with each of these humans assessing themselves on a different arbitrary scale, because the scales are personal reflections of their own growth. I will keep on ungrading.

Why I Ungrade, and a How-To Primer

I’ve come to the conclusion (a little late in the game) that standard exams are ableist, sometimes (most times?) racist, and do not measure learning. We can do better.

Exams are ableist because they operate under the assumption that everyone is able to retain or function under a certain umbrella of expectation at a specific time. This is not the case. Some of my most amazing students have been horrible exam takers.

Exams are (sometimes?) racist and sexist. Even seemingly innocuous exams like the good old Force Concept Inventory are not as innocent as they seem. The FCI was shown to have ethnic and racial bias. (See Henderson and Stewart, Racial and ethnic bias in the Force Concept Inventory 2017). In chemistry, this title pretty much speaks for itself, “A QuantCrit Investigation of Society’s Educational Debts Due to Racism and Sexism in Chemistry Student Learning“, Van Dusen et al 2022.

Exams do not measure real learning. They measure what a student can do at a pinpoint in time, under specific conditions. They fail to capture the learning trajectory, or even what a student knows in that moment for students who experience exam anxiety (or many other situational issues).

For these reasons and others, I ditched exams and began ungrading. I truly ditched traditional exams back in 2018, when I was teaching large sections of first year biology. In that course, though, exams are required (as is true for most first and second year courses at UBC). So I designed collaborative exams (these are not two-staged exams). I am now teaching a third year lab course that has never had traditional exams, but did have quizzes and worksheets and things to make sure students were “keeping up”. (I’m embarrassed now to even admit that.)

Step 1: If you want to ungrade, my first tip is to take a look at all of the things students are currently doing for marks and get rid of all of these surveillance type of micro-managy things.

My course products are project based. I have roughly 100 students, and they can work in groups or they can work solo. Their projects are meaningful in that they are all sent out beyond the walls of UBC and are read by other stakeholders in the community (the City of Vancouver, local grocery stores or restaurants, etc.) (A write-up on one of my class projects is here Place Based Learning in Pacific Spirit Park)

Step 2: Get your students involved in deciding some meaningful thing they can do as a demonstration of their learning. (In some of my courses, this is very broad and I encourage creativity).

Step 3: Trust your students! This was harder for me than I thought it would be. When the first projects came in, I couldn’t help myself, and I asked my TAs to keep a secret spreadsheet and they assigned rough marks “just in case”.  (In case of what, I don’t know.) I immediately deleted this spreadsheet. In the spirit of ungrading, I truly believe the learner to be the best judge of their learning.

Step 4: Archive everything and provide copious amounts of feedback. This is not as daunting as it seems. Reading student work and commenting without assigning marks is a pleasure. I have students submit work on Canvas and feedback is provided.

Step 5: As much as it is feasible, allow for formative learning. At almost all stages, students in my course can take our feedback, edit, and resubmit their work. This is how true learning works. (We all know that).

Step 6: At the end of the term, I still have to enter a grade for my students – and not just any grade, an actual percentage. Because of this micro-managy system, students often perceive a real true difference between each percentage point. But it seems a bit much to ask students to assign themselves a percentage. Even an accumulation of self-assessment of all their work to arrive at a letter grade is a big job. What I did was design a self assessment form. Students do not willy-nilly pick an arbitrary grade. Instead, they work through reflecting on all their work and suggest a letter grade (on each piece and at the end). This actual form is adapted from a form in “Ungrading” edited by Susan Blum. Firas Moosvi (UBC Okanagan) provided a lot of feedback and encouragement as I designed this form.

Here it is, in its entirety.  (Feel free to use/edit as you see fit). (For some students, they take this document and run. Some students insert pictures of what they’ve done – they are really proud to showcase this. A minority of students (N=2) were uneasy and met with me 1:1 to talk through how to do this assessment. Another student wanted some guidance on how much each thing in the portfolio should count. I sent her the old weighting system from the “before ungrading” times as a guide.)

Biology 342 Self Assessment Form, Fall 2021

Your name:

Your lab section:

Congratulations!! You have made it through the term. We have shared a long and involved journey this semester as you have experienced what’s it’s like to be a scientist. I hope you have enjoyed this experience and were successful in meeting your learning goals. Because you are the one who has spent time learning this term (and I am not), you are best able to authentically evaluate your progress.

Gather your stuff from this course. The stuff you have created constitutes your portfolio of learning. This includes your lab notebook, your City of Vancouver mini-report, your salmon letter, your term project, and feedback for oral presentations. Grab some tea/coffee/water/a snack and settle in for some reflection. Plan to spend 30-60 minutes or so.

1. The most important thing. Think back to before the term started. Look through your entire portfolio. You accomplished a lot! What is the one most important thing that you will take away from this course? (Your most important thing may be broad or it may be very specific.)

2. Scavenger hunt (looking at specifics). Each week you set learning goals for yourself. Choose your 3 favourite things you accomplished (learning goals) and write them here.

3. Read through all of your self-assessments that you made at the end of each lab. Critically read feedback you were given. What was this experience like? Did you always/usually/sometimes meet your goals? What summary letter grade would you give yourself for your weekly learning? Why?

4. How would you grade your lab notebook? Is it complete? Organized? Neat? What did you learn through this process? Justify your grade (in a few sentences).

5. Your field work. Read your City of Vancouver report again. Would you change anything in this report now that you have more experience? What was your group contribution like – did you contribute equally? Give yourself a letter grade for this project. Justify your grade.

6. Your salmon project. Read your salmon letter again. Pretend you are the recipient of this letter – does it make sense? Did you contribute equally to this project? Give yourself a letter grade for this project. Justify your grade.

7. Your research project. Think back to your initial project design. You probably weren’t sure if it would actually work, and that part doesn’t matter. Evaluate your group’s project design. Was your question clear and measurable? Did you choose something brave that may not have worked? What was hard about designing a project?

8. Your data. You decided when and how to gather your data for your project. How was data collection? Did it go like you expected? Did you contribute equally toward data collection? What was hard?

9.  Your report. Read through your final report. Are you proud of this work? (You should be!) What letter grade would you give yourself for this project? Why?

10.  You gave oral presentations in this class. How was that experience? How did you do? Was your project well articulated?

11. Please suggest a grade for yourself, with comments. One of the key components of this exercise is for you to learn how to be a good judge of your own work. Be careful not to under-estimate your score in the way of “modesty”, “humbleness”, laziness, or out of fear. Similarly, be careful not to over-estimate your score out of overconfidence, laziness, arrogance, pride, or a false sense of ability.:

Grade:

 

Explain how you arrived at this grade:

 

If your suggested grade is very different from how the TAs and I perceive your learning, I will set up a meeting with you to discuss your grade. I reserve the right to raise or lower your grade. Note on how grades will be entered: If we agree that a B best reflects your learning in this course, I will enter the median within the B range. (A letter grade of B +/- goes from 71-79, so I would enter a 75.) If your honest reflection puts you somewhere outside of this median, you can certainly suggest a more precise number – with justification. For example, you may suggest a 78 because you went to the Museum of Anthropology and spent 2 hours learning how salmon are important to our first nations, and your learning was significantly enhanced by that extra effort.)

12. Do you have any other comments?

12b. Please comment on what this “ungrading” experience was like for you this term. (If you’ve taken a lab course that was graded traditionally, how was your experience different in this ungraded course?)

I hope you have a wonderful break! I appreciate you taking part in this course and in this exercise. Lab notebooks will be available for pick-up next term in the lab. Please drop by to say hello!”