Author Archives: chendric

Students posting on WordPress on the front end

I use WordPress for all of my course sites, and for some of my courses I ask students to post directly on the course site (for one they set up their own WordPress sites and they are syndicated to the course site). So far when I ask them to post to the course site I’ve had to teach them how to sign up as an author on the site, then log into the dashboard and make a post, how to add images, etc. It is quite a to-do, as the three screencasts I created for a course this summer attests to. I’ve decided to look into a front-end posting system and see how that would work.

The first thing I thought of was gravity forms, because that’s what we have used for the Directory in the Teaching with WordPress open online course I’m helping to facilitate. For that, we asked people to upload an image, gave them input boxes for text and also for a URL if they wish to connect a website. It seems I could use something like this to ask students to:

  • write a blog post on something associated with the course (differs according to different assignments)
  • include a URL or two if relevant
  • include an image if relevant

What I’d also like them to be able to do is to embed a video file from the front end, like you can do from the dashboard in WP where it just embeds automatically from YouTube and Vimeo (and maybe others too…those are the two I’ve used).

For example, this summer term I asked students to find and write about philosophical activity out there in the world beyond the course, and they had to include at least one image or video embed or audio file. It would have been great if they could just fill out a form on the front end to do so.

I don’t know how to use Gravity Forms for this; Rie Namba set it up for us on the Teaching with WordPress site. But I can go to a WordPress drop-in at UBC to learn (we have a two-hour drop-in time every week, which is just super cool to have).

And Pauline Ridley sent me this link on Twitter, which talks about how to set up a Gravity Form so users can submit a blog post with images through it: http://gravitywiz.com/use-gravity-forms-to-create-user-submitted-posts/ This looks really useful!

When I tweeted about this desire of mine, Mariana Funes reminded me about the P2 theme for WordPress. She and John Johnston have set up a P2 demo site for Teaching with WordPress, and anyone can play along if they contact Mariana or John (try Twitter, or if you want to contact them but don’t have a Twitter account, comment below and I’ll connect you to them!). I forgot about this site and haven’t tried it out yet. I’m going to as soon as I get my login credentials (again…can’t find them) from Mariana. Then I’ll be able to see if it can do all of what I want.

screen shot of TRU Writer

Screen shot of TRU Writer

Alan Levine created some things called SPLOTs for Thomson Rivers University, which are super excellent, easy way for people to make various kinds of posts on the front end of WordPress. The TRU Writer looks particularly good for my purposes. But it’s not (yet?) easily available as a WP theme; the source code is on Github, but that’s beyond my abilities to deal with. And plus, I can’t just upload new themes to our UBC Blogs site where my course sites are; the themes and plugins are controlled centrally. Hmmm…maybe I could convince them to try the SPLOT? :)

 

Editing after posting?

One thing I’m wondering, for all of these options; is there any way for students to edit their posts after posting from the front end? I know that’s not the case with the Gravity Form we used for the Directory for the Teaching with WordPress course. Any edits that needed to be done were done by one of us after it was posted. And the TRU Writer says the post is final once it’s submitted as well. Not sure about the P2 theme.

 

Anyone else have another idea to try for front-end posting?

 

A web, not a website

In Teaching with WordPress, one of the week 2 topics for discussion is to think about how to design a web. This comes from a quote from Stephen Downes in a presentation called “Design Elements in a Personal Learning Environment,” where he says: “A MOOC is a web, not a website.” Now, in this he is talking about what later came to be known as cMOOCs, or connectivist MOOCs (see my blog posts here and here for a discussion of cMOOCs). Many MOOCs today are more like websites than webs. But what does that mean, really?

To me, having experienced several open online courses that I would call “cMOOCs,” designing a course as a web means that one focuses more on providing opportunities for people to connect with each other than on providing content that they all need to get and be assessed on. The curriculum comes in large part from the participants, who shape what is talked about and how the course goes by what they write, what they link to, the questions they raise, etc. And perhaps most importantly, the best value for me in such courses is that the connections I have made continue onwards, long past the end of the courses. From my experience in various open online courses I have gone on to collaborate with people on designing and facilitating an open online course, on research projects, and, well, just on fun.

I will tell anyone who will listen that my experiences in connectivist-style open online courses has changed my life. For example, here’s a map of all the things that have changed in my professional activities as a result of taking my first open online course, ETMOOC, in early 2013. (The embed interface is not that great; I used MindMup for this map, and it’s a little clunky…it’s just that that is what I started with so I kept it in there!) This link should get you to a full page version of the mind map.

 

But my question is, how do I design my own on-campus courses so that they are more web-like and less website-like? I’m not thinking that my students’ lives are going to be changed in quite the same way as mine has been changed by my experiences in open online courses, but I would like for there to be more connections between students, and between students and myself, through online interactions. And there isn’t much that is doing that in my WordPress course websites right now.

Right now my WordPress sites for my on-campus courses don’t do a whole lot beyond giving content: here are the readings, here are the assignment instructions, etc. That’s a website. For example, see the website for the course I’m teaching right now, Introduction to Philosophy, here.

Sometimes I also ask students to do blog posts (depending on the course); so, for example, for Arts One their blog posts are aggregated onto our class website under “our blog posts,” here. Sometimes I ask them to post some of their work publicly (it’s always up to them whether or not to do it, though), such as with the “non-traditional artifacts” here or the “philosophy in the world” assignments here.

And for the first time ever, just this week I asked students to participate in a discussion on a WP site through comments, using a shortcode to get two pages with the discussions onto a single page: https://blogs.ubc.ca/phil102/weekly-schedule/week-5/ Here’s a short post on how I did that.

 

I guess I just feel like I’m mostly replicating an LMS with my WordPress sites. And I want to know how I can use the power of the WP blank slate to do more interesting things. That’s one of the things I am hoping to get help with. And a question I asked on Twitter earlier this week is a start!

 

Engaging students with OER

Near the end of May I worked with Jon Festinger and Will Engle to do a 1.5 hour workshop on how using and creating Open Educational Resources (OER) can have pedagogical value in courses (beyond saving students money, which is also important). You can see the basic abstract for the session in the wiki page embedded below.

Click here to see our slides for the workshop, on Google Slides (or see below).

We also created a wiki page for the event, which has numerous link to resources. We also tried to get small groups to post answers to discussion questions on the wiki, but as the event was held in the late afternoon, a bunch of people left when it was time to do the small group activity (I guess many instructors, like many students, think the “real action” is in the presentation rather than the group discussion!).

The wiki page for the workshop is embedded below.

 

About this session


"Increasing Student Engagement through Open Educational Resources" is a workshop held during the CTLT Institute in May 2015.


Abstract

Open educational resources are educational materials (text, video, audio, and more) that are licensed to allow others to reuse, revise, remix, redistribute, and retain them free of cost. There are numerous pedagogical benefits to both using OER and creating OER in courses; this workshop will focus on a few of them, including the following.

Asking students to create OER in courses means, in part, asking them to create things that are available to and of use by other students in the course (both past, present and future) and by people beyond the course. Assignments that are read only by an instructor and/or teaching assistant can seem to be what David Wiley calls in a blog post “disposable”: “assignments that add no value to the world – after a student spends three hours creating it, a teacher spends 30 minutes grading it, and then the student throws it away” (Resource here). If, instead, student work is adding value to the world, contributing to a larger body of knowledge that can be used by others, it is much more likely that they will be engaged in working on it and try to make it as good as possible. Examples of such assignments could be student blog posts, student-created web pages or wiki pages, videos, and more that others can see/hear/interact with and learn from. Another example that will be discussed in the session is having students edit an open textbook and share their edits openly.

Using OER in courses means asking students to read/watch/listen to/interact with educational materials for the course that are publicly available and licensed for reuse and (often) revision. Finding and assigning OER can allow for presentation of material in different ways: e.g., a textual resource can be augmented through finding and using a diagram, an image, a video, another text that explains things differently, etc. This can help both engage students and improve their understanding of course material. Further, if the OER are licensed to allow revision, students can edit them or mix them with other resources to create something new, both helping their own leaning and contributing OER for others to learn from.

In this session we will all discuss together the various kinds of open educational resources, including open textbooks, how to find OER for your courses, and several of the pedagogical benefits of creating and using OER.


Facilitators


Will Engle is a strategist for open education resources at UBC's Center for Teaching, Learning & Technology. He engaged with projects that are leveraging emerging technologies, approaches, and pedagogies to support open learning. With a background in library science, Will is interested in understanding and supporting the removal of barriers that limit access to education, information, and knowledge.

Jon Festinger, Q.C. (LL.B., B.C.L. 1980 McGill University) is a Vancouver, British Columbia based counsel and educator. He is an SFU Professor of Professional Practice and a faculty member of the Centre for Digital Media. Jon has taught media, entertainment and communications law topics at the UBC Faculty of Law for over two decades, as well as teaching at various times at the UBC Graduate School of Journalism, the Thompson Rivers University Faculty of Law and the University of Victoria Faculty of Law. He is the author of the first edition of “Video Game Law” published by LexisNexis in 2005, co-author of the 2nd Edition published in 2012. The open and on-line components of his courses can be found here & here. Jon was named a member of Creative Commons’ “Team Open” in 2014.

Christina Hendricks is a Sr. Instructor in Philosophy at UBC, and she also regularly teaches in the Arts One program. She has been a proponent of open education for several years, having participated in and few open online courses and been part of the design and facilitation team for others, including one with Peer 2 Peer University called Why Open?, and a course on Teaching with WordPress. She uses as many open educational resources in her teaching as she can, and posts many of her teaching materials as open educational resources herself.


Agenda and session outcomes

Agenda

  1. Introductions--to us, to you
  2. Defining openness and open educational resources (OER) in groups
  3. Discussion of openness and OER
  4. Presentation on pedagogical benefits of OER and open courses
  5. Groups: take a "traditional" assignment and discuss how you might use what we've talked about today to transform it (and why)
  6. Conclusion


Session outcomes

By the end of the session, you should be able to:

  • Give a definition of “open” and/or open educational resources
  • Explain at least two pedagogical benefits to using and/or creating OER in teaching & learning
  • Explain one or more courses/projects at UBC using/creating OER
  • Say how you might adapt an activity or assignment to make it more "open," and why this would be pedagogically a good thing to do

Group activities

Click on your group number to go to the page where you can type in your answers to the questions in the group activities during the session.

To see all the groups' notes from the activities, click here: http://wiki.ubc.ca/Sandbox:Student_Engagement_Through_OER/Group_Resource

You can also see how the group wiki pages look when embedded into a WordPress site, here: http://willdev.sites.olt.ubc.ca/


Resources, links from the session or relevant to the session


Slides from the session

The slides used during the session can be found here (on Google Slides).


Examples of open courses or OER

A list of some examples can be found on the open.ubc.ca website, here: http://open.ubc.ca/learning/

Please add other examples that you know of, below!


At UBC


Elsewhere


Open Education

Creative Commons licenses

True Stories of Open Sharing

Watch some amazingly true stories of open sharing--the great stuff that can happen when we share our work openly: http://stories.cogdogblog.com/

source: http://wiki.ubc.ca/sandbox:Student_Engagement_Through_OER

I made discussions on WordPress!

Okay, so it’s not that fancy, but I’m pretty excited that I got the following to work.

So in my PHIL 102 (Introduction to Philosophy) course this summer, I took one of the sections of the course and did a little bit of a “flip” of it, where I asked students to watch some videos ahead of class, in addition to doing the reading, so I wouldn’t have to do all the lecture in class and we could spend more time face-to-face on what F2F is good at: discussion, interaction.

But I wanted them to also do some kind of activity with the videos so the material sinks in a bit better, and to connect the work outside of class with the videos to the work inside class with the activities. So I decided to ask them to post comments on one of two discussion questions, and I would bring their answers into class to share, and talk about them a bit. noun_17047_cc

But I didn’t know how to do that on WordPress until I became part of a team of designers and facilitators for a course on Teaching with WordPress. One of the people designing the site set up our front page so that we could show announcements on it, using a shortcode. I copied this idea for the PHIL 102 class. You can see the page where I embedded the discussions, here.

I made each of the two discussion questions a post under the category “discussions.” Then I used the following shortcode on the page linked above to get them onto the page: [loop query=”posts_per_page=3&category_name=discussions” view=”archive”] That requires a plugin that allows for the “loop” shortcode: loop shortcode plugin, made by people at UBC. That’s the same code we use on the front page of the Teaching with WordPress site to get the “latest updates” to show up.

Then, I just asked students to comment on those posts. I told them they could make up a fake name, or use their initials, or use their real name if they wanted. I always want to give them the option of not posting publicly if they choose.

I think it worked pretty well. There was good discussion on the two pages. I’m not sure how well it would work if I had a big class, though–this one is only 40 students, so the discussion didn’t get overwhelming where you have to scroll for days.

Open course design challenges (#TWP15)

 

One of the questions for the weekly discussion for week 1 of Teaching with WordPress is: “What’s your biggest challenge in designing for open?”

I have several course websites on WordPress, and one of the challenges I’ve faced in designing each of them is determining just where to put things and how to hierarchize them in menus so they can be easily found. I don’t know if this is my biggest challenge, but it is one I face each term as I think about redesigning my sites. It is made more important by the fact that the sites are public on the web, and I hope that others who visit them might find the information there useful. So they have to be clear even to people who are not in the course and don’t get the benefit of me talking about where things are on the site!

Here are the sites I have so far:

Introduction to Philosophy (PHIL 102): https://blogs.ubc.ca/phil102

Introduction to Moral Theory (PHIL 230): https://blogs.ubc.ca/phil230

Continental Philosophy seminar (PHIL 449): https://blogs.ubc.ca/phil449

 

Where are the lecture notes?

When I created the PHIL 102 site in the Fall of 2013 I made a mistake that I rectified when I taught that course again in the Summer of 2015.

Screenshot 2015-06-06 18.17.03When I first created the site, I had a “weekly schedule” so students could find each week and see what they are supposed to read before class and what we’ll be doing in class. I created the weekly schedule as a way to be able to quickly update what students need to read/what we’re doing in case things change over the course of the class (which always happens!), rather than having a static syllabus/schedule. You can see the weekly schedule for the Summer 2015 version here: https://blogs.ubc.ca/phil102  Having a weekly schedule like this I still think is a good idea.

But I decided to put the lecture notes after each class on each of the weekly pages. So, the lecture notes for Plato’s Gorgias would be on the page that discusses what students are to read before the class in which we discuss the Gorgias. I honestly don’t know what I was thinking, because I can’t imagine that was very useful for students. They’d have to go to each page in the weekly schedule to download the lecture notes. And then I realized later that if anyone coming upon my site on the web wanted to see the lecture notes from the course they wouldn’t know where to look.

So now I’ve created a separate page in the course with just the lecture notes: https://blogs.ubc.ca/phil102/lecture-notes/  On the top menu of the course site I have a section called “notes,” and under that are the lecture notes and also notes from the students’ small group discussions in class. I think that’s pretty clear, though perhaps not perfect.

 

Too many menu items

In my PHIL 449 course (https://blogs.ubc.ca/phil449) I have too many items in the top menu.

Screenshot 2015-06-06 18.18.36

It’s just hard to read/find things. There were some things I wanted students to be able to find right away, like the bibliography (which they needed for their research papers), the critical abstracts (where they could read each others’ summaries and reviews of research articles or books), and the “non-traditional artifacts” (which were assignments students chose to do instead of essays). And I couldn’t think of a good way to put those things under something else. I’m still struggling with that, even a year later–I’m not sure how I’d categorize things differently so that there are fewer items in the top menu.

One thing I did differently for the PHIL 102 site is to combine the “home” and “about” pages so I don’t have to have two menu items for that, like I did for the PHIL 449 site. I also put the syllabus on the “about” page for PHIL 102 so I don’t have to have that in a separate menu item either (the menu item is called “About & syllabus”).

 

Re-naming the weekly schedule

Screenshot 2015-06-06 18.20.55

In my course site for Introduction to Moral Theory (PHIL 230), I didn’t make a “weekly” schedule, but instead did it by topic (moral relativism, utilitarianism, Kantianism, etc.). This was because I thought that students would be less likely to find things by remembering which week it was in, than by remembering the topic.

I think this was a good idea, but it also makes each page for each topic longer than they were before. And when I designed the PHIL 102 site for this summer, I went back to the “weekly” idea (but labelled each week in the menu with the author of the readings or the topic) because the pages were already pretty long just by having the schedule for two days on them. That’s because I include not only required readings, but lots of optional resources.

 

Where to put various resources?

In many of my courses I have handouts or links to other resources that are useful throughout the course. Sometimes I put them under a menu item called “resources” (see, e.g., the PHIL 449 site), but then I thought that students might not find them there. So for PHIL 102 for this summer I decided to put some of them under “assignments,” such as the page with “writing help.” If you click on “Assignments,” then “writing help” is part of the drop-down. And other resources I put directly on the pages where they are needed for assignments. For example, in PHIL 102 students need information on finding and using public domain and CC licensed works, so I put that directly on the page with the assignment they need this information for: https://blogs.ubc.ca/phil102/assignments/philosophy-in-the-world/

For that page I used the “wiki embed” plugin that UBC has installed on UBC Blogs, which allows me to write up the information on a wiki page and then use it in multiple sites. If I change the wiki page, then all the sites that have it embedded are updated. I did this with the public domain/CC licenses information because I figured I’d be using that in other courses as well.

 

Adding images

When designing the PHIL 102 site for this summer I added images to each of the pages in the weekly schedule. I realized that the pages were very boring with ust text, and I wanted a bit more visual appeal. So I found an image related to the readings for each class meeting and included it there. See, for example, the week we discussed John Stuart Mill and Peter Singer: https://blogs.ubc.ca/phil102/weekly-schedule/week-4/ They’re not the most interesting images, but at least it’s a start.

This is not really related to the issue in this post, which is where to put what/how to organize, but I thought I’d mention it as a change I made to try to improve my sites over time.

Screenshot 2015-06-06 18.25.51

Screen shot from PHIL 102 site, Summer 2015

 

 

What do you think?

I’m curious if anyone has thoughts about the issue of organizing/hierarchizing/making things easy to find for students and others, or any of the problems/solutions I’ve discussed above. I think I still have some ways to go to make my sites as clear as they can be.

Learning subjectives (#rhizo15)

A drawing I made for #rhizo14, last year

A drawing I made for #rhizo14, last year

I’m partially participating in Website for #rhizo15, an open, online course in rhizomatic learning. During week one, we were asked in a video posted on that site to think about learning subjectives in addition to (instead of?) learning objectives.

The idea seems to be this: we can never be certain exactly what is going to happen in a learning situation, where we’re going to go; we can have a general outline, but things take on a life of their own when we are learning with others. And even the clearest learning objectives are going to be taken differently, interpreted differently, experienced differently by different people.

Here are a few quotes from the video for week one posted on the #rhizo 15 website that are helping me get a handle on what the topic of discussion is:

How do we think about learning and designing for learning when we don’t know where we’re going?
…learning is an uncertain process, life is an uncertain place, right answers are things that will only exist in storybooks.
How do we still provide enough structure that people know what we’re talking about?

It is that last point that I really want to focus on here.

I agree with the point that we can’t ever know exactly where we are going to go in learning, and that everyone’s learning experience will be different. Those things seem quite clear. But I worry that at times we might move from there into saying, well then, let’s embrace the chaos and give the least amount of structure possible.

Kind of like the #rhizo15 course itself, for which the idea of the “community as the curriculum” is embodied in (at least) the fact that the only curriculum given by the person who started the course consists of short videos with thought-provoking ideas and questions. What else happens rests entirely on the actions and conversations of the participants–what they talk about, what tools they decide to use to do so (e.g., see this Vialogues discussion about week 2’s video), what artifacts they create. Who would have guessed ahead of time that a blog post with a dialogue (by Tania Sheko) would have led, within about a week or so, to the creation of a radio play? (A project I missed while I was at a conference, and am very sad about missing!)

Now, I’m not knocking this lack of structure as if it’s never appropriate. I think it works great for a course like this, one that people join into because they are simply interested, have some time to dedicate to it, want to connect with others who are thinking about these topics, etc. And it works well for thinking about one’s lifelong learning in general, as evidence by Sheko’s dialogue on her blog. Of course I can’t know for certain where my life is going to go, so it makes no sense for me to have rock-solid learning objectives ahead of time.

But it seems to me that the situation is, perhaps rightly, different for students who are paying for courses for which they are being evaluated in ways that attach to a record that is important for their future. I feel a moral imperative to provide enough structure in a course that they can have a good sense of what they need to do in order to earn the grade they hope to earn. There is a strong power imbalance going on in a “traditional” course where I am in charge of giving grades, and if they don’t get enough information about what the expectations are then I feel like I would be being unfair to them. So it’s vitally important to me to figure out a way to recognize and value the fact that learning is uncertain, and that it would be best if students can find their own paths and their own means of learning (with the community of the rest of us in the class) while still having enough structure that students can have a fair sense of how they will be evaluated and what to do to achieve the marks they hope to achieve.

Now, if learning subjectives are mostly a matter of giving students more choice, more freedom to decide what they want to focus on in classes, then I’m all for that. As Laura Pasquini puts it in a recent blog post,

The openness of learning subjectives provides opportunities for students to drive the course agenda and direct their interests for topics.

This is something I think would be great to do, and I haven’t done as much of that as I’d like in the past. I have offered students the choice of more than one kind of assignment to do in one of my courses (a paper or a more creative project), and I’m also experimenting, in upcoming courses, with students choosing how they want their course grade to be calculated–which assignments to count for what. I also want to involve students more in assessing their own work (I already have them engage in peer feedback quite often), so that they take more ownership of it than just relying on the instructor to assess it.

I’m also happy to say to my students that I’m not sure where our discussions of philosophy or literature are going to go, that we’re going to get together in a room and talk about what we’ve read and see what happens, that I can’t come up with learning objectives for each class meeting because the discussion may take us in directions I can’t predict. That makes sense to me too.

But a certain degree of structure is still crucial when we’re teaching courses for which we are evaluating others in ways that can affect their future, I think. I wouldn’t think it fair to walk into such a classroom and say to students that I don’t know what they’re going to be doing, exactly, or what the curriculum is going to be; all I know is I’m going to start with a couple of readings and questions and we’ll see what happens from there. That’s a fine and very interesting way to run an open online course–I love learning this way in courses like this, and thrive on seeing the unexpected things that happen! I’m not convinced it’s fair to students we are evaluating to do so.

Learning is uncertain, life is uncertain, but I feel strongly that I need to respect the imbalance of power between myself and my students and ensure that they have enough structure to be able to have at least a decent grasp on what the expectations are on which they will be evaluated. Maybe we will work on these expectations, perhaps a marking rubric for essays for example, collaboratively. Maybe we will work collaboratively on where we are going to go in the course, in a general sense. But regardless how we get there, I do think I want to try to direct the rhizome with some structure.

 

P.S. When I first heard about the notion of “rhizomatic learning,” it was in a presentation by Dave Cormier that included a discussion of how it is not necessarily a lens through which we should view all learning situations. I discuss that in a blog post from 2013, here (jump down to “when is rhizomatic learning appropriate?”). Part of the discussion there was that rhizomatic learning fits well in situations where there are not clear answers, but perhaps is not the way to go when one needs to learn certain basic facts before moving on to more complex domains where the answers aren’t clear. But so far in #rhizo15 I haven’t heard much or anything in the way of saying that maybe rhizomatic learning is good for some contexts but not all. I’m curious if people feel that it’s okay to not be rhizomatic in some contexts, or in some aspects of a course, or when learning certain sorts of things.

 

 

 

Foucault, the sovereign, discipline & bio-power

I gave a presentation last night for the Vancouver Institute for Social Research, a fantastic program that provides free lectures at an art gallery downtown for anyone to attend. This term’s series has focused on sovereignty, and I decided to give a talk on Foucault’s claim that in common ways of thinking about power in political theory (in the 1970s at least), we still have not yet cut off the head of the king:

What we need … is a political philosophy that isn’t erected around the problem of sovereignty, nor therefore around the problems of law and prohibition. We need to cut off the King’s head: in political theory that has still to be done (Interview, “Truth and Power,” in Power/Knowledge, ed. Colin Gordon. Pantheon, 1980).

I contrasted the “juridico-discursive” view of power that, according to Foucault, has dominated political interpretations of power (and that is descended from the way monarchies came about and established themselves), with disciplinary power and bio-power.

The presentation was done through Prezi.com; here is a PDF of the presentation for this session.

Upcoming #TvsZ game and presentations at #et4online

#TvsZ is back! Running April 22-24, 2015. See the main website, here.

Plus, next week I and several other people are presenting on #TvsZ at the OLC “Emerging Technologies for Online Learning” 2015 conference.

What is #TvsZ?

That’s surprisingly difficult to answer. Here’s how I tried to describe it recently in an application for a teaching award, in which I discussed my work in open education.


 

Originally designed as a zombie game played on Twitter (and thus called “Twitter vs. Zombies”), we have also created a new version called “Technology vs. Zen.” Both games are played through Twitter, and are meant to bring people together in order to create collaborative stories. The other part of the purpose of the game is to help people learn how to use Twitter, and to give them motivation to create and share digital artifacts such as blog posts, images, videos, and more. The game usually happens over the course of a weekend, often lasting about three days.

Apocalypse, Flickr photo shared by Charles Hutchins, licensed CC BY 2.0

Apocalypse, Flickr photo shared by Charles Hutchins, licensed CC BY 2.0

In “Twitter vs. Zombies” the overall setting of the game is a zombie apocalypse, where there are zombies who have started to infect humans. You can see the website for the third iteration of the zombie version, here: https://twittervszombies3.wordpress.com/basics/. On Twitter, one can be bitten by a zombie through the use of a hashtag, and then has a certain number of minutes to dodge or be rescued by someone else before they turn into a zombie themselves. But the game goes beyond this; the most interesting parts of the game are when people take on missions where they have to add to the ongoing story in the game through a blog post, a picture, a video, a drawing they take a picture of, a song, or many other things. These aspects of the game happen through new rule releases that occur about every 12 hours: https://twittervszombies3.wordpress.com/rules/

In “Technology vs. Zen” the setting is an apocalyptic scene of unknown origin; participants are to imagine that they have woken up to find a wasteland around them, dead and dying plants, deserted city streets. The game site for this version is here: http://tvsz.us. The point of the game is to figure out what has happened and to determine how to approach solving the problem. Players begin on one of two teams: “technology” or “nature,” each team devoted to either a technological solution or one that has to do with working more in tune with nature. Participants start out recruiting others for their teams, but then are asked to engage in missions such as finding food, building a shelter, describing what they think has happened, and determining an approach to solving the problem (examples of such missions can be found here: http://tvsz.us/story-2/).

A number of people have used #TvsZ in their courses, asking students to play in order to experience collaborative storytelling and connecting with people around the globe in a team that has to work together in order to accomplish their missions. They have also used it to show an example of open and emergent pedagogy, though outside of a specific course context. Finally, it serves as an engaging way to encourage students to learn how to create and post digital objects—though the game sites don’t have information on how to do so, participants learn this from each other (or from their instructor, if they are playing the game as part of a course). As the current TvsZ planning team wrote in an abstract for an upcoming conference presentation:

 This game builds digital literacy through creating avenues for participants to engage in international collaboration, to compose for a visible and active audience, and to craft personal learning networks. It is a dynamic experience for engaging students in transmedia storytelling and narrative collaboration, and it can democratize the classroom by blurring the line between teacher and student. The game design itself is democratized through emergent rules: players re-shape the rules and revise the narrative as the game unfolds. (This quote comes from the abstract reprinted below)


 

But even since writing that, the game has changed again. This time we’re thinking of not having any teams to start with and asking people to create their own teams. Thus, there might not be a “technology” team or a “nature” team, but entirely different ones.

That’s one of the wonderful things about this game: it is continually evolving. And not only between games, but within the game itself: rules change over time, new missions are created for teams to complete, and participants are asked to suggest changes during the game as well. And actually, participants sometimes just change the game themselves by choosing to do something quite different than what we designed; in a recent version, which had a divide between humans and zombies, a group of people decided they didn’t want to be either humans or zombies and participate in biting or escaping bites, but to rather be neutral commentators who created poetry about the game.

What does one get out of playing the game? Here are a couple of blog posts I found with reflections on experiences in various versions: one by Karen Young, and one by Kevin Hodgson.

And here’s a fabulous artifact created out of what the teams did in #TvsZ 6.0, thanks to @nanalou022, which gives a good sense of what that version of the game was like.

 

So what are we doing at the conference?

I think I’ll just let our abstracts, which are pretty detailed, speak for themselves. We have two presentations, a longer one and a shorter one.

Here’s the abstract for the long, 2.5 hour workshop. This one is called Perforate Your Classroom: Collaboratively Hack the Open Online Game #TvsZ 6.0.” During this workshop, people will learn about the game, start playing it, learn how it has been used in courses, and work together on how they might change it for their own educational purposes.

All of the following is from this #et4online webpage.

Abstract

Participants will learn about and play the open online Twitter game #TvsZ, go through the process of hacking it, and discuss pedagogical benefits and challenges.

Extended Abstract

This workshop will invite participants to explore the pedagogical value of perforating oneÍs classroom: opening it up for students to learn with others online in loosely facilitated social media experiences. The seven international collaborating facilitators will share their experience of co-facilitating an open online game. The facilitators, who teach in Egypt, Canada, New York, Georgia, and California, will share their cross-institutional, cross-border experience of hacking #TvsZ and playing it with their students.

#TvsZ is an open online Twitter game played across an increasing variety of online sites and apps. The game, created originally in 2012 by Pete Rorabaugh and Jesse Stommel, is usually played over 3-4 days by anyone who chooses to follow the Twitter hashtag #TvsZ, as well as students in participating classes. Players, who are often meeting virtually for the first time, interact with each other on Twitter via a basic game dynamic which encourages informal, spontaneous tweets relating to the game premise. As players develop increasing familiarity with other players and with the basic syntax of game tweets, additional game dynamics are introduced, often in response to player suggestions and initiatives. These additional dynamics encourage players to create a wide variety of media objects, to experiment with new modes of networked collaboration, and to refashion their roles in the game itself.

This game builds digital literacy through creating avenues for participants to engage in international collaboration, to compose for a visible and active audience, and to craft personal learning networks. It is a dynamic experience for engaging students in transmedia storytelling and narrative collaboration, and it can democratize the classroom by blurring the line between teacher and student. The game design itself is democratized through emergent rules: players re-shape the rules and revise the narrative as the game unfolds. Although #TvsZ had been played multiple times before, the diverse interests and backgrounds of the co-facilitators as well as the international flavor, led to an interest in hacking the game in order to meet the different needs of their students and their own diverse teaching agendas.

The basic structure of the game can be revised in numerous ways, however, and participants in the workshop will brainstorm how they might do so for their own teaching and learning contexts. For example, while most versions of #TvsZ started with a Zombie narrative of biting and converting human players, the 6.0 version was intentionally kept zombie-free and non-violent.

Our workshop will be experiential: one must play the game to get a good sense of how and why one might want to hack it. Workshop participants will play a short version of one of the #TvsZ games and brainstorm their own forks of the game, and discuss possible repercussions of various modifications to such a game. They will also discuss possible pedagogical benefits to including a game like #TvsZ in their curricula, as well as potential problems one might encounter when doing so (and how such problems might be addressed).

Workshop Interaction/Takeaways:
Participants will play a version of #TvsZ, go through the process of hacking it, and (time-permitting) try out aspects of their hacked version during the workshop. Participants will discuss pedagogical benefits of using such a game in their classes, possible challenges and approaches to assessing learning.

Presenter(s)
Pete Rorabaugh (Southern Polytechnic State University, USA)
Andrea Rehn (Whittier College, USA)
Christina Hendricks (University of British Columbia – Vancouver, Canada)
JR Dingwall (University of Alberta, Canada)
Maha Bali (American University in Cairo, Egypt)
Additional Authors
Janine DeBaise (SUNY-College of Environmental Science and Forestry, USA)
Lizzie Finnegan (D’Youville College, USA)

Here are the slides for that workshop:

 

 

Here’s our abstract for the shorter session. This one is called “Perforating the Classroom: How Hacking the Online Game #TvsZ 6.0 Brings Together Faculty, Students and Community Members.” It is just for talking about how we changed the original #TvsZ from a zombie narrative to a more generic apocalypse narrative, and why, and how we engaged in cross-world collaboration to do so.

The following is from this webpage for #et4online.

Abstract

Learn about the collaborative hacking and hosting of #TvsZ, an open online Twitter game which fosters digital literacies/network fluencies

Extended Abstract

#TvsZ is an open online Twitter game played across an increasing variety of online sites and apps. The game, created originally in 2012 by Pete Rorabaugh and Jesse Stommel, is usually played over 3-4 days by anyone who chooses to follow the Twitter hashtag #TvsZ, as well as students in participating classes. Players, who are often meeting virtually for the first time, interact with each other on Twitter via a basic game dynamic which encourages spontaneous tweets relating to the game premise. As players develop increasing familiarity with other players and with the basic syntax of game tweets, additional game dynamics are introduced, often in response to player suggestions and initiatives. These additional dynamics encourage players to create a wide variety of media objects, to experiment with new modes of networked collaboration, and to refashion their roles in the game itself.

The rationale for #TvsZ is simple; we call it the “perforated classroom” mode of teaching and learning. In this era of information abundance and fast-changing socio-economic paradigms, both students and teachers require new and different skills. Students need to learn to contextualize ideas through efficient web-enabled research practices, to share their results through effective multi-modal communication, to discover new resources and connect to emerging networks of experts as they prepare for lives which may require many transitions among fields. Teachers need to learn to model these these skills by interacting with students as curators of information and connected, public co-learners. The perforated classroom thus embodies these various methods of connection, while also enriching the possibilities of teacher-student, student-student, student-community, and student-teacher-community-global rapport beyond the classroom itself.

#TvsZ 6.0, played November 14-16, 2014, refashioned the premise and dynamics of play to respond to contemporary events, and to better adapt to the cultural and temporal distances among players and game facilitators. The global nature of the #TvsZ 6.0 facilitation team and their students resulted in some unique emergent dynamics during the game, which this presentation will highlight. While previous versions began with a Zombie infection narrative, the 6.0 version was intentionally kept zombie-free and non-violent.

#TvsZ 6.0 was hosted by a group of seven international collaborating scholars with varying types of expertise (and familiarity with the game itself) and with different institutional roles and teaching goals. We, and our students, live in three countries (Canada, Egypt and the US) and four widely separated time zones. While our students all speak English, many also use at least one other language as a primary mode of communication. Our students ranged from freshmen to seniors in college, and the participating classes focused on disciplines and topics. Two of the game hosts did not directly involve their own students, but facilitated the game out of a commitment to open learning itself. More than 150 players participated in the online game: some as students completing assigned work, some participating in extra credit activities, some who were invited to play to help them learn twitter literacy, some to learn about creative game design. In addition, many players from the Twitterverse (including veteran #TvsZ players from previous iterations) participated for the sheer fun of it.

This presentation will focus on #TvsZ 6.0’s cycle of collaborative development, focusing on the value of social networks for instructor collaboration, and sharing our experience of a cross-border, cross-institutional, and cross-cultural collaboration between teachers and students, from game host & student perspectives. By exploring a few of the media objects created by game participants, we will also discuss various methods for evaluating the outcomes of student, teacher, and community peer-learner collaborations. Each step of development and implementation exemplifies a stage in the digital fluency that the game promotes by involving people in the fun and frenzied creativity of participation, by inviting participants to collaborate and co-learn techniques of multimodal media creation, by tempting collaborators to become partners in the management of the game during gameplay, and by player-partners becoming hosts and hackers of future iterations of the game itself.

Open online games extend learning opportunities beyond the classroom, augmenting studentsÍ understanding of knowledge networks. The reflexive nature of #TvsZ and the other games it may spawn creates space to enjoy the game experience while critiquing its shortcomings (e.g., in terms of how language, pop culture, and even time zones affect players in different parts of the world). Students engage in collaborative, experiential, and self-directed learning, developing Twitter literacy about the values, as well as the potential risks, of using social media to network. They learn by doing; rather than following linear modules, they learn from how others are playing the game and they ask the community for help. They also learn about power dynamics in gaming and social media. Hacking the game into a more collaborative narrative, and playing it with students from different countries and cultures provided insights not previously visible in #TvsZ iterations, such as how game rules (in terms of time limits and timezones) could affect equity in the game, how cultural attitudes could affect students’ gameplay, and how to develop game dynamics that would encourage students to venture outside the safety of their classmates and play with strangers online.

Presenter(s)
Andrea Rehn (Whittier College, USA)
Maha Bali (American University in Cairo, Egypt)
Pete Rorabaugh (Southern Polytechnic State University, USA)
JR Dingwall (University of Alberta, Canada)
Christina Hendricks (University of British Columbia – Vancouver, Canada)
Additional Authors
Lizzie Finnegan (D’Youville College, USA)
Janine DeBaise (SUNY-College of Environmental Science; Forestry, USA)
Sherif Osman (American University in Cairo, Egypt)

Here are the slides for that shorter workshop:

 

What is open education?

Wordle of this blog post, from http://www.wordle.net

Wordle of this blog post, from http://www.wordle.net

I wrote the following narrative for a teaching award application, and someone has requested that I post it openly as well, as it may be useful to others. I’m happy to do so! (Update July 18, 2015: unfortunately, I didn’t get the award, but you can see my entire application for it in this post).

This was a section of the application where I describe the basics about what open education is. I then go on, after this, to talk about how I engage in open educational activities in my own work. I might post those sections here later, in separate posts.

If you want to learn more about open education, there is also a great ebook called The Open Education Handbook. David Wiley has created an open course on open education, here: https://learn.canvas.net/courses/4

And here is the open education course at the Open University in the UK that I took in 2013. My blog posts from that course are here.


What is open education?

Financial, legal, technological openness: open educational resources

What is open education? To start, it is useful to consider the various meanings the word “open” can have in “open education.” Hodgkinson-Williams and Gray (2009) give a useful overview of some of these meanings, including what they call “financial openness,” “legal openness,” “technological openness, and “social openness.”

A common understanding of “open” is “free,” as in free of cost, or what Hodgkinson-Williams and Gray (2009) call “financial openness.” This is the meaning one might immediately think of as associated with Massive, Open, Online Courses. These are courses that are available for anyone with a reliable internet connection to take, free of cost.[1] Financial openness is also exemplified when a teacher makes a set of lecture notes, essay topics, a video, an image, etc. available for others to use without a fee.

“Legal openness” refers to the degree to which teaching materials, student work, research and more are licensed to allow others to reuse, revise, and redistribute. Some MOOCs, for example, may only allow you to view materials, not download them to revise or share them with others.[2] The “Open Definition” by the Open Knowledge Foundation addresses this meaning of open directly: “Open means anyone can freely access, use, modify, and share for any purpose (subject, at most, to requirements that preserve provenance and openness)” (Open Knowledge Foundation, n.d.). David Wiley, in a widely-used definition of “open content,” lists similar requirements for openness, and labels them the “five R’s”:

  1. Retain – the right to make, own, and control copies of the content (e.g., download, duplicate, store, and manage)

  2. Reuse – the right to use the content in a wide range of ways (e.g., in a class, in a study group, on a website, in a video)

  3. Revise – the right to adapt, adjust, modify, or alter the content itself (e.g., translate the content into another language)

  4. Remix – the right to combine the original or revised content with other open content to create something new (e.g., incorporate the content into a mashup)

  5. Redistribute – the right to share copies of the original content, your revisions, or your remixes with others (e.g., give a copy of the content to a friend) (Wiley, n.d.)

Wiley argues that the more of these five activities that are allowed, the more “open” a work or set of materials is. How one alerts others to the possibility that they can use one’s work in such ways is through an open license, such as a Creative Commons license. [3] Giving one’s work an open license means that one retains copyright, but allows others to use, share, and sometimes also revise the work without asking permission each time.

Hodgkinson-Williams and Gray (2009) also discuss “technological openness,” which refers to the use of different sorts of software tools. Those that are open source are more open technologically than those that are not. In addition, tools that allow for easy editing by anyone, without having to purchase the software, are more open: thus, documents in Open Office or Google Documents are considered more open than those in Microsoft Word. Both David Wiley and “The Open Definition” also acknowledge the importance of technological openness: if a work can only be edited using tools that are very expensive, or that only run on certain platforms, or that require a high level of expertise, it is less open.

Open education is often discussed in terms of using or creating “open educational resources,” or OER—these combine financial, legal, and technological openness. According to the William and Flora Hewlett Foundation,

OER are teaching, learning, and research resources that reside in the public domain or have been released under an intellectual property license that permits their free use and re-purposing by others. Open educational resources include full courses, course materials, modules, textbooks, streaming videos, tests, software, and any other tools, materials, or techniques used to support access to knowledge (William and Flora Hewlett Foundation, n.d.).

Thus, syllabi, lecture notes, video recordings of lectures, slides, animations, assignments, podcasts, and more can be OER, so long as they are given an open license. Engaging in open education can be as simple as assigning one or more OER for students to read, hear, watch in one’s classes, or creating OER for others to use, revise and share themselves.

Social openness: open pedagogy and students as producers

Finally, Hodgkinson-Williams and Gray (2009) discuss “social openness”: “the willingness to make materials available beyond the confines of the classroom by lecturers, students and university management” (p. 105). Social openness not only involves making teaching materials available to a wider audience, but also engaging in more collaborative activities among students, between students and instructors, and between both and the wider community. Hodgkinson-Williams and Gray (2009) point to a range between (1) lecturer-centred openness, in which, for example, an instructor creates all curriculum materials and shares them openly, to (2) more student-centred openness, involving students contributing to the curriculum through adding content in things such as blogs and wikis, to (3) inviting contributions and collaborations between students, instructors, and members of the public—such as through connecting with professionals in the field (p. 105).

Similarly, the Cape Town Open Education Declaration, drafted in 2007 and currently signed by nearly 2500 individuals and over 250 organizations, focuses on creation and use of OER; but it also emphasizes changing one’s pedagogy to invite more collaboration between instructors, students and the public:

 We are on the cusp of a global revolution in teaching and learning. Educators worldwide are developing a vast pool of educational resources on the Internet, open and free for all to use. These educators are creating a world where each and every person on earth can access and contribute to the sum of all human knowledge. They are also planting the seeds of a new pedagogy where educators and learners create, shape and evolve knowledge together, deepening their skills and understanding as they go (“Cape Town Open Education Declaration,” 2007).

Such collaborative pedagogical approaches are sometimes referred to as “open pedagogy.” Wiley (2013) defines open pedagogy as educational activities that are only possible because materials are made available with an open license. Examples he gives include: asking students to revise and remix OER that are used in a course in order to create tutorials for aspects of the course that students often struggle with, and asking students to create or edit Wikipedia entries on topics discussed in a course. Similarly, though using a different term, Ehlers (2011) labels such activities “open educational practices”: “practices which support the (re)use and production of OER through institutional policies, promote innovative pedagogical models, and respect and empower learners as co-producers on their lifelong learning path” (p. 4). Open educational practices, like Wiley’s view of open education, involve the use and creation of OER in courses where learners are collaborators and co-producers of the curriculum. Thus, “[t]he pure usage of … open educational resources in a traditional closed and top-down, instructive, exam-focused learning environment is not open educational practice,” according to Ehlers (2011, p. 5), but doing so in the context of a course where students revise such materials and act as collaborators and co-producers of curriculum is.

Tom Woodward expands on this view of open pedagogy to refer to “a general philosophy of openness (and connection) in all elements of the pedagogical process,” where “[o]pen is a purposeful path towards connection and community” (Grush, 2013; italics in original). Thus, open pedagogy can also include open assignments, which allow students to shape how they will show evidence of learning (or even create assignments for other students to do); open course planning, in which one invites comments and contributions from others when planning a course; and what Woodward calls “open products,” where students publish their work “for an audience greater than their instructor. … Their work, being open, has the potential to be used for something larger than the course itself and to be part of a larger global conversation” (Grush, 2013).

Asking students to create open products, to do work openly and publicly and thereby contribute to knowledge production both inside and beyond the course, is also part of a pedagogical model that Neary and Winn (2009) call “the student as producer.” Contrasting with the idea of the student as a “consumer” of knowledge transmitted by an expert, and higher education as guided by market forces for the sake of students’ future employability, the student as producer model can be defined briefly as: “undergraduate students working collaboratively with academics to create work of social importance that is full of academic content and value, while at the same time reinvigorating the university beyond the logic of market economics” (Neary and Winn, 2009, p. 193). The student as producer approach “aims to radically democratize the process of knowledge production” (Neary and Winn, 2009, p. 201). Bruff (2013), citing Bass and Elmendorf (n.d.), emphasizes openness in the student as producer model, by arguing for the importance of students sharing their work with “authentic audiences,” people beyond just the instructor who can benefit from what they are producing. In addition, Bruff (2013) lists two other elements of his view of the student as producer model: students work on open-ended questions or problems, ones that don’t yet have a solution (rather than only working to get the “right” solution to a problem), and students have some autonomy in choosing and carrying out projects.

I am here linking the student as producer model with open pedagogy as discussed above, because I think there is significant overlap; I refer to all of these here as “open pedagogy.” Examples of open pedagogy include activities from asking students to make public blog posts (or posts that are at least shared with the rest of the class, even if they are not public), having students create websites or wikis that showcase a research project they have completed, encouraging students to revise OER and re-share them for other students, teachers and the public, to opening one’s classroom activities to participation by those not officially registered in the course (such as by having discussions on social media, opening up presentations by doing them on webinars, and more).

In my work in open education, I have used, created and shared open educational resources, and I have also engaged in various activities I am putting under the general label of open pedagogy.

[In the rest of the application I discuss my open educational activities…]

——————————————————–

[1] Many MOOCs currently are offered through central organizations such as EdX (https://www.edx.org/), Coursera (https://www.coursera.org/), Future Learn (https://www.futurelearn.com/), Iversity (https://iversity.org/), and UnX (courses offered in Spanish and Portuguese) (http://www.redunx.org/web/aprende/cursos). But there are also institutions of higher education that offer their own MOOCs on their own platforms, without connecting to one of these kinds of organizations.

 

[2] For example, the Coursera terms of use say: “You may download material from the Sites only for your own personal, non-commercial use. You may not otherwise copy, reproduce, retransmit, distribute, publish, commercially exploit or otherwise transfer any material, nor may you modify or create derivatives works of the material.” (Coursera, 2014).

 

[3] Creative Commons licenses provide a range of choices depending on how one wants to share one’s work (e.g., one can restrict the work to non-commercial uses, one can insist that any new works made from the original be shared also with an open license, or one can allow others to reuse the work but not allow any revisions). Finally, Creative Commons has a public domain license by which one can signal that they are releasing their work into the public domain, free to use, revise, redistribute without restriction on how and for what purpose, and without the requirement that the original creator be attributed. See Creative Commons, “About the licenses” for more: http://creativecommons.org/licenses/.

 

Works Cited

Bass, R. and Elmendorf, H. (n.d.). Social pedagogies: Teagle Foundation white paper. Retrieved from https://blogs.commons.georgetown.edu/bassr/social-pedagogies/

Bruff, D. (2013, September 3). Students as Producers: An Introduction [Blog post]. Retrieved from http://cft.vanderbilt.edu/2013/09/students-as-producers-an-introduction/

The Cape Town Open Education Declaration. (2007). Read the Declaration. Retrieved from http://www.capetowndeclaration.org/read-the-declaration

Coursera. (2014). Terms of Use. Retrieved from https://www.coursera.org/about/terms

Ehlers, U.-D. (2011). Extending the Territory: From Open Educational Resources to Open Educational Practices. Journal of Open, Flexible and Distance Learning, 15(2), 1–10.

Grush, M. (2013, November 12). Open Pedagogy: Connection, Community, and Transparency–A Q&A with Tom Woodward. Retrieved February 15, 2015, from http://campustechnology.com/articles/2014/11/12/open-pedagogy-connection-community-and-transparency.aspx

Hodgkinson-Williams, C., & Gray, E. (2009). Degrees of openness: The emergence of Open Educational Resources at the University of Cape Town. International Journal of Education and Development Using Information and Communication Technology, 5(5), 101–116. Retrieved from http://ijedict.dec.uwi.edu/viewarticle.php?id=864

Neary, M., & Winn, J. (2009). The student as producer: reinventing the student experience in higher education. In The Future of Higher Education: Policy, Pedagogy and the Student Experience (pp. 192–210). London, UK: Continuum International Publishing Group. Retrieved from http://eprints.lincoln.ac.uk/1675/

Open Knowledge Foundation. (n.d.). The Open Definition. Retrieved from http://opendefinition.org/od/

Wiley, D. (n.d.). The open content definition. Retrieved from http://opencontent.org/definition/

Wiley, D. (2013, October 21). What is Open Pedagogy? [Blog post]. Retrieved from http://opencontent.org/blog/archives/2975

William and Flora Hewlett Foundation. (n.d.). Open Educational Resources. Retrieved from http://www.hewlett.org/programs/education/open-educational-resources

Rubrics and peer feedback

I’ve been participating in an open, online course called Human MOOC: Humanizing Online Instruction. It’s officially over now, but I’m just completing a couple of final things from it.

One of the sections was on peer review/peer feedback by students of each others’ work. There was a link to a very helpful resource on peer feedback from the teaching and learning centre at Washington University in St. Louis. This page, linked to the previous one, is also very useful: “How to Plan and Guide In-class Peer Review Sessions.” A couple of things struck me about these resources that I wanted to comment on briefly.

What rubric/criteria should students use to do peer review?

On the first resource linked above, the following is stated:

Some instructors ask their students to evaluate their peers’ writing using the same criteria the instructor uses when grading papers (e.g., quality of thesis, adequacy of support, coherence, etc.). Undergraduate students often have an inadequate understanding of these criteria, and as a result, they either ignore or inappropriately apply such criteria during peer-review sessions (Nilson 2003).

The second resource states similarly:

The role of the peer-reviewer should be that of a reader, not an evaluator or grader. Do not replicate the grading criteria when designing these worksheets. Your students will not necessarily be qualified to apply these criteria effectively, and they may feel uncomfortable if they are given the responsibility to pronounce an overall judgment on their peers’ work.

This makes sense, though at the same time it’s troubling because if the students can’t understand the rubrics we use to mark their work, then how can they understand why they got the mark they did, or what they need to do to improve? It seems to me the answer here is not to ask students to use a different rubric when doing peer review than what we use to mark, but changing the rubric we use to mark so that it makes more sense to students (if there are comprehension problems). Now, I haven’t read the work by Nilson cited above, but it would be interesting to look more carefully into what undergraduate students tend to understand or not understand, or why, and then change one’s rubric accordingly.

One way one might do this, perhaps, is to ask them to use one’s marking rubric to evaluate sample essays and then invite feedback on the rubric as/after they are doing this. Then one can maybe catch some of the things students don’t understand before one uses the rubric for marking the essays?

Mock peer review session

The second resource suggests that one holds a mock session to begin with, which seems an excellent idea. It connects with the importance of training students in peer review before asking them to engage in it on work for the course (as discussed in Sluijsmans et al., 2002).

The idea would be to give them a “fake” essay of a kind similar to what they need to write, give them the peer review worksheet, and ask them to come up with comments on the paper. This can be done individually or in groups. Then, in class, have students give their comments to the whole group and the instructor writes them down on something that can be shown on the screen (or, alternatively, one could have them write the comments on a shared document online so they could be projected easily and the instructor doesn’t have to re-write them!). Then the class can have a discussion on the essay, the comments, and the marking worksheet/rubric, to clear up any confusion or help students improve their comments–e.g., moving from “good introduction” to saying what about the introduction is good, in particular.

This is an excellent idea, and I’m going to incorporate it in my upcoming philosophy class this summer. In Arts One we meet every week to do peer review of essays, in groups of four students plus the prof, so we can help students learn how to do peer review well on an almost one-to-one basis. And, since they do it every week for a year, they get quite good at it after awhile, even a very short time, actually!

 

Self-assessment

I could have sworn that the resources linked above from Washington University also talked about the value of students doing self-assessment of their own work, but now I can’t find that on those pages. But I was thinking that after they do peer feedback on each others’ work, it would be useful for them to go back to their own work and give feedback on it. It seems to me that after reading and commenting on others’ work, seeing what works/what doesn’t work, one could come to one’s own with fresh eyes, having learned from others’ work and also having distanced oneself from one’s own a bit.

I think I’ll try asking students to submit the peer review worksheet on their own essays after doing the peer feedback on others’, when they turn in their drafts post-peer-feedback.

 

Works cited

Nilson, Linda. (2003). “Improving Student Peer Feedback.” College Teaching, 51 (1), p. 34-38.
Sluijsmans, D. M. A., Brand-Gruwel, S., van Merriënboer, J. J. G., & Bastiaens, T. J. (2002). The training of peer assessment skills to promote the development of reflection skills in teacher education. Studies in Educational Evaluation, 29(1), 23–42. http://doi.org/10.1016/S0191-491X(03)90003-4