{"id":953,"date":"2013-02-26T12:00:53","date_gmt":"2013-02-26T19:00:53","guid":{"rendered":"https:\/\/blogs.ubc.ca\/chendricks\/?p=953"},"modified":"2013-03-02T17:21:13","modified_gmt":"2013-03-03T00:21:13","slug":"peer-assessment-face-to-face-vs-online-synchronous-part-2","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/chendricks\/2013\/02\/26\/peer-assessment-face-to-face-vs-online-synchronous-part-2\/","title":{"rendered":"Peer Assessment: Face to face vs. online, synchronous (Part 2)"},"content":{"rendered":"

Here I look at one last study I’ve found that focuses on the nature of student peer feedback discussions when they take place in a synchronous, online environment (a text-based chat). Part 1 corresponding to this post can be found here.<\/a><\/span><\/span><\/p>\n

Jones, R.H., Garralda, A., Li, D.C.S. & Lock, G. (2006)<\/strong> <\/strong>Interactional dynamics in on-line and face-to-face peer-tutoring sessions for second language writers, Journal of Second Language Writing<\/em> 15,\u00a0 1\u201323. <\/strong><\/span>DOI:<\/span> http:\/\/dx.doi.org\/10.1016\/j.jslw.2005.12.001<\/a><\/span><\/p>\n

This study is rather different than the ones I looked at in Part 1 of face to face vs. online, synchronous peer assessment,<\/a><\/span> because here the subjects of the study are students and peer tutors in a writing centre rather than peers in the same course. Still, at least some of their results regarding the nature of peer talk in the tutor situation may still be relevant for peer assessment in courses.<\/span><\/p>\n

\"\"<\/a>

The Tutoring Centre<\/a>, by Tulane Public Relations,<\/a> on Flickr. CC-By licensed.<\/a><\/p><\/div>\n

Participants and data<\/strong><\/span><\/span><\/p>\n

The participants in this study were five peer tutors in a writing centre in Hong Kong, dedicated to helping non-native English speakers write in English. For both tutors and clients, <\/span>English was an additional language, but the tutors were further along in their English studies and had more proficiency in writing in English than the clients. Data was collected from transcripts of face to face consultations of the tutors with clients, as well as transcripts of online, text-based chat sessions of the same tutors, with many of the same clients.
\n<\/span><\/p>\n

Face to face tutoring was only available in the daytime on weekdays, so if students wanted help after hours, they could turn to the online chat. Face to face sessions lasted between 15 and 30 minutes, and students “usually” emailed a draft of their work to the tutor before the session. Chat sessions could be anywhere from a few minutes to an hour, and though tutors and clients could send files to each other through a file exchange system, this was only done “sometimes” (6). These details will become important later.<\/span><\/p>\n

Model for analyzing speech<\/strong><\/span><\/p>\n

<\/strong>To analyze the interactions between tutors and clients, the authors used a model based on <\/span>“Halliday\u2019s functional-semantic view of dialogue (Eggins & Slade, 1997; Halliday, 1994)” (4).<\/span> In this model, one analyzes conversational “moves,” which are different than “turns”–a “turn” can have more than one “move.”<\/span> The authors explain a move as “a discourse unit that represents the realization of a speech function” (4).<\/span><\/p>\n

In their model, the authors use a fundamental distinction given by Halliday into “initiating moves” and “responding moves”:<\/span><\/p>\n

\n
\n
\n

Initiating moves (statements, offers, questions, and commands) are those taken independently of an initiating move by the other party; responding moves (such as acts of acknowledgement, agreement, compliance, acceptance, and answering) are those taken in response to an initiating move by the other party.<\/span>\u00a0(4-5)<\/span><\/p><\/blockquote>\n

They then subdivide these two categories further, some of which is discussed briefly below.
\n<\/span><\/p>\n

Results
\n<\/span><\/strong><\/p>\n<\/div>\n<\/div>\n<\/div>\n

Conversational control<\/span><\/span><\/p>\n

In the face to face meetings, the tutors exerted the most control over the discussions. Tutors had many more initiating moves (around 40% of their total moves, vs. around 10% of those for clients), whereas clients had more responding moves (around 33% of clients’ total moves, vs. about 14% for tutors). In the chat conversations, on the other hand, initiating and responding moves were about equal for both tutors and clients (7).<\/span><\/p>\n

Looking more closely at the initiating moves made by both tutors and clients, the authors report:
\n<\/span><\/p>\n

\n
\n
\n

In face-to-face meetings, tutors controlled conversations primarily by asking questions, making statements, and issuing directives. In this mode tutors asked four times more questions than clients. In the on-line mode, clients asked more questions than tutors, made significantly more statements than in the face-to-face mode, and issued just as many directives as tutors. (10)<\/span><\/p><\/blockquote>\n<\/div>\n<\/div>\n<\/div>\n

Types of questions<\/span><\/span><\/p>\n

However, the authors also point out that even though the clients asserted more conversational control in the online chats, it was “typical” of the chats to consist of questions by students asking whether phrases, words, or sentences were “correct” (11). They did not often ask for explanations, just a kind of check of their work from an expert and a quick answer as to whether something was right or wrong. On the other hand, when tutors controlled the conversations with their questions, it was often the case that they were using strategies to try to get clients to understand something themselves, to understand why something is right or wrong and to be able to apply that later. <\/span>So “control” over the conversation, and who asks the most questions or issues the most directives, are not the only important considerations here.<\/span><\/p>\n

The authors also divided the questions into three different types. Closed questions:<\/strong> “those eliciting yes\/no responses or giving the answerer a finite number of choices;\u00a0open questions: <\/strong>“those eliciting more extended replies”; rhetorical questions: <\/strong>“those which are not meant to elicit a response at all” (12)<\/span><\/p>\n

In the face to face sessions, tutors used more closed questions (about 50% of their initiating questions) than open questions (about 33%); the opposite was true in the online chats: tutors used more open questions (about 50% of their initiating questions) than closed (about 41%).<\/span><\/p>\n

<\/p>\n

Directives (a subcategory of initiating moves)<\/span><\/span><\/p>\n

The authors note that “in face-to-face sessions, tutors issued more than six times more directives than clients,” but in the online chats the number of directives was about the same for tutors and clients (14). They subdivided directives into requests, suggestions and commands, and found that:<\/span><\/p>\n

    \n
  • In face to face meetings tutors made over twice as many requests as clients, whereas in the online chats clients made about three times more requests than tutors.<\/span><\/li>\n
  • In face to face meetings clients made very few commands, whereas in the online chats the number of commands amongst clients and tutors was about the same. <\/span><\/li>\n
  • In both modes, <\/span>unsurprisingly, tutors made significantly more suggestions than clients. (14)<\/span><\/li>\n<\/ul>\n

    Topics of discussion
    \n<\/span><\/p>\n

    \u00a0In the face to face mode, there were many more conversational turns devoted to “textual” issues such as grammar, word choice and style than in the online chat mode. On the other hand, in the online chats there were more conversational turns devoted to the “higher order goals” (Brufee, 1986; Harris, 1986) related to content and the writing process than in the face to face mode.
    \n<\/span><\/p>\n

    \n
    \n
    \n

    Some of the other results could be grounded in this difference in topic, the researchers point out. Focusing on grammar, word choice, and other “local,” “textual” issues may tend to lead to tutor-controlled discussions with fewer open-ended questions than focusing on larger writing issues.<\/span><\/p>\n

    Finally, the authors point out that there was much more “relational” talk in the online chat mode than in the face to face mode. Clearly some of this is due to the fact that establishing and maintaining relationships is harder in a text-based chat than in a face to face meeting, but the authors suggest that more was happening than this: the tutor\/client relationship was different in the online mode than in the face to face mode, they argue (16). Relying mostly on the sheer amount of relational talk in the online mode (as well, presumably, as an analysis of the recorded chats, though they don’t mention this), they authors state that the online chats were more like conversations, more open and fluid and with more sharing of personalities, than the face to face meetings. The latter were structured more like “lessons,” with a hierarchical relationship between tutor and client.<\/span><\/p>\n

    Discussion<\/strong><\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n

    In the last part of the article, the authors ask,<\/span><\/p>\n

    \n
    \n
    \n
    \n

    what can account for the dramatic shift in interactional dynamics when the tutoring sessions were conducted on-line? (17)<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/blockquote>\n

    \u00a0They suggest, relying in part on other research, that computer-mediated communication can lead to more personal sharing and disclosure, the development of more egalitarian relationships, partly due to the perceived distance from the other person. They also note that going into the writing centre meant clients were on the tutors’ “turf,” whereas engaging in online chats could be done from the clients’ own “turf.”<\/span><\/p>\n

    The conclusion reached here is that both types of tutoring might be useful, since they seem to focus on different topics (local, textual vs. global).<\/span><\/p>\n

    My thoughts<\/span><\/strong><\/p>\n

    It may be that many of these results can be explained by the tutors having essays before the face to face meeting (and thus able to come ready with detailed comments) and also tutors and clients both looking at the essay during the session. Neither of these were usually the case for the online chats. Thus, perhaps it was not so much the medium that made the difference–except insofar as the medium of the online chat made it more difficult to share files (I don’t know if that was true or not). <\/span><\/p>\n

    The different topics of the chat could be explained by this–it’s much easier to discuss textual issues with the essay in front of you during the meeting.\u00a0 And if, as the authors pointed out when discussing the different topics of the two modes (local vs. global writing concerns), the differing topics can explain at least some of the other differences found, such as in the types of questions and the power relations, then it could be that many of the results found here were due to tutors having the essay in front of them (and beforehand) during the face to face session but not the online chat.<\/span><\/p>\n

    For example, couldn’t the differences in the initiating moves, including questions, requests and commands, have in large part to do with this difference? If the tutor has the paper beforehand, s\/he could have numerous questions, requests and commands ready. In the online chats the initiator of the discussion is the client, who chooses to contact the tutor with a request or question in mind. The client is now the one who is prepared beforehand with something to say, and the discussion is centred around his\/her question, request or other initiating move.<\/span><\/p>\n

    If the tutor and client both had the essay in front of them during the online chat, and if the tutor had had it before the chat and thus came ready with comments already prepared, would this have changed the nature of the dialogue in the chat?<\/span><\/p>\n

    Relating this study to peer assessment<\/span><\/p>\n

    I’m less concerned in peer assessment with issues of power hierarchies than Jones et al. were in this study about tutors and clients, though I think such issues can and do come up. It is quite possible that some students see themselves as more expert on a subject or with a skill than other students–and others might see them this way as well–which could lead to some problematic power dynamics in peer assessment.<\/span><\/p>\n

    I’m more interested in whether the two modes (face to face or online, text-based chat) differ in terms of how students interact in them. I expect they do, but I am concerned about the issue noted above with the difference here possibly pertaining largely to having the essay in hand, and ahead of time, or not. In all my work with peer assessment, students read and comment on each others’ essays before discussing together, so an online chat with this kind of peer assessment may look very different from what Jones et al. have reported.
    \n<\/span><\/p>\n

    In the next post I’m going to try to summarize and make some conclusions (if possible) from all the research I’ve summarized (so far) on different modes of peer assessment.<\/span><\/p>\n

     <\/p>\n

    Works Cited<\/span><\/span><\/p>\n

    \n
    \n
    \n
    \n
    \n
    \n

    Bruffee, K. A. (1986). Social construction, language and knowledge. A bibliographical essay. College English<\/em>, 48, 773\u2013790.<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n

    Eggins, S., & Slade, D. (1997). Analyzing casual conversation<\/em>. London: Cassell.<\/span><\/p>\n

    \n
    \n
    \n

    Halliday, M. A. K. (1994). An introduction to functional grammar<\/em> (2nd ed.). London: Edward Arnold.<\/span><\/p>\n

    \n
    \n
    \n

    Harris, M. (1986). Teaching one-to-one: The writing conference.<\/em> Urbana, IL: National Council of Teachers of English.<\/span><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n

     <\/p>\n","protected":false},"excerpt":{"rendered":"

    Here I look at one last study I’ve found that focuses on the nature of student peer feedback discussions when they take place in a synchronous, online environment (a text-based chat). Part 1 corresponding to this post can be found here. Jones, R.H., Garralda, A., Li, D.C.S. & Lock, G. (2006) Interactional dynamics in on-line […]<\/p>\n","protected":false},"author":665,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[699867,460443],"tags":[460462,1230],"class_list":["post-953","post","type-post","status-publish","format-standard","hentry","category-peer-assessment-feedback","category-scholarship-of-teaching-and-learning","tag-research-reviews","tag-writing"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/posts\/953","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/users\/665"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/comments?post=953"}],"version-history":[{"count":27,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/posts\/953\/revisions"}],"predecessor-version":[{"id":1107,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/posts\/953\/revisions\/1107"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/media?parent=953"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/categories?post=953"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/chendricks\/wp-json\/wp\/v2\/tags?post=953"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}