Beyond feedback: Developing student capability in complex appraisal (Sadler, 2010).

In articles I read about student peer feedback, Sadler’s work is repeatedly referenced–hence my interest in reading this paper. Below are some of my notes from “Beyond feedback: Developing student capability in complex appraisal” by Dr. Royce Sadler.

Sadler argues that “regardless of levels of motivation to learn, students cannot convert feedback statements into actions for improvement without sufficient working knowledge of some fundamental concepts.” (p.537)

• “For students to be able to apply feedback, they need to understand the meaning of the feedback statements.” p.535
• Ideally, feedback helps students engage in divergent thinking (ie, not memorization, not one narrow response)
• The literature on feedback has often declared that feedback aids learning (i.e., it can accelerate learning)

Those who have studied how students respond to instructor-provided feedback, acknowledge that, in order to improve communication, we need to:

• Raise students’ understanding of assessment criteria
• Recognize that the medium of communication matters (certain comments/ideas/etc are more likely to be communicated in writing, others more likely to be communicated orally. See p.537)

Challenges associated with feedback:

• Feedforward and feedback are essentially about telling and disclosure and typically consist of 1-way messages from instructor to student.
• Students have trouble assimilating feedback from instructors into an existing knowledge base.
• “Complementary attention should therefore be directed to what students make of the feedback, rather than just its composition. Seen from the learner’s perspective, this represents an emphasis on visibility (to the student) rather than disclosure (by the teacher)” ” (p.539) [I really like that quote]

Interpretive challenges faced by students

Students face at least three interpretive challenges when trying to capitalise on feedback. In order to be able to make critical connections between feedback and their work, students need to have knowledge/understanding of three relevant appraisal terms and concepts. Sadler urges that “these assessment concepts must be understood not as abstractions but as core concepts that are internalised, operationalised and applied to concrete productions” (p.548).

The core concepts are:

1. Task Compliance.  Did the student comply with the basic specifications of the assignment? A simplistic example would be: if the instructor asked for an essay, did the student produce an essay (vs, let’s say, a podcast).  I’m oversimplifying here.
2. Quality.  Sadler defines quality as “The degree to which a work comes together as a whole to achieve its intended purpose” (p.544). Determinations of quality require judgements of many different things and also require diverse forms of judgment. As such, we need to create planned opportunities for students to practice with feedback.
3. Criteria. A criterion is a “property or characteristic that is useful in the context of quality and quality determinations” (p.544). Students need help grasping the role and nuances of the criteria used in the assessment. Part of the challenge here is that some criterion have sharp boundaries and others don’t.

Even once the students understand these concepts, learners still face the challenge of assimilating the teacher’s feedback into an existing knowledge base so that it can be drawn on in the future (and this task draws on tacit knowledge, as well as an understanding of the concepts). “As with all learning, newly acquired knowledge needs to be consolidated before it decays if it is to have any positive influence on future works” (p.540).

A helpful summary from the section“A way forward”

Sadler writes:

“There are four basic tasks for peer appraisal, and they can be expressed as questions in the following order.

Does a particular response qualify as an attempt to address the issue specified in the task description? This is a category question, not a quality issue, and can be decided only after analysing the work as a whole.

The next question is: How well does the work achieve the purpose intended? This gets to the heart of the determination of quality.

Third: What are the grounds for the judgement reached, using whatever criteria are appropriate to substantiating the valuation?…

The fourth and final question is: How could the work be substantially improved? This requires advice in terms of the work as a whole, and on specific deficiencies or weaknesses.” p.547

Reference: Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), 535-550.

Photo from Pexels

Building rapport with your students: help them understand their role as active civil participants in the classroom

Much has been written about how faculty members can create rapport with their students.  I suspect most of us have had the experience of teaching a class, posing a question and/or seeking a reaction, and getting minimal-to-no response (even after giving adequate wait time)! Ugh. For someone like me who values connection, these moments aren’t high points.

Recently, I was listening to Dr. Todd Zakrajsek speak on the Teaching in Higher Education podcast. Though the episode was about laptops in the classroom, Todd briefly addressed ways instructors can build rapport with their students by helping them understand what it means to be an active civil participant in the classroom (episode time stamp 31:15 – 32:34).

Here is what he suggested:

• At the beginning of the course, speak with your students about being an active civil participant in a community (i.e., the course)
• You may say something along the lines of “If I’m talking about something I feel is important and relevant to the course, you can be an active participant by nodding at my periodically, you may smile, or show me other facial expressions.”
• “When you (the student) asks me questions, I will listen to you and give you non-verbal feedback that shows you I care about what you’re saying. Could you please do that for me too?”
• “When I’m up here [front of class] and look out and see a sea of faces that are buried in their laptops or without expression, that makes my job hard–and my job is to help you learn stuff that is going to help you!”

What are some of the ways you educate your students about being an active participant in your classroom, especially as it pertains to building instructor-student rapport?

Additional resources on instructor-student rapport:

• Building Rapport with Your Students (Faculty Focus article)
• Establishing Rapport: Personal Interaction and Learning (IDEA Paper #39)
• The Undergraduate Experience: Focusing Institutions on What Matters Most. (Book by Felten, P., Gardner, J. N., Schroeder, C. C., Lambert, L. M., Barefoot, B. O., & Hrabowski, F. A. (2016))

Image credit: https://commons.wikimedia.org/wiki/File:Yukio_Koriyama_Polytechnique.jpg