Monthly Archives: July 2018

Peer-Assessment and Self-Assessment in Musical Performance

Until recently, very little scholarly attention has been paid to peer- and self- assessment in instrumental music performance. What research there is tells us that self-assessment is often out of touch with the assessments of teachers and peers (Bergee & Cecconi-Roberts, 2002). Instrumental teachers and ensemble coaches typically assume that players can evaluate their own performance correctly (or hope they will learn to do so over time), but the evidence compiled by Bergee & Cecconi-Roberts suggests that accurate self-assessment in musical performance is elusive at best. The studies of small group peer interaction carried out by Bergee & Cecconi further demonstrate the complexity of peer-assessment in music performance. These studies showed no consistent positive effect of peer feedback on the accuracy of musical self-assessment. Worse, if peer feedback is not handled well, they report that an even larger disconnect between self-assessment and teacher assessment can occur. So, what is happening here?

Based on my research, I suspect that the results of this study might accurately reflect two very important aspects of musical training that have been mostly unexplored:

  1. The goals of instrumental instruction are largely tacit.
  2. Musical self-assessment cannot be based on external measures of sound production.

From 2014-2016, I carried out a study of instrumental masterclasses created by members of the London Symphony Orchestra to guide instrumentalists in preparing audition materials for the YouTube Symphony (Kaastra, 2016). I adapted Herbert H. Clark’s conceptual framework for analyzing tacit processes in language use (H. H. Clark, Using Language 1996) to explore the tacit aspects of musical activity. These analyses demonstrate that instrumental teachers do more than just measure sound output and give feedback to students. Teachers demonstrate ways of attending to musical activity at different levels. These levels are discussed in detail in my paper (see reference below).

Self-assessment cannot be based on external measures alone. Yes, we can and should record ourselves and critique our performances as objectively as possible afterwards. But to succeed in real time, we need to learn to engage what Donald Schöen calls, “reflection-in-action” and “reflection on reflection-in-action” (Schöen, 1989). We engage metacognition. We learn to attend to the physiological processes that support our performance goals. If we are rehearsing intonation, the target of focal awareness is pitch. But pitch is a complex percept. On the bassoon, playing in tune requires monitoring and manipulation of air support, air speed, embouchure formation (lips, jaw, and tongue), articulation, head position, fingerings, and posture. We feel our sound and position our sound in the context of what we hear happening around us. Accurate self-assessment means that we feel in control of our self-positioning with respect to any number of performance goals – dynamics, pulse, tempo, tone quality, phrasing, etc. The more we learn to name these targets of focal awareness, isolate them, and work on them, the more mastery we gain and the more accurate our self-assessments will be as a result.

Next time you are in a lesson, think about how your teacher is identifying targets of focal awareness for you. Write about these in your reflective journal.

References:

Bergee, M. J. & Cecconi-Roberts, L. (2002). Effects of Small-Group Peer Interaction on Self-Evaluation of Music Performance. Journal of Research in Music Education, 50(3): 256-268.

Clark, H. H. (1996). Using Language. Cambridge University Press.

Kaastra, L. (2016). Tacit Knowledge in Orchestral Performance. College Music Symposium 56: n.p. Available online at: https://ubc.academia.edu/LindaKaastra

Schöen, D. (1989). “A Masterclass in Musical Performance.” Chapter 8 in, Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. Jossey-Bass Inc., Publishers.

 

Choosing a topic

Participants in WRDS 150 work on one research project for the whole semester. The research is carried out in stages, so that students can practice their research skills while learning about scholarly discourse. We spend a lot of time on discourse studies in class, so I will focus more on the writing process in this blog.

One of the first major challenges students face is choosing a topic to write about. Topics should be both interesting and specific. Interesting to who? To you, of course. A research topic is interesting when it excites you, and when you want to learn more about it. Good topics are ones that make you want to uncover, expose, argue, discover, investigate, and share. Buyer beware: good research will challenge you to think differently than you already do, to understand different points of view, and to ask new questions. Good research requires you to learn something and then share not only what you have learned, but how you learned it. You may not change your mind, but your explanations will be stronger as a result of your work.

In this course, we choose both a topic and a research perspective. A research perspective is a way of organizing a topic area to cultivate a certain kind of scholarly discourse. Research perspectives will have questions that they can and cannot ask of a topic. While we study the discourse features of scholarly articles in class, practice asking questions from each research perspective we study. Ask these questions in class and we will start some very interesting conversations! These conversations will help you identify your research topic.

WRDS 150 Changes – Graded Peer Review

Good News! ASRW has decided to eliminate the final exam for WRDS 150. To make up the 20 percentage points normally assigned to the final exam, I have chosen to more formally assess the peer reviews that take place throughout the semester. I view this as a wonderful opportunity to make some positive improvements to support student success in the course.

Why did I choose to focus on the peer reviews?

First, I already incorporate peer feedback at various points in the writing process. My students tell me that they learn important things about their own writing by reading the work of classmates, they understand the assignment criteria better by applying them to the work of another writer, and they benefit from the research conversations with classmates interested in similar topics. (I try to group students together based on their topics and research perspectives whenever possible.) These anecdotal reports seem to be supported by recent research on peer review which finds that the task of providing feedback to others exercises a type of evaluative judgement that can later be employed in self-assessment, which can [I assume, over time] reduce the need for external feedback (Nicol, Thomson, & Breslin 2014).

Second, scholarly research on peer review has shown that peer evaluation can encourage an increased motivation for learning, a sense of autonomy and responsibility among members of the class, and the development of transferable, lifelong skills (see Carvalho 2013).

Third, I now provide additional training to help students understand the task, scope, format, and motivation for each assignment. Since our writing assignments are scaffolded, each assignment builds on the lessons and products of the previous one, students will also be learning different peer review strategies for different stages of writing. This should support the development of self-regulation skills necessary for success as researchers (Nicol & Macfarlane-Dick 2006) and build a community practice of high quality peer feedback not only for writing and research, but hopefully by extension, for musical activity as well.

References:

Carvalho, A. (2013). Students’ perceptions of fairness in peer assessment: evidence from a problem-based learning course. Teaching in Higher Education, 18 (5), 491-505.

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in higher education, 31(2), 199-218.

Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: A peer review perspective. Assessment & Evaluation in Higher Education, 39, 102-122. https://doi.org/10.1080/02602938.2013.795518 (Links to an external site.)Links to an external site.

 

Engaging Performance

Welcome to my course blog for WRDS 150 – Engaging Performance. This blog provides background information on various topics raised in class. These topics provide context and rationale for the approach I take. Please visit the blogs on peer review and the writing process to see how our work is carried out.

“Engaging Performance” Course Blurb

Music and language share some key features as topics of research. First, the range of practices and perspectives on music and language are enormous. Both topics can be studied based on their varying cultural products and situated practices. Language texts and musical works are situated, they occur a result of cultural norms, beliefs, and practices. We can study genres of written text and genres of music. We can also study the activities of language and the activities of music making. We can even combine these perspectives to explore creative adaptations of language and music in the form of genre violations, mixed genre products and cross-genre performances.

This section of WRDS 150 takes a discourse studies approach to exploring the way performance is presented in a range of scholarly texts on music. We will critically engage six academic articles representing different disciplinary perspectives on music – musicology (music as discourse), music theory (the role of analysis in the performance of music), ethnomusicology (ethnographic perspectives on performance), and music cognition (empirical research on music performance). In taking this focus, we will aim to identify 1) how different disciplines in music scholarship portray the role of performers and the activities of performance and 2) how the research methods and writing styles of these different disciplines contribute to producing different kinds of knowledge about performance. Our writing about performance will aim to construct bridges between practice and research, giving students an apprenticeship for entering the academic community. Students in the course will be encouraged to position themselves as researchers by engaging their experience of performance with the knowledge making in one or more of these disciplines.