{"id":10,"date":"2010-01-10T15:14:46","date_gmt":"2010-01-10T23:14:46","guid":{"rendered":"https:\/\/blogs.ubc.ca\/critoetec565a\/?page_id=10"},"modified":"2010-03-14T20:56:38","modified_gmt":"2010-03-15T04:56:38","slug":"assessment","status":"publish","type":"page","link":"https:\/\/blogs.ubc.ca\/critoetec565a\/assessment\/","title":{"rendered":"Assessment"},"content":{"rendered":"

Creating an assessment in Moodle using the the Moodle quiz activity was definitely a challenge – which I discuss in more depth in my blog.\u00a0 Here I will review and reflect on the process I went through designing my quiz <\/a>using the ‘options’ available with the Moodle quiz tool whilst trying to be mindful of both the learning objectives of this course<\/a> and the 10 Conditions of learning in the Gibbs & Simpson article:<\/p>\n

Quiz Objective<\/strong>: My goal here is to give the students an opportunity to assess their \u2018learning\u2019, not for me to assess them.\u00a0 Therefore, as much as I have left options for them to \u2018cheat\u2019, it really comes down to the classic axiom, \u2018they are only cheating themselves\u2019.<\/p>\n

Lesson<\/strong>: I have chosen to introduce the quiz using a lesson and linking the quiz to it so that I can explain the content, layout, timing, expectations and scoring to the students.\u00a0 By doing introducing the quiz in this way, and allowing a minimum of 24 hours for the students to process this information (the test will not open until the day after the lesson does), the students should well prepared to engage with the quiz rather than fiddle (what buttons do I push, how much time will I have, etc) with the quiz format.<\/p>\n

Timing<\/strong>:\u00a0 Time is an important theme in the course and comes into play during the quiz, especially for the long answer questions.\u00a0 Because the course is about the interview, and these essay questions are, ostensibly, interview questions.\u00a0 Giving the students a tight time frame will reinforce the importance of the 3 second rule (you should begin your response within 3 seconds) and the 3 minute rule (your answers should be 2 – 3 minutes long, max! with added time for keyboarding skills, or lack thereof).\u00a0 The students should know the answers (content) as they are from their own experience and we will also have practiced these in \u2018class\u2019, both (hopefully) in writing and orally.\u00a0 That said, I have given students suggested time frames for answering all of the questions so they have enough time to work through the last two.\u00a0\u00a0 I am also attempting to emulate condition 2 particularly with respect to the time allotment for and weighting of the essay questions which echoes the time spent and focus on what was practiced in class. \u00a0The time the quiz will be open has been restricted to 3 days so students don\u2019t have time to \u2018over think\u2019 the quiz.\u00a0 Again, this would take away from them being able to practice answering questions \u2018under pressure\u2019.<\/p>\n

Display: <\/strong>Students will be able to see 1 question per page.\u00a0 While they may jump from page to page to see the other questions, it is a bit of a waste of time and hopefully, they will not be inclined to do so.\u00a0 Given that the answers may be in their notes and in the content of the course and they could look them up if they wanted (especially with the essay questions \u2013 and copy and paste might be tempting)\u00a0but the tight time frame should deter them from trying this.\u00a0 I would have liked to use images instead of text in the answers to the fourth question (multiple choice) on the quiz but that did not appear to be an option within the framework.\u00a0 I believe I could put the images (if I had them) in the question, numbered them and the referred to them in the answers.<\/p>\n

Question Types: <\/strong>The only question format I didn\u2019t really like was the short answer format as the only questions I could come up with for this format\/type\u00a0seemed far to \u2018rote\u2019 for my taste.\u00a0 Hence, I decided to start the quiz with these questions and chose two points that I have stressed with the students in my f2f teachings and will attempt to do so in this, the online version. \u00a0I next moved to the multiple choice, matching and finally essay.\u00a0 Though the essay questions are my assessment tool of choice, the opportunity to provide substantive feedback on the multiple choice and questions and overall feedback on the matching the questions (which I will take up later in the feedback section) was very impressive and allowed me the opportunity to, in a sense, blur the lines between assessing and teaching when I chose both the answers and wrote up the feedback.\u00a0 Allowing the students to revise their answers if they do not get full marks on their first choice\/submission and after reading (and hopefully processing) the feedback is for me a valuable option and also falls nicely into Gibbs conditions 9 and 10.<\/p>\n

Attempts<\/strong>:\u00a0 I have chosen to limit the students to 1 attempt.\u00a0 I have limited it to 1 attempt because I do not want them to spend too much time on being \u2018right\u2019 or, for that matter, on revising their short and long answer responses as this takes away from the \u2018tight time frame\u2019 which, again, is really what is being stressed.\u00a0 I have also chosen not to go with the adaptive mode.\u00a0 What I am allowing is for the students to change their answers if they do not get them \u2018right\u2019 enough.\u00a0 Their scores will be penalized for this, and it will, of course, take time away from more (heavily weighted) important questions so they must make quick decisions as to how to proceed and budget their time.<\/p>\n

Grades<\/strong>: I have weighted the long answer responses much more heavily than the short answer, multiple choice and matching questions as a way of stressing that their ability to answer to these questions is of more importance (in a sense, formative over summative).\u00a0 The answers for the essay questions will be graded manually, and will come at a later date.\u00a0 It is a fair bit of work, but a good balance with the site generated grading.<\/p>\n

Review Options<\/strong>:\u00a0 All of the review options have been checked.\u00a0 The immediacy of the feedback is definitely inline with condition 6 and it allows the students to redo (albeit, quickly) each question (with a penalty) in search of the best answer.<\/p>\n

Security<\/strong>: not necessary.\u00a0 Again, if the students want to cheat, they will.\u00a0 I also believe that adding security may indicate a lack of trust which may end up being a self fulfilling prophecy.<\/p>\n

Common module settings<\/strong>: I would have liked to have hidden the test so that the students can only access it through a lesson which is intended to introduce the quiz, its objectives, and structure.\u00a0 Instead, I will delay the start of the test.<\/p>\n

Feedback<\/strong>: There are varied spaces for feedback \u2013 some \u2018suggestive\u2019 or helpful to students when framing their answers to the questions, some to give a \u2018pat on the back\u2019 for a good answer, and some that give the opportunity to explain to students why certain answer are \u2018better\u2019 than others.\u00a0 I have attempted to take advantage of as many of these as possible in the multiple choice and matching sections and have tried to frame the feedback with conditions 4, 5, and 7 through 10 in mind.\u00a0 I considered linking the feedback to where the answers would have come up during the lessons, but think it best to be \u2018present\u2019 with feedback.\u00a0 I also sense that the \u2018answers\u2019 to these questions are actually going to come up in the discussions, not the content so the links may not even be available.\u00a0 I am considering going over the test with the students and discuss why some of the answers were \u2018better\u2019 than others in a final forum as well as how it felt being pressed for time while trying to make a \u2018good impression\u2019 of sorts.<\/p>\n

Gibbs & Simpsons 10 conditions:<\/em><\/p>\n

    \n
  1. Sufficient assessed tasks are provided for students to capture sufficient study time. <\/em><\/li>\n
  2. These tasks are engaged with by students, orienting them to allocate appropriate amounts of time and effort to the most important aspects of the course. <\/em><\/li>\n
  3. Tackling the assessed task engages students in productive learning activity of an appropriate kind.<\/em><\/li>\n
  4. Sufficient feedback is provided, both often enough and in enough detail.<\/em><\/li>\n
  5. The feedback focuses on students\u2019 performance, on their learning and on actions under the students\u2019 control, rather than on the students themselves and on their characteristics.<\/em><\/li>\n
  6. The feedback is timely in that it is received by students while it still matters to them and in time for them to pay attention to further learning or receive further assistance.<\/em><\/li>\n
  7. Feedback is appropriate to the purpose of the assignment and to its criteria for success.<\/em><\/li>\n
  8. Feedback is appropriate, in relation to students\u2019 understanding of what they are supposed to be doing<\/em><\/li>\n
  9. Feedback is received and attended to<\/em><\/li>\n
  10. Feedback is acted upon by the student<\/em><\/li>\n<\/ol>\n

    Gibbs, G. & Simpson, C (2005).\u00a0 Conditions under which assessment supports students’ learning.\u00a0 Learning and Teaching in Higher Education, 1 <\/em>(1), 3-31.\u00a0 Retrieved 8 February 2009 from: http:\/\/www.open.ac.uk\/fast\/pdfs\/Gibbs%20and%20Simpson%202004-05.pdf <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

    Creating an assessment in Moodle using the the Moodle quiz activity was definitely a challenge – which I discuss in more depth in my blog.\u00a0 Here I will review and reflect on the process I went through designing my quiz using the ‘options’ available with the Moodle quiz tool whilst trying to be mindful of […]<\/p>\n","protected":false},"author":108,"featured_media":0,"parent":0,"menu_order":5,"comment_status":"open","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-10","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/pages\/10","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/users\/108"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/comments?post=10"}],"version-history":[{"count":12,"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/pages\/10\/revisions"}],"predecessor-version":[{"id":82,"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/pages\/10\/revisions\/82"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/critoetec565a\/wp-json\/wp\/v2\/media?parent=10"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}