{"id":10,"date":"2009-05-16T21:04:11","date_gmt":"2009-05-17T05:04:11","guid":{"rendered":"https:\/\/blogs.ubc.ca\/leungetec565\/?page_id=10"},"modified":"2009-06-28T06:41:03","modified_gmt":"2009-06-28T14:41:03","slug":"assessment-tools","status":"publish","type":"page","link":"https:\/\/blogs.ubc.ca\/leungetec565\/assessment-tools\/","title":{"rendered":"Assessment Tools"},"content":{"rendered":"<p class=\"MsoNormal\"><!--[if gte mso 9]><xml> <w:WordDocument> <w:View>Normal<\/w:View> <w:Zoom>0<\/w:Zoom> <w:PunctuationKerning \/> <w:ValidateAgainstSchemas \/> <w:SaveIfXMLInvalid>false<\/w:SaveIfXMLInvalid> <w:IgnoreMixedContent>false<\/w:IgnoreMixedContent> <w:AlwaysShowPlaceholderText>false<\/w:AlwaysShowPlaceholderText> <w:Compatibility> <w:BreakWrappedTables \/> <w:SnapToGridInCell \/> <w:WrapTextWithPunct \/> <w:UseAsianBreakRules \/> <w:DontGrowAutofit \/> <w:UseFELayout \/> <\/w:Compatibility> <w:BrowserLevel>MicrosoftInternetExplorer4<\/w:BrowserLevel> <\/w:WordDocument> <\/xml><![endif]--><!--[if gte mso 9]><xml> <w:LatentStyles DefLockedState=\"false\" LatentStyleCount=\"156\"> <\/w:LatentStyles> <\/xml><![endif]--><strong>Reflection: Using Moodle\u2019s Assessment Tools<\/strong><\/p>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\">I have never created a test within a LMS before. After exploring Moodle\u2019s function in building a quiz, I\u2019d say I have mixed feelings over it: while I see that it can be used as a powerful, time-efficient way teachers can use Moodle\u2019s \u201cquiz\u201d function as a form of formative assessment, the function itself has some significant limitations that dampen its usefulness.<\/p>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\"><strong>Background<\/strong><\/p>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\">I have created a pre-test in my Biology 11 Moodle course. The intention of the pre-test is to give students an opportunity to gauge themselves of their preparedness in writing the unit test, which would be conducted in class. In designing the test, I have modified some materials from course exercises, and actual test questions, to give students a relevant flavour of what they should be expecting to see on their actual unit test. In choosing the types of questions to use on the pre-test, I have tried to sample the broad scope of concepts learned in the taxonomy and evolution unit of my course. I have also tried to provide a variety of question types to prepare students differently \u2013 of the ten questions on the pre-test, 3 were multiple-choice questions, 3 were matching questions, and there are 4 more short and essay questions (2 of each type).<\/p>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\">In designing the opening and closing date of this quiz, I am mindful of the fact that most students do not begin studying early to truly absorb and understand course materials. Hence, students were told that they must have completed the pre-test a few days before the actual unit test. I believe this would force students to begin studying early. To remain consistent with the concept of using formative assessment to foster growth in students\u2019 understanding of course concepts, without creating a sense of frustration, I have chosen to NOT give actual, concrete marks for the pre-test \u2013 students would receive a participation mark for having completed the pre-test before its due date. To further reduce anxiety, I am also allowing students to try the pre-test twice. It is my hope that students would be able to reflect on the area(s) of challenge after their first test attempt, and would study or seek help to overcome these challenges.<\/p>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\"><strong>Positives<\/strong><\/p>\n<p class=\"MsoNormal\">\n<ul>\n<li>Moodle\u2019s quiz function allows the instructor to create a test bank of questions. The instructor, when creating a new quiz, can choose to use these questions that are already built. This would allow an instructor to either: a) create multiple tests that can be used for different sections that he\/she teaches, or b) create tests from different phases of a teaching unit \u2013 this would provide great insights into how students are progressing through a unit.<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<ul>\n<li>Moodle allows a relative easy way to upload a picture into a test question. Instructors can use the \u201cfile\u201d function under the main screen to upload a collection of images onto the Moodle site. Then, as test questions are being created, pictures can be easily added.<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<ul>\n<li>Gibbs and Simpson (2005) argue that it is important to support student learning by giving them immediate feedback. This is one of the prominent features of Moodle\u2019s quiz function in allowing a student who is trying a quiz to instantly know whether an answer is correct or not. If used as a summative assessment, the instructor can also disable that function, so students would only know their mark after they have submitted the assignment. Instant feedback also allows the instructor to provide the students with the correct answer and\/or explanation of the answer as well. This works particularly well in short answer questions, where a partial answer can potentially prompt a screen that explains the question more thoroughly.<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\"><strong>Challenges<\/strong><\/p>\n<p class=\"MsoNormal\">\n<ul>\n<li>Objective Answers\u2019 Nightmares: While Moodle quiz works very well for multiple-choice, true-false, and matching questions, the same cannot be said of objective answers. In my experience, when I have created a short answer question, a response would be marked wrong even when it is using almost all of the same words as the \u2018standard answer.\u201d (e.g. \u201cBecause all of these primates have fur\u201d is marked wrong when the \u201cstandard\u201d answer is \u201cBecause all of them have fur\u201d).<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<ul>\n<li>Misleading Score: When short-answer and essay questions are a significant component of a quiz created in Moodle, a student\u2019s quiz score would be substantially skewed to be lower than reality. This is because Moodle does not have to ability to grade an essay-type question, which in itself is educationally sound. However, when calculating how a student has done on a quiz, it will report a mark of zero for any of such questions. I have placed a disclaimer as part of the instruction for the test, but the surprisingly low mark may still affect students\u2019 motivation negatively.<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<ul>\n<li>Scrambling Woes: Teachers who give multiple-choice tests would generally welcome a feature where the choices are automatically scrambled (or randomized) for them. This practice would help make cheating more difficult, and thus may dissuade students from any attempts to demonstrate academic dishonesty. However, logistically, this scrambling feature makes it difficult for a variety of high-level multiple choice questions. For example, I cannot give choices a to c with possible answers, then have choice \u201cd\u201d as \u201call of the above\u201d and \u201ce\u201d as \u201cnone of the above.\u201d I also cannot give a question where some choices feature a combination of earlier answers (e.g. choice \u201cd\u201d is \u201conly a and c,\u201d or choice e is \u201call of the above except c\u201d). Moodle does not allow the instructor to turn the randomizing feature on for selected questions only, and this greatly decreases the effectiveness of the feature.<\/li>\n<\/ul>\n<p class=\"MsoNormal\">\n<p class=\"MsoNormal\"><strong>Reference:<\/strong><\/p>\n<p class=\"MsoNormal\">\n<p><span style=\"font-size: 12pt; font-family: &quot;Times New Roman&quot;;\">Gibbs, G. and Simpson, C. (2005).\u00a0 \u201cConditions under which assessment supports students\u2019 learning.\u201d <em>Learning and Teaching in Higher Education<\/em> Accessed online 25 June 2009 <a href=\"http:\/\/www.open.ac.uk\/fast\/pdfs\/Gibbs%20and%20Simpson%202004-05.pdf\" target=\"_blank\">http:\/\/www.open.ac.uk\/fast\/pdfs\/Gibbs%20and%20Simpson%202004-05.pdf<\/a><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Reflection: Using Moodle\u2019s Assessment Tools I have never created a test within a LMS before. After exploring Moodle\u2019s function in building a quiz, I\u2019d say I have mixed feelings over it: while I see that it can be used as a powerful, time-efficient way teachers can use Moodle\u2019s \u201cquiz\u201d function as a form of formative [&hellip;]<\/p>\n","protected":false},"author":661,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-10","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/pages\/10","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/users\/661"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/comments?post=10"}],"version-history":[{"count":4,"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/pages\/10\/revisions"}],"predecessor-version":[{"id":41,"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/pages\/10\/revisions\/41"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/leungetec565\/wp-json\/wp\/v2\/media?parent=10"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}