{"id":9,"date":"2014-01-16T22:39:28","date_gmt":"2014-01-17T05:39:28","guid":{"rendered":"https:\/\/blogs.ubc.ca\/leeyyetec565\/?page_id=9"},"modified":"2014-03-03T00:47:21","modified_gmt":"2014-03-03T07:47:21","slug":"assessment","status":"publish","type":"page","link":"https:\/\/blogs.ubc.ca\/leeyyetec565\/assessment\/","title":{"rendered":"Assessment"},"content":{"rendered":"

\"\"<\/a>A method of assessment\u00ad<\/span><\/em><\/strong><\/p>\n

The Moodle exam was designed to employ objective tests that assess aspects of student learning about computer programming. Objective tests (Pass IT, 2004) require examinees to provide responses to questions the correct answers of which are pre-determined. Multiple-Choice, Short-Answer and Matching question types are good choices to use in objective tests with CAA (Computer Aided Assessment). Questions based on these three types are designed to test Bloom\u2019s taxonomy (Center for Teaching, 2001): specifically knowledge, comprehension, application, and analysis. Essay questions are not easily assessed through CAA because pre-determined answers cannot be provided. Therefore, essay questions should be used for evaluating leaners\u2019 analysis, application and synthesis skills.<\/p>\n

Multiple Choice Questions<\/span><\/p>\n

Multiple-choice questions are suitable for objective tests that measure learners\u2019 level of understanding in a particular knowledge area. Multiple-choice questions can help teachers identify learners\u2019 conceptual knowledge and their ability to give examples related to the subject (Anderson, 2001) instead of simply recalling knowledge. I created three multiple-choice questions to evaluate learners\u2019 understanding of the specific areas through examples.<\/p>\n

Matching Questions<\/span><\/p>\n

Matching questions are a good choice to evaluate learners\u2019 understanding of the relationship between different pieces of knowledge: between definitions and terms, between examples and terms, between classifications and structures, and so on. Matching questions are a variation of the multiple-choice format and can be employed for the same purpose but they can also be used to evaluate a learner\u2019s ability to apply knowledge . For example, three of the matching questions created in Moodle evaluate learners\u2019 understanding of the relationship between the Scratch program blocks and corresponding programming concepts, as well as the application of programming knowledge in using Scratch blocks.<\/p>\n

It appears that partial marking is missing in the Moodle matching question type. However, I think that partial marks should be given to students successfully identify any correct answer.<\/p>\n

Short Answers<\/span><\/p>\n

A possible advantage of the short-answer question type is that the student must supply the correct answer rather than identify or choose it. The likelihood that the learner will guess the correct answer is lower than that of either a multiple-choice question or a matching question.<\/p>\n

Setting up answers for short answers questions was a bit frustrating because answers could be in many different formats. I overcame the issue by giving specific instructions on how to write answers with the acceptable format. For example, one of the short-answer questions required that the answer be \u201cconditional statement, loop, statements\u201d. I asked examinees to provide the answer in a specific order, separating its parts with commas. This would avoid issues like using different separators and writing the answers in a different order. Luckily, there was a feature in Moodle to allow short answer questions to have more than one answer to be evaluated. I successfully evaluated answers based on the number of matching words using wild cards (*).<\/p>\n

Essay Questions<\/span><\/p>\n

I chose two different topics. One of them asks students to write about \u201cthe ethical implications of adapting someone else’s software programming\u201d. The topic aims to promote real-life learning opportunity. The question can be part of a real-life interview. Analyzing the topic is a good way to foster programming ethics. The other topic asks students to compare differences between two programming syntax styles. The goal is to evaluate students\u2019 analysis skills.<\/p>\n

 <\/p>\n

Assessment Feedback<\/span><\/strong><\/em><\/p>\n

The feedback has been carefully designed to promote extended learning based on Gibbs & Simpson\u2019s (2004) assessment framework.<\/p>\n

I provided feedback that contained either details or further review links so that the process can promote active learning. The feedback did not state the responses were either correct or not correct. The assessment was provided as a part of a learning process. The exam provided students with constructive learning opportunities – further reading suggestions and course content URLs associated with the questions – to foster the assessments to be an extent of learning. (Gibbs & Simpson, p. 17)<\/p>\n

The feedback was given immediately after the exam \u00a0and received by students while it still matters to them, in time for them to pay attention to further learning or receive further assistance (Gibbs & Simpson, p. 18). This immediate feedback \u00a0was also emphasized in the seven principles of good practice (Chickering & Gamson, 1987; 1991).<\/p>\n

The Moodle feedback setting was missing one feature. It did not provide individual feedback when choices were not selected by examinees. Moodle only displayed feedback when answers were selected by examinees. The feature is important because non-selected answers can also provide students with opportunities to learn. Currently the opportunities are somewhat limited to showing feedback only related to the selected answers.<\/p>\n

References:\u00a0<\/span><\/strong><\/p>\n

Airasian, Peter W.; Cruikshank, Kathleen A.; Mayer, Richard E.;\u00a0Pintrich, Paul R.<\/a>; Raths, James; Wittrock, Merlin C. (2000). Anderson, Lorin W.;\u00a0Krathwohl, David R.<\/a>, eds.\u00a0A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives<\/i>. Allyn and Bacon<\/p>\n

Chickering, A.W. and Gamson, Z.F. (1987).\u00a0 Seven Principles for Good Practice in Undergraduate Education.\u00a0 American Association for Higher Education Bulletin, 39 (7), p. 3-7. http:\/\/www.aahea.org\/articles\/sevenprinciples1987.htm<\/a><\/p>\n

Good Practice Guide in Question and Test Design (2004), Pass IT<\/i>, Retrieved Feb 28, 2014, from http:\/\/www.calm.hw.ac.uk\/GeneralAuthoring\/031112-goodpracticeguide-hw.pdf<\/p>\n

Gibbs, G. & Simpson, C. (2005).\u00a0 \u201cConditions under which assessment supports students\u2019 learning.\u201d\u00a0Learning and Teaching in Higher Education<\/em>\u00a0Accessed online 11 March 2009.\u00a0http:\/\/www.open.ac.uk\/fast\/pdfs\/Gibbs%20and%20Simpson%202004-05.pdf<\/a><\/p>\n

Patricia Armstrong, Bloom\u2019s Taxonomy, Center for Teaching<\/i>, Retrieved Feb 28, 2014, from: http:\/\/cft.vanderbilt.edu\/guides-sub-pages\/blooms-taxonomy\/#2001<\/a><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

A method of assessment\u00ad The Moodle exam was designed to employ objective tests that assess aspects of student learning about computer programming. Objective tests (Pass IT, 2004) require examinees to provide responses to questions the correct answers of which are … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":22978,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-9","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/pages\/9","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/users\/22978"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/comments?post=9"}],"version-history":[{"count":4,"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/pages\/9\/revisions"}],"predecessor-version":[{"id":56,"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/pages\/9\/revisions\/56"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/leeyyetec565\/wp-json\/wp\/v2\/media?parent=9"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}