Monthly Archives: June 2009

Sample assessment activity

I’ve posted a sample of an e-learning assessment activity to my WebCT account.

I’ve chosen to do a self-assessed quiz that incorporates a number of different question-and-answer strategies: multiple choice, matching, short answer, and short essay. I’ve also incorporated feedback for the student whenever possible.

The set-up for the quiz includes the following options:

  • Deliver questions one at a time
  • Timed (30 minutes)
  • Unlimited attempts allowed (questions randomized for each attempt; minimum attempt time of 10 minutes)
  • Student score released
  • Statistics released

The goals here are fairly simple. Gibbs and Simpson (2004) indicate that student learning behavior is heavily drive by assessment (p 4). Hence, the first goal is to assess the most critical learning components. Furthermore, they state that high-quality feedback is strongly and positively correlated with learning. So the goal is to incorporate as much feedback as possible. This includes the very basic feedback of students seeing what they answered correctly and what they answered incorrectly, and a more advanced level of providing feedback on each answer to selected questions.

Also, Gibbs and Simpson make it clear that formative assessment is a very powerful means of ensuring that learning is occurring … so I’ve set this up during the course as a formative assessment exercise, not at the end of the course as a summative test at the end of a unit.

A benefit of using ICT technology for assessment like this, provided it is set up properly, is that every student can receive feedback on their performance … something that would be more difficult to achieve with in-person or non-ICT forms of assessment. Note however that this increase in scale of assessment comes with a concomitant decrease in the personalization of assessment, a negative that must be taken into account and compensated for elsewhere in the course.

Of critical importance to me as the instructor is not just that students are able to assess their own level of learning but that I can get a good picture of how well students are progressing – both individually and as a whole. Fortunately, WebCT has build capabilities into the system to enable me to review student performance in Assessment Manager. I can view student’s responses individually or as a group, and I can track performance across all students for a single question fairly easily. I can also review reports that give me a visual snapshot of student performance. All of these can be used to refocus teaching to compensate for any systemic deficiencies, or provide personal and more extensive feedback on an individual basis where students may require.

A few final notes: I set up the quiz to deliver questions one at a time so that students can focus on each question individually. Timing is set up to encourage some level of pre-knowledge of the subject matter before taking the quiz. Unlimited attempts are allowed, and the final grade is an average of all attempts, because I do not want to penalize poor test takers. And finally, both the student score and statistics are released so that students can self-assess their performance.

References:

Gibbs, G., & Simpson, C. (2005). Conditions under which assessment supports students’ learning. Retrieved June 23, 2009, from The Open University: http://www.open.ac.uk/fast/pdfs/Gibbs%20and%20Simpson%202004-05.pdf

Intel Learning Series Alliance Summit

For the past three days I’ve been in Cairo, Egypt, at the Intel Learning Series Alliance Summit.

The summit is a forum for Intel to bring together an entire ecosystem of companies providing pieces of the solution pie for its education initiatives. Those revolve primarily but not exclusively around the Classmate PC, a purpose-built hardware platform for education.

The ecosystem includes a wide range of companies:

  • local OEMs (tech industry jargon for original equipment manufacturers) from many of the EMEA (Europe, Middle East, and Africa) countries
  • ODMs (original design manufacturers: companies that create hardware specifications or recipes for the OEMs to follow)
  • Education service providers (companies that present a unified and more or less complete solution to a local education agency in the form of hardware, software, and services that they usually aggregate from multiple providers)
  • Software companies with education-specific solutions (and a few here that have generic solutions they are applying to the education world)
  • Intel personnel from around the world

It’s been an amazing conference, not least because of the chance to see the pyramids or because I had the opportunity to address the entire group on the first day … but also to see the immense range of companies and individuals who are part of providing educational technology solutions.

I think it’s a part of the educational technology spectrum that many educators have only a shadowy knowledge of. There are huge product, implementation, and support needs for any significant school technology effort, and most of these are multi-national and complex project-based collaborations and partnerships between easily 10 or 15 companies.

To simplify the world a little for educators, Intel is promoting the idea of the ESP: Educational Service Provider. This company brings together many custom components of a solution for a school, district, or educational region, after consulting with the school to understand their needs. After meeting with a number of these, it’s clear there’s a lot of expertise here!

It’s gratifying to see the effort that Intel has put into ensuring a secure pedagogical foundation for their products, training, and implementation resources. They’ve also spent heavily on ethnography to understand local needs in regions all over the world. And some members of their teams, like Sabine Huber in Intel Germany, have advanced degrees in educational technology (Huber’s is in 1:1 computing).

Much more going on here … too much to say! Hopefully I’ll have more chance to blog it on the flight home.

Twittpedia

This is a cross-post from the course discussion forum. For the past couple of days I’ve been reflecting on what the below experiences of learning signify for the larger context of K12 educational technology.

Anderson talks about learning being learner-, knowledge-, assessment- and community-centred.

The most learner-centered environments I’ve experienced have at one and the same time been the most solipsistic (or at least solitary), and the most social environments. They’ve both been within the wild, undisciplined, unplanned, decentralized, haphazard environment of the web itself.

Besides my MET courses, one of my primary learning experiences is just-in-time learning for just about anything, online. Wikipedia, online forums, help sites, you name it: they all have a place in learning. This is intensely self-directed, intensely focused, and requires strong information searching, retrieval, and processing skills. This is learner-centred, but it’s also knowledge-centred. Assessment is binary: did I find the information I needed to solve my problem. Community is involved, but only in the abstract sense that those who care to share their knowledge online build the overall repository that all of us can then access.

But another of my primary learning experiences is Twitter … connecting with smart, creative people who see and share interesting facts, theories, experiences, and resources. This is intensely social, usually very undirected and unfocused (unless you search or ask questions), and requires an ability to ignore irrelevancies and treat knowledge as a stream into which you will dip the occasional toe rather than a body of work that must be surveyed and mapped and conquered. This is a very community-centred learning.

Twitter and other social networking tools like it are potentially prototypes of learning sites that school districts and regions could create (easy to do with open source components) that would allow everyone in a school environment with expertise in anything share it with others – and benefit from others’ knowledge … all in real-time or near real time. It makes me wonder about a potential marriage of a Twitter with a Wikipedia … the ephemera of what knowledge individuals need now coupled with the relative longevity of increasingly accurate and better units of knowledge.

In fact, now that I think about it … I’m tempted to try to build such an animal!

Anderson, T. (2008). Towards a theory of online learning. In T. Anderson & F. Elloumi, Theory and Practice of Online Learning. Athabasca University Press. Accessed June 11, 2009, from http://www.aupress.ca/books/120146/ebook/02_Anderson_2008_Anderson-Online_Learning.pdf