As many of you will know, the 11th International Learning Analytics and Knowledge Conference was held last week. So, this week at LAVA we’ll have an informal meet up and share highlights from the conference. If you attended LAK, it would be great if you could come prepared to discuss what you felt were highlights from the conference with the group (links, papers, insights, etc.)
Category: Uncategorized
Panopto Video Analytics – Marko Prodanovic (Mar 31, 2021)
Marko Prodanovic from Sauder Learning Services will be presenting their work on accessing and making use of Panopto video data.
Over the past year we’ve seen a sharp increase in teaching and learning happening through asynchronous video lectures. This also means a lot of new data!
In this session, Marko will show some of the work he’s done in developing a Python tool for fetching and managing viewing data from the Panopto video platform. We’ll look at the means by which data is being accessed (through various APIs), the transformations we perform and the reasoning behind them. We’ll also walk through a set of video analytics dashboards, built in Tableau that utilizes this data. As this project is ongoing, the last 15 minutes of the session will be dedicated to feedback, suggestions and discussion around the broader applications of this kind of viewing data.
Learning Analytics Instrumentation – Jeff Longland (Mar 10, 2021)
Continuing the theme of learning analytics instrumentation, Jeff Longland will provide an update on UBC’s work towards a data system for learning events. We’ll look at how learning tools can be instrumented to emit structured events, how events are ingested and stored, then finally how they can be accessed. A live demonstration will be attempted, so even if the topic isn’t of particular interest, it might be worthwhile for the humour alone!
Learn more about UBC Learning Analytics: https://learninganalytics.ubc.ca/
Learning Analytics Instrumentation – Dr. Christopher Brooks (Feb 10, 2021)
Our first LAVA meeting of the year will take place on Wednesday Feb. 10th at 11am-12pm PST, and will be led by Dr. Christopher Brooks.
From Dr. Brooks:
Abstract: As a field at the intersection of social and data sciences there is a strong need for quality instrumentation of teaching and learning. Yet, much of the work done in the field of Learning Analytics to date has not considered instrumentation directly, and instead has been built upon data which is the byproduct of learner activities, sometimes even pejoratively referred to as “data exhaust”. In this talk I will describe both a need for and an agenda toward exploring learning analytics instrumentation directly, where the creation, employ, and improvement of data collection instruments are of central interest. I will discuss methodological, architectural, and pragmatic considerations when it comes to the instrumentation of learning analytics systems, and give specific thoughts on the need to understand and improve upon instrumentation choices when making theoretical and methodological decisions.
Bio: Christopher Brooks is an applied Computer Scientist who builds and studies the effects of educational technologies in higher education and informal learning environments. Dr. Brooks has a particular domain focus on data science education and methodological interests in predictive modelling, learning analytics, and collaborative learning. He has published widely in the areas of educational technologies and human computer interaction, and has been awarded several best papers (LAK, AIED, CHI, CSCW) with collaborators. At the University of Michigan School of Information he directs the activities of the educational technology collective (etc), a group of postdoctoral scholars, graduate students, undergraduate students, and other collaborators.
This presentation will take place on Zoom. If you would like to attend but are not part of the LAVA emailing list, please contact Alison Myers (alison.myers@sauder.ubc.ca) for information.
Representation of a Community of Inquiry in Cooperative Online-based Courses through Learning Analytics – UMIT in Austria (Nov 25, 2020)
We’ll be having an off-cycle LAVA meeting today, November 25th, at 11:30am, where we will have presenters join us from UMIT in Austria!
Elske Ammenwerth, Eva Kaczko, Verena Dornauer, and Lisa-Maria Norz, members of LACOI: Representation of a Community of Inquiry in Cooperative Online-based Courses through Learning Analytics will join us to share their work and to learn about the LAVA community. We will learn about the ongoing Learning Analytics Community of Inquiry project and some details about specific research avenues of that project including: regulation of learning in CoI (Community of Inquiry), Cognitive presence – toward automatic measurement, and Social presence – toward automatic measurement by social network analysis. Following an initial presentation and discussion from LACOI, members from LAVA will also share some of their work and projects.
Some more information about LACOI, from the project website: https://iig.umit-tirol.at/index.php/en/projects/24-ongoing-projects/263-2020-2023-lacoi-representation-of-a-community-of-inquiry-in-cooperative-online-based-courses-through-learning-analytics
Wider research context: From a socio-constructivist point of view, learning requires activity, self-regulation, and cooperation among students. Online-based learning environments in higher education offer great flexibility to students, but are challenging in fostering such cooperative learning. The Community of Inquiry (CoI) is an established and effective framework on fostering effective cooperative learning in virtual learning environments. Learning Analytics provides approaches to measure the CoI. However, an automated analysis and visualization approach of the CoI is still lacking which prevents real-time monitoring of courses. In addition, it is unclear which actionable advice can be derived from CoI analysis to directly improve teaching and learning. Our idea is to build CoI dashboards using learning analytics. We will then evaluate whether this has an impact on teaching, learning process, or learning outcome.
Research questions:
- Is it possible to develop a comprehensive, automated representation and visualization of the Community of Inquiry (CoI) and its three dimensions for individual online-based courses by combining and extending approaches from learning analytics?
- Does the visualization of the CoI in a teacher dashboard, combined with actionable advice, has any impact on teaching?
- Does the visualization of the CoI in a student dashboard, combined with actionable advice, has any impact on student self-regulation, learning process, or learning outcome?
If you’d like to attend future meetings, be added to the email list, or would like to present to the LAVA group, please contact Alison (alison.myers@sauder.ubc.ca).
Basics of Tableau – Alison Myers (Oct 14, 2020)
From Alison:
I will very briefly go over the basics of Tableau, but will spend most of the time talking about some of the new features of Tableau 2020.3 (ahem, dynamic parameters), as well as some good old Tableau tips and tricks that I use. If there is anything you are curious about or would like me to cover either you can let me know in advance or I can try to answer during the session.
The final 20 minutes will be saved for Q/A, open discussion and sharing Tableau tips/tricks
Other Resources
We walked through this LAVA Demonstration workbook: https://public.tableau.com/profile/alison.myers3113#!/vizhome/LAVADemoWorkbook2020-10-14/StudentInfo
This is a great workbook to pick apart to understand more options for how to work with set and parameter actions! https://public.tableau.com/en-gb/profile/andy.kriebel#!/vizhome/SetParameterActionsCatalog/ColoringBetweenTwoDateswithSetAction
Canvas Student Timezones – Craig Thompson (Aug 19, 2020)
Our LAVA meeting this week (Wednesday August 19, 3-4pm PT, on Zoom) will be lead by Craig Thompson from the UBC Learning Analytics Project.
At this session, Craig will present on the newly developed Student Time Zones tool:
From Craig: This is a new LTI tool, developed by Andrew Gardener and Justin Lee, to give instructors an early insight into students’ scheduling availability this fall. We’ll briefly walk through the tool, and then open the floor for comments, suggestions, and discussion.
—
If you would like to attend but are not part of the LAVA emailing list, please contact Alison Myers (alison.myers@sauder.ubc.a) for the Zoom information. You can also request that Alison add you to the LAVA mailing list, where we share information about upcoming LAVA sessions.
Reflective Writing Analytics – Dr. Andrew Gibson (Aug 5, 2020)
Our LAVA meeting next week (Wednesday August 5, 3-4:30pm PT, on Zoom) will be led by Dr. Andrew Gibson from Queensland University of Technology.
Presentation description (originally posted here):
Andrew Gibson from Queensland University of Technology (QUT) will outline recent research work that uses Reflective Writing Analytics (RWA) to help gain insights into pre-service teachers capacities with respect to assessment. The research involves capturing regular personal reflections from pre-service teachers over a period of time using web-based software called GoingOK. These reflections are analysed using natural language processing technologies, in a socio-technical pragmatic approach where socio-cultural interpretive research informs the development of the analysis, and iterations of analytics inform the emergence of the interpretation. Andrew will provide examples of the RWA and present a case for using similar approaches in other learning analytics research.
—
If you would like to attend but are not part of the LAVA emailing list, please contact Alison Myers (alison.myers@sauder.ubc.a) for the Zoom information. You can also request that Alison add you to the LAVA mailing list, where we share information about upcoming LAVA sessions.
Introduction to Dash and DashR – Firas Moosvi (Jul 8, 2020)
Our LAVA meeting this week (Wednesday July 8, 3pm PT) was led by Firas Moosvi. Firas presented on Dash, its features, and how to get an app up and running.
Links below:
—
If you would like to attend future LAVA sessions but are not part of the emailing list, please contact Alison Myers (alison.myers@sauder.ubc.a) for the Zoom information. You can also request that Alison add you to the LAVA mailing list, where we share information about upcoming LAVA sessions.
Wednesday June 24: Difficulty and Gender Analysis of Course Grades: A Dashboard -Gabriel Smith and Warren Code
Our LAVA meeting this week (Wednesday June 24, 3pm PT, on Zoom) will be led by Gabriel Smith and Warren Code from the Faculty of Science. They will be presenting “Difficulty and Gender Analysis of Course Grades: A Dashboard”
From Gabriel and Warren:
Inspired by the work of the SEISMIC group (https://sites.google.com/umich.edu/SEISMIC/working-groups/key-projects) on demographic effects in introductory STEM courses, we have developed a dashboard (in R Shiny) to explore course performance in introductory courses in the Faculty of Science relative to grade averages over other courses taken, both in general for a course to give a sense of the relative “difficulty” of a course, and also with respect to the gender of the students. With data drawn from 1st and 2nd year Science courses across a sample of recent years, we will provide a live demonstration of our dashboard (with obfuscated course names) which has a “macro” level to show patterns in disciplines or types (lecture vs. lab) of courses and a “micro” level to drill down into one chosen course at a time. We will discuss our choices in visualization and modelling in adapting the approach of the SEISMIC group, and offer a brief overview of trends we have observed so far.
—
If you would like to attend but are not part of the LAVA emailing list, please contact Alison Myers (alison.myers@sauder.ubc.a) for the Zoom information. You can also request that Alison add you to the LAVA mailing list, where we share information about upcoming LAVA sessions.