Providing Actionable Information for Students – Dr. Fatemeh Salehian (Aug 4, 2022)

In our August 4th LAVA meeting, we will be hearing from Dr. Fatemeh Salehian. Fatemeh is a postdoctoral research fellow in the School of Information at UBC. She is currently affiliated to the University of Michigan, Ann Arbor, and the University of South Australia. She has been working on learning analytics projects for over seven years. Her research focuses on understanding how learners self-regulate their learning processes and how learning analytics can help to support self-regulated learning since it is critically associated with students’ performance and learning outcomes. Her research focuses on using data to study learners’ behaviors in online learning environments to develop indicators of learning behavior.

From Fatemeh:

I will talk about two projects focusing on providing actionable information for students. 

 First is the OnTask platform which offers an intuitive interface to upload data about student engagement into a matrix and the definition of a set of simple when/do rules to customize email messages for the students. Instructors use the indicators about student engagement to select/ignore text portions that are then collated and sent to the students as regular email messages. These messages provide students with personalized support and suggestions to improve their engagement. In our recent analysis, the results showed that there is a significant association between the messages’ topics and the students’ performance. 

 Second, My Learning Analytics (MyLA) is a student-facing dashboard that provides students with information about their engagement with course materials and resources, assignments, and grades in a Canvas course. A set of three learning analytics data visualizations have been designed to reveal behavioral patterns associated with good learning skills, guide decisions about actions students can take that may improve their academic outcomes, and provide a transparent view of students’ course standing.

Teamable Analytics: A Team Formation and Analytics Tool – Dr. Bowen Hui (May 5, 2022)

This week we will be hearing from Dr. Bowen Hui. Dr. Hui is Associate Professor of Teaching & Associate Head of Undergraduate Affairs (CMPS) in the Computer Science program at UBCO.

From Bowen:

Teamable Analytics: A Team Formation and Analytics Tool

Forming effective teams for large classes is a challenge for educators due to the complexity of project needs, the diversity of individual characteristics, and the criteria different educators have for forming teams. Although many researchers over the past several decades studied the success factors of a team, there is still little consensus on how a team should ideally be formed. Consequently, how one decides to form teams in a class depends on the domain, classroom context, and pedagogical objectives.

In this demo, we present a web application that offers several algorithms to support the team formation process called Teamable Analytics. Teamable Analytics is compatible with any learning management system (LMS) that uses the LTI protocol. Our tool provides a dashboard for educators to elicit student characteristics and customize how those responses are combined to form teams. In contrast to existing team formation software, our tool supports more use cases for building teams, it provides a general end-to-end solution to the team formation process, it is integrated with the LMS so to minimize data setup and privacy risks, and it makes use of visual analytics to diagnose problematic formations, increase user trust, and monitor ongoing team performance.

To date, our team has integrated Teamable Analytics with the Canvas LMS and completed 7 pilot studies with interdisciplinary classes consisting of 15 to 210 students across both UBC campuses. We are currently seeking collaborators to further the research and development in the visual analytics component of the project.

Student Flows Project – Annay Slabikowska & Craig Thompson (Apr 7, 2022)

This week’s LAVA session [Thursday April 7, 2-3pm, Zoom] will be led by Annay Slabikowska (PAIR) and Craig Thompson (CTLT), who will present recent work on the Student Flows Project.

From Annay and Craig:

The project is collaboration between the Learning Analytics and Planning and Institutional Research teams and the Faculty of Science, including contributions from analysts in the Faculty of Arts and the Sauder School of Business.

The goals of the Student Flows Project are threefold: to create a shared common data set that can be used by analysts across the institution to explore student flow scenarios, to develop visualizations of student flows and to recommend tools to visually analyze student flows, and to collaboratively document and share best practices for exploring student flow scenarios.

By “Student Flows” we mean student progression through courses, specializations, and degree programs during their time at UBC. This can include analysis of time to degree completion, identifying common patterns of switching between faculties or majors, investigation of common course co-enrolment or sequencing, and more. In addition to these enrolment-based data elements, we are also interested in student characteristics, and how they relate to enrolments. For example, we need to be able to explore whether there are differential course or program outcomes for various student cohorts, such as international students, mature students, or indigenous students, as well as temporal cohorts.

From our initial exploration of this space, it became clear that there was not a one-size-fits-all solution to data analysis and reporting regarding student flows. For example, the level of detail needed varies by audience: one Dean may be interested in understanding how students flow into and out of their Faculty, whereas a department head may be interested in how students choose to sequence courses within their major. Additionally, at any given level of detail, different stakeholders will have different needs terms of what information they want to see, and how they would like it to be presented. Thus, we have endeavored to create a framework (dataset, documentation, and established best practices) that will enable a distributed team of analysts to undertake work in this space, to more easily collaborate and share, and to answer the plethora of questions raised by various institutional stakeholders.

We draw inspiration from other universities such as University of Michigan, which is an early leader in establishing a common data set for institutional researchers, and numerous institutions exploring visualization techniques for student flows such as UC Davis, University at Buffalo, and University of New Mexico.

You can view their presentation here:

Tableau Tutorial – Alison Myers (Feb 3, 2022)

For our first LAVA meeting this year (Feb 3, 2-3pm) Alison Myers (me!) will be doing an introduction to Tableau, with a short demonstration of some of the dashboards that Sauder Learning Services has developed over the past few years (many of you will likely have seen these dashboards in some form from past sessions).

From Alison:

This will be a speed run through of Tableau to introduce basic concepts, while briefly touching on some more intermediate functionality. If you are unfamiliar with Tableau – this will likely be “too fast” – but will hopefully give you a sense of the possibilities. If you are familiar with Tableau, then hopefully I might introduce a tip or trick you haven’t seen. If anyone has anything specific that they would like demonstrated or discussed – please feel free to reach out and let me know ahead of the session.

Tableau Desktop is available for a two week free trial for anyone, and available for free for a year at a time for students and faculty : https://www.tableau.com/trial/tableau-software.

Reframing Student Evaluation of Teaching (SEoT) -Dr. Julie Wei (Jul 7, 2021)

Join us on Wednesday July 07th at 3pm-4pm PST for our next LAVA session held by Dr. Julie Wei form the Faculty of Arts.

Reframing Student Evaluation of Teaching (SEoT): Using Student Comments to Unlock Hidden Themes

From Julie:

Student evaluation of teaching (SEoT) has been implemented for decades by many universities including UBC. This has created and is still creating huge amount of student feedback comments that pour in course and teaching evaluation survey, however this type of data has not been used widely, probably because it is time-consuming to review the unstructured data. In this presentation, Dr. Julie Wei will share a project she initiated and led at the Faculty of Arts by employing both students’ original comments and the explicit suggestions automatically extracted from them by using Natural Language Processing (NLP) approach. This could quickly provide instructors and decision-makers with useful information that could help further identify the areas that need to improve and thus help promote quality teaching and student success in the long run.

These sessions are being held via Zoom. To attend this session, or to be added to our mailing list to receive information about future sessions, please contact Alison Myers (alison.myers@sauder.ubc.ca).

Panopto Video Analytics – Marko Prodanovic (Mar 31, 2021)

Marko Prodanovic from Sauder Learning Services will be presenting their work on accessing and making use of Panopto video data.

Over the past year we’ve seen a sharp increase in teaching and learning happening through asynchronous video lectures. This also means a lot of new data!

In this session, Marko will show some of the work he’s done in developing a Python tool for fetching and managing viewing data from the Panopto video platform. We’ll look at the means by which data is being accessed (through various APIs), the transformations we perform and the reasoning behind them. We’ll also walk through a set of video analytics dashboards, built in Tableau that utilizes this data. As this project is ongoing, the last 15 minutes of the session will be dedicated to feedback, suggestions and discussion around the broader applications of this kind of viewing data.

Learning Analytics Instrumentation – Jeff Longland (Mar 10, 2021)

Continuing the theme of learning analytics instrumentation, Jeff Longland will provide an update on UBC’s work towards a data system for learning events. We’ll look at how learning tools can be instrumented to emit structured events, how events are ingested and stored, then finally how they can be accessed. A live demonstration will be attempted, so even if the topic isn’t of particular interest, it might be worthwhile for the humour alone!

Learn more about UBC Learning Analytics: https://learninganalytics.ubc.ca/

Learning Analytics Instrumentation – Dr. Christopher Brooks (Feb 10, 2021)

Our first LAVA meeting of the year will take place on Wednesday Feb. 10th at 11am-12pm PST, and will be led by Dr. Christopher Brooks.

From Dr. Brooks:

Abstract: As a field at the intersection of social and data sciences there is a strong need for quality instrumentation of teaching and learning. Yet, much of the work done in the field of Learning Analytics to date has not considered instrumentation directly, and instead has been built upon data which is the byproduct of learner activities, sometimes even pejoratively referred to as “data exhaust”. In this talk I will describe both a need for and an agenda toward exploring learning analytics instrumentation directly, where the creation, employ, and improvement of data collection instruments are of central interest. I will discuss methodological, architectural, and pragmatic considerations when it comes to the instrumentation of learning analytics systems, and give specific thoughts on the need to understand and improve upon instrumentation choices when making theoretical and methodological decisions.

Bio: Christopher Brooks is an applied Computer Scientist who builds and studies the effects of educational technologies in higher education and informal learning environments. Dr. Brooks has a particular domain focus on data science education and methodological interests in predictive modelling, learning analytics, and collaborative learning. He has published widely in the areas of educational technologies and human computer interaction, and has been awarded several best papers (LAK, AIED, CHI, CSCW) with collaborators. At the University of Michigan School of Information he directs the activities of the educational technology collective (etc), a group of postdoctoral scholars, graduate students, undergraduate students, and other collaborators.


This presentation will take place on Zoom. If you would like to attend but are not part of the LAVA emailing list, please contact Alison Myers (alison.myers@sauder.ubc.ca) for information.

Representation of a Community of Inquiry in Cooperative Online-based Courses through Learning Analytics – UMIT in Austria (Nov 25, 2020)

We’ll be having an off-cycle LAVA meeting today, November 25th, at 11:30am, where we will have presenters join us from UMIT in Austria!

Elske Ammenwerth, Eva Kaczko, Verena Dornauer, and Lisa-Maria Norz, members of LACOI: Representation of a Community of Inquiry in Cooperative Online-based Courses through Learning Analytics will join us to share their work and to learn about the LAVA community. We will learn about the ongoing Learning Analytics Community of Inquiry project and some details about specific research avenues of that project including: regulation of learning in CoI (Community of Inquiry), Cognitive presence – toward automatic measurement, and Social presence – toward automatic measurement by social network analysis. Following an initial presentation and discussion from LACOI, members from LAVA will also share some of their work and projects.

Some more information about LACOI, from the project website: https://iig.umit-tirol.at/index.php/en/projects/24-ongoing-projects/263-2020-2023-lacoi-representation-of-a-community-of-inquiry-in-cooperative-online-based-courses-through-learning-analytics

Wider research context: From a socio-constructivist point of view, learning requires activity, self-regulation, and cooperation among students. Online-based learning environments in higher education offer great flexibility to students, but are challenging in fostering such cooperative learning. The Community of Inquiry (CoI) is an established and effective framework on fostering effective cooperative learning in virtual learning environments. Learning Analytics provides approaches to measure the CoI. However, an automated analysis and visualization approach of the CoI is still lacking which prevents real-time monitoring of courses. In addition, it is unclear which actionable advice can be derived from CoI analysis to directly improve teaching and learning. Our idea is to build CoI dashboards using learning analytics. We will then evaluate whether this has an impact on teaching, learning process, or learning outcome.

Research questions:

  1. Is it possible to develop a comprehensive, automated representation and visualization of the Community of Inquiry (CoI) and its three dimensions for individual online-based courses by combining and extending approaches from learning analytics?
  2. Does the visualization of the CoI in a teacher dashboard, combined with actionable advice, has any impact on teaching?
  3. Does the visualization of the CoI in a student dashboard, combined with actionable advice, has any impact on student self-regulation, learning process, or learning outcome?

If you’d like to attend future meetings, be added to the email list, or would like to present to the LAVA group, please contact Alison (alison.myers@sauder.ubc.ca).

Spam prevention powered by Akismet