Presentation at ETUG: Co-creating XR Application for Education

What is ETUG?

Educational Technology Users Group (ETUG) is a community of BC post-secondary educators focused on the ways in which learning and teaching can be enhanced through technology.

What is this presentation about? 

In the ETUG Fall 2018 Workshop, I proposed to present. And here is the abstract:

Most educators get to access AR/VR/MR applications when they are well-developed and ready to use, but they are missing in the design and development process. To most people, the design and development process remains mysterious, but educators need to be involved in the process and become co-creators. Sharing the process and challenges will be an important first step.

What was presented?

Developing HoloLens Application for Aircraft Maintenance Engineers

Just in case you don’t know, our project is basically to translate an existing desktop Helicopter Rotor Head application into Microsoft Hololens application. In addition, we are adding voice control and multiple user network.

(Image Credit: John Bondoc, UX Designer)

Sounds interesting? It’s actually quite scary because none of our team members had experience developing HoloLens application previously. So we learn as we do it.

We just finished Sprint #6 and entered into Sprint #7.

(Credit: Junsong Zhang, Project Manager)

In Sprint #5, we created a prototype based on the concept art below and started adding voice control into the application. The main changes were: 1) we added a voice control command board, and 2) the controls were moved below the rotor.

(Image Credit: John Bondoc, UX/UI Designer)

However, in Sprint #6, we tested the prototype and found that the main problems are

  • Difficulties with collective/cyclic controls.
  • Difficulties to see the effects such as airflow & swashplate movement.
  • Difficulties in looking at the rotor while moving the cyclic/collective controls.
  • Slow response with voice control.
  • Confusion about voice control menu.
  • Insensitivity of voice control in noisy environment.
  • There are no indications when “make bigger/smaller” voice controls hit the limits.
  • Not enough training/instructions with regard to how to use HoloLens.
  • Users tend to take it as a 2D object instead of 3D.

Considering scope, we decided to work on the ones that are critical to the functionality of this application:

  • Improve cyclic function
  • Resize/reposition cyclic & collective controls
  • Resize the whole field of view so users don’t need to move their heads too much at the beginning.
  • Change how the model scale up and down: keep the rotor in the background while it grows bigger or smaller instead of jumping to the front.
  • Redesign the voice control menu: instead of a command board, the new voice control menu will be interactions that give users instructions when they gaze/hover over the buttons.

(Credit: the entire team)

Based on that, we came up with a new sketch that reflects that our new interface and interaction. The main changes are the positioning of controls and voice control menu, as well as how the interactions work. We’ll have to prototype and test it. 

(Image Credit: John Bondoc, UX Designer)

From this week on, we will spend more time developing a multiple user network. The idea is to enable instructors to broadcast their views and modifications in the application to students in real-time.

Why retrospective is so important in Agile project management? Example From My Project Team

If you ask me what are the most important things I learned from this whole Agile project management method, I would say it is probably how it helps my project teams to build a shared culture that allows everyone to provide critical feedback and solve problems in a safe and creative environment through sprint planning, sprint review, stand up and particularly retrospective.

No matter what team you are in, there will always be different personalities, different backgrounds and different approaches to get things done. On one hand, diversity lays a good foundation for creativity. On the other hand, it means potential conflicts and misunderstanding.

What Agile method provides is a systematic but nimble approach to align team members and resolve conflicts together. It is safe, transparent, and therefore everyone in the team is productive.

Here is an example of retrospective with my team.

In case you are not familiar with these symbols, the plus symbol means things we did well; the triangle symbol means what we need to improve; and the light bulb symbol means suggestions for improvement.You might wonder why we had so many items under “△”. On one hand, it was because we had accomplished more that week. But more importantly, it was because our team ignored the importance of retrospective in previous weeks, leaving some important issues unattended.

The fact is not everyone in my team values retrospective the same way, particularly when the team is seemingly doing a good job. There were times when retrospective was almost omitted and I had to explain why we still need retrospective. One reason is that it could be a perfect opportunity to recognize the great work the team has accomplished, if the team is indeed doing a wonderful job. But the truth is that there are always some feelings or misunderstanding that need to be addressed, and I am a big believer in creating space for every team member to speak out.

Sensing that we need a proper retrospective, I asked everyone to write down their thoughts silently on post-its in 5 mins, and then stick them on the wall when they finished writing.

The next step is simple: team members took turns to explain their post-its and occasionally we had small conversations about certain issues. I tend to let conversations flow as long as it is reasonable and relevant, and then find the right time to lead to the next topic or the next person.

Facilitating team retrospective is not just about taking a mark pen in team meetings and telling the team to have a retrospective. It’s more about observing and seeing where potential problems are, and finding the right time and place to speak about it even before the meetings. But having a formal process in which everyone is encouraged to speak up is extremely valuable.

So here are the themes of issues we had, and the circled one was identified as the most important issue we committed to improve.

Now we have an extra thing to do in the next retrospective: reviewing the commitments we made.