{"id":6200,"date":"2021-04-04T16:55:52","date_gmt":"2021-04-04T23:55:52","guid":{"rendered":"https:\/\/blogs.ubc.ca\/etec523\/?p=6200"},"modified":"2021-04-04T17:06:39","modified_gmt":"2021-04-05T00:06:39","slug":"a3-holobar-the-next-step-in-ar","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/etec523\/2021\/04\/04\/a3-holobar-the-next-step-in-ar\/","title":{"rendered":"A3 &#8211; HoloBar: the Next Step in AR"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Hi everyone, welcome to my A3 contribution. When doing research for this course I encountered a lot of Augmented Reality content, and even worked on a Moveable Feast for it. One thing that I noticed is that to experience AR\/VR\/MR there is always a device between the user and the experience. I created a short journey, a fictitious piece of hardware that does not get between the user and the experience. Below is a video blog, and below that, a transcript of the video with images. Enjoy!<br><br>&#8211; Mark Pepe<br><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-embed-handler wp-block-embed-embed-handler wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"HoloBar: the Next Step in AR\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/YnauLPgvc_I?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p class=\"has-large-font-size wp-block-paragraph\"><br>Transcript<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hi, my name is Mark Pepe, I\u2019m currently a K to 7 Music teacher with Catholic Independent Schools of the Vancouver Archdiocese. I teach general music as well as concerts bands, jazz bands, and choir. I also teach French for grades 5 6 and 7. I am a classically trained operatic tenor, I sing with the Vancouver Opera Chorus, and have performed across Canada, and in Italy. I have Bachelor of Music in Opera Performance and Music Education, Bachelor of Education in Secondary Music, and I am currently a graduate student in the Master of Education Technology program. All at the University of British Columbia.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I\u2019d like to discuss a fictional solution to a problem with augmented reality: hardware, I like to call it the middle man. The hardware between the user and the piece, or overlay, that augments our reality. When we interact with augmented, virtual, and mixed realities we are always looking through a device. This could be pointing a phone at an object, at a piece of art, or scanning a QR code and then we experience this digital phenomenon through the small screen. Or we wear goggles, or glasses, that project an overlay on the lens to our physical world.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Having a little fun here, and thinking about the future, I present the HoloBar. Imagine a device, that looks like the sound bars that give us high quality sound for our entertainment systems, except it projects a three dimensional hologram. The HoloBar gives an unencumbered augmented reality experience by taking away the middle man. The HoloBar could be mounted on the wall, ceiling, or on the ground, because it can be portable.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-1024x749.jpg\" alt=\"\" class=\"wp-image-6203\" width=\"512\" height=\"375\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-1024x749.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-300x220.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-768x562.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-1536x1124.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-diagram-2048x1499.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The HoloBar would use spatial mapping to mesh the real world environment with holographic objects, or even beings (Mahroo, Greci, &amp; Sacco, 2019). That means HoloBar can scan the environment that it\u2019s in to project the hologram to scale.<br><br>HoloBar can project a hologram of your favourite artist that will perform your favourite music in your own home. In this sketch, I have a hologram of Maria Callas singing some Puccini. The HoloBar will bring together a high quality three dimensional visual with high quality sound of one\u2019s home audio system. It could be your living room, dining room, kitchen, even outdoors on the patio.<br><br>It doesn\u2019t have to be a musical performance. It could be a piece of classical theatre, like Shakespeare, a comedian doing stand-up comedy, a lecture by your favourite thinker. It could even be an object to display, like a Faberg\u00e9 Egg, a Rodin sculpture, maybe even Leonardo Da Vinci\u2019s Flying Machine.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-1024x835.jpg\" alt=\"\" class=\"wp-image-6204\" width=\"512\" height=\"418\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-1024x835.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-300x245.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-768x626.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-1536x1253.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-callas-2048x1671.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">This is also an opportunity for artists to create a holographic NFT, non-fungible token. Digital arts are currently contributing most of the current growth in the NFT market (OVR.ai, 2021). Maybe, for a very hefty price, John Legend can give you a private concert, and after the performance it becomes your very own personalized NFT. Since NFT trading cards&nbsp; are trending, it can even be a life size hologram of the soccer player Cristiano Ronaldo celebrating a goal.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There is also a social aspect to this. You can converse with your friends, even watch that John Legend performance with your friends in the comfort of your living rooms. During last year\u2019s CES convention will.i.am was interviewed and was asked what the future of music was, and he said VR. But the one problem was the social aspect, and the sound quality. People enjoy going to concerts for the social aspect; seeing their favourite artist with their friends. They don\u2019t go for the sound quality because it\u2019s loud and is all bass (CES, 2021).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-1024x779.jpg\" alt=\"\" class=\"wp-image-6205\" width=\"512\" height=\"390\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-1024x779.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-300x228.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-768x584.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-1536x1169.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guest-2048x1558.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">But how would this apply to education?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Drawing from my own experience here. I still study singing privately and my teachers are based in Niagara Falls, Ontario, while I\u2019m in Vancouver. We\u2019ve been doing singing lessons over FaceTime for the past six years. It works really well, but one thing that is missing is not being able to see what my body does while singing. For example, through FaceTime it\u2019s very hard to see what my diaphragm is doing. It wasn\u2019t until we were in studying together in Italy when she said, \u201cI can finally see that you\u2019re not breathing low enough.\u201d With HoloBar, my teacher would be right there with me seeing what my body is doing while I sing a challenging musical passage.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-1024x776.jpg\" alt=\"\" class=\"wp-image-6206\" width=\"512\" height=\"388\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-1024x776.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-300x227.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-768x582.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-1536x1165.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-guitar-lesson-2048x1553.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">In this sketch, I have a guitar teacher giving a private lesson to a young student. The hologram would be of high enough quality that the teacher and student can clearly see what each other is doing. The student here would be able to get a good look at fingerings for various chord voicings, technique for right hand finger picking, and any other technical and musical nuances.<br><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-1024x821.jpg\" alt=\"\" class=\"wp-image-6207\" width=\"512\" height=\"411\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-1024x821.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-300x241.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-768x616.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-1536x1232.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-classroom-2048x1642.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">In this sketch, I have what could be a classroom where a teacher, and two students are collaborating on a problem. With the HoloBar, they would be able to have a holographic three dimensional model that would help them solve their problem. A student of architecture can view files from Three dimensional modelling programs such as Revit to help with iterations of their design. Graphs from an Excel spreadsheet can also be displayed to view regressions, and other types of data. This would allow for different&nbsp; types of learning in many subject areas.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We know that AR can, and has been used, to train nurses and doctors, trades people, and scientists in the laboratory. Objects can be seen rather than having to wear cumbersome goggles and glasses. Imagine a mechanic in training, to practice working on the engine of a rare sports car they would be able to use HoloBar to get familiar with the parts and the design (Mahroo, Greci, &amp; Sacco, 2019).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-1024x745.jpg\" alt=\"\" class=\"wp-image-6208\" width=\"512\" height=\"373\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-1024x745.jpg 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-300x218.jpg 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-768x559.jpg 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-1536x1118.jpg 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/holobar-child-2048x1490.jpg 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">In elementary school, HoloBar can bring the museum to the school, by displaying objects otherwise unavailable for a closer look. In this diagram, a child can be seen looking at a three dimensional cube, why, because of my poor drawing skills. I wish it was a dinosaur instead. Children are curious and want to learn. They could look at dinosaur bones, their favourite animal, or even Disney characters.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Where are we currently for a technology like this?<br><br>Well, they\u2019re already on their way. Scientists from the Interact Lab at the University of Sussex have designed what they call a Multimodal Acoustic Trap Display, MATD. Essentially, it\u2019s a small box with small speaker array on the top and bottom, an LED light, and 2mm in diameter bead. Sound waves from the array keep the bead afloat and moving while the LED lights the bead. Since there\u2019s a speaker array, sound can be incorporated, and those same sound waves can also provide some tactile feed back. This is just but one of many examples.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-1024x532.png\" alt=\"\" class=\"wp-image-6209\" width=\"512\" height=\"266\" srcset=\"https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-1024x532.png 1024w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-300x156.png 300w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-768x399.png 768w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-1536x798.png 1536w, https:\/\/blogs.ubc.ca\/etec523\/files\/2021\/04\/matd-2048x1064.png 2048w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><figcaption>Hirayama, R., Martinez Plasencia, D., Masuda, N.&nbsp;<em>et al.<\/em> 2019<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">I hope that you enjoyed my journey into what I hope the Augmented Reality experience will eventually become.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you.<\/p>\n\n\n\n<p class=\"has-large-font-size wp-block-paragraph\"><br><br>References<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">CES 2021. (2021, January 13). <em>Moving into the Future with will.i.am<\/em> [Video file]. CES. <a href=\"https:\/\/www.ces.tech\/Videos\/2021\/CES-Program\/Anchor-Desk\/Moving-into-the-Future-with-will-i-am.aspx\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.ces.tech\/Videos\/2021\/CES-Program\/Anchor-Desk\/Moving-into-the-Future-with-will-i-am.aspx<\/a><br><br>CNET (2019, November 29). <em>You can feel and hear these holograms<\/em> [Video file]. YouTube. <a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/tzWP-NL3Lck\" target=\"_blank\">https:\/\/youtu.be\/tzWP-NL3Lck<\/a><br><br>Hirayama, R., Martinez Plasencia, D., Masuda, N.&nbsp;<em>et al.<\/em>&nbsp;A volumetric display for visual, tactile and audio presentation using acoustic trapping.&nbsp;<em>Nature<\/em>&nbsp;<strong>575,&nbsp;<\/strong>320\u2013323 (2019). <a rel=\"noreferrer noopener\" href=\"https:\/\/doi.org\/10.1038\/s41586-019-1739-5\" target=\"_blank\">https:\/\/doi.org\/10.1038\/s41586-019-1739-5<br><\/a><br>Mahroo A., Greci L., Sacco M. (2019) HoloHome: An Augmented Reality Framework to Manage the Smart Home. In: De Paolis L., Bourdot P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science, vol 11614. Springer, Cham. <br><a rel=\"noreferrer noopener\" href=\"https:\/\/doi.org\/10.1007\/978-3-030-25999-0_12\" target=\"_blank\">https:\/\/doi.org\/10.1007\/978-3-030-25999-0_12<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OVR.ai. (2021, February 2). <em>NFTs on Steroids with Digital Arts Leading the Way<\/em>. <a href=\"https:\/\/www.ovr.ai\/blog\/nfts-on-steroids-with-digital-arts-leading-the-way\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.ovr.ai\/blog\/nfts-on-steroids-with-digital-arts-leading-the-way\/<\/a><br><br><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hi everyone, welcome to my A3 contribution. When doing research for this course I encountered a lot of Augmented Reality content, and even worked on&#8230;<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/blogs.ubc.ca\/etec523\/2021\/04\/04\/a3-holobar-the-next-step-in-ar\/\">Read more<span class=\"screen-reader-text\">A3 &#8211; HoloBar: the Next Step in AR<\/span><\/a><\/div>\n","protected":false},"author":21470,"featured_media":6208,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18,10],"tags":[183,201,203,204,205,207,202,208,182],"class_list":["post-6200","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a3-mobile-forum","category-mobiletechnologies","tag-ar","tag-augmented-reality","tag-mixed-reality","tag-mr","tag-music","tag-video","tag-virtual-reality","tag-vlog","tag-vr","entry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/posts\/6200","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/users\/21470"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/comments?post=6200"}],"version-history":[{"count":4,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/posts\/6200\/revisions"}],"predecessor-version":[{"id":6224,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/posts\/6200\/revisions\/6224"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/media\/6208"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/media?parent=6200"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/categories?post=6200"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/etec523\/wp-json\/wp\/v2\/tags?post=6200"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}