{"id":137,"date":"2023-02-26T22:02:00","date_gmt":"2023-02-27T05:02:00","guid":{"rendered":"https:\/\/blogs.ubc.ca\/rgch540\/?p=137"},"modified":"2023-03-14T19:52:49","modified_gmt":"2023-03-15T02:52:49","slug":"task-7-mode-bending","status":"publish","type":"post","link":"https:\/\/blogs.ubc.ca\/rgch540\/2023\/02\/26\/task-7-mode-bending\/","title":{"rendered":"Task 7: Mode Bending"},"content":{"rendered":"\n

This week’s task involved changing the semiotic mode of our\u00a0week 1 task<\/a>. I’ve opted to redesign my original task by creating an audio-driven trivia game using Twine. During the game, users are invited to guess the items in my bag based on the sounds that they make.<\/p>\n\n\n\n

Twine Game:<\/strong> Play ‘What’s in My Work Bag’ on itch.io<\/a><\/p>\n\n\n\n

Project File:<\/strong> Download ‘What’s in My Work Bag’ (*.zip)<\/a><\/p>\n\n\n\n

Development<\/h2>\n\n\n\n

Audio Recording<\/strong><\/p>\n\n\n\n

In the process of changing the semiotic mode of my original task, I took it upon myself to record the sounds made by each of the items in my bag. To do so, I used the Voice Notes app on my iPhone to create the recordings. By positioning and manipulating each item close to my phone’s microphone, I attempted to capture each sound in a distinguishable way. I then brought each sound into\u00a0Audacity<\/a>\u00a0to edit out any excess noise. The only items that I did not include from my original task #1 were the face mask and the laptop charger, as the recorded sounds were not distinguishable enough.<\/p>\n\n\n\n

Twine Game<\/strong><\/p>\n\n\n\n

To tie each sound together and create a unified multimodal experience, I decided to produce a simple hypertext trivia game in Twine. This was an opportunity for me to learn and experiment with Twine for the first time, especially since I had more bandwidth this week to do so. Along the way, I found myself relying on my knowledge of HTML and CSS, the Twine user-guide, and findings that my peers made with their own Twine objects. For example,\u00a0Elaine Lee’s (2022) task #5 post<\/a>\u00a0references Fry’s (2017)\u00a0video on hosting and embedding images in Twine<\/a>, which I also drew upon to add some visuals from\u00a0the Noun Project<\/a>.<\/p>\n\n\n\n

To integrate my sound effects into Twine, I uploaded each sound to Google Drive and then pasted a public embed link for each sound.<\/p>\n\n\n\n

In order to add the score counter, I referred to a discussion post<\/a> by Chapel (2017) which introduced me to the $score<\/code> variable. While this was originally written for Twine Sugarcube, I was able to modify Chapel’s (2017) approach for Harlowe with the help of Twine’s debug tool.<\/p>\n\n\n\n

Reflection<\/h2>\n\n\n\n

In my original week #1 task, I shared the contents of my bag using a combination of modes including visual (photo), linguistic (text), and spatial (content arrangement\/page layout). While approaching this task, I was reminded of the New London Group’s (1996) “designs of meaning” (p. 73) framework, which speaks to the ever-changing and contextually-driven relationship between “available designs, designing, and the redesigned” (p. 74). I can see now how my use of visual, linguistic and spatial modes in task #1 was drawing on my existing familiarity and knowledge of “available designs” (NLG, 1996, p. 74) for sharing information in a blog environment.<\/p>\n\n\n\n

As such, the “designing” (NLG, 1996, p. 73) process challenged me to reimagine the representation of task #1 by modifying the mode of communication. With my “redesigned” (NLG, 1996, p. 73) task, I relied more on aural modes (rather than solely linguistic and visual) to do the ‘heavy lifting’ of meaning-making. Rather than describing the object using visuals and text, the user must interpret the sound of each object to guess what it is.<\/p>\n\n\n\n

The use of hypertext allowed me to modify the arrangement and presentation of audio clips in a more participatory way. While my redesigned task is more of a proof-of-concept, I think it successfully demonstrates how users can express their existing knowledge in a new way (i.e., drawing on knowledge of different sounds and the trivia game rules and format) when compared to the more passive nature of the original task.<\/p>\n\n\n\n

Thinking through this mode-changing exercise and its broader connection to digital literacy, I’m reminded of Dobson & Willinsky (2009) suggestion that digital literacy has the potential to \u201c[further] educational and democratic as well as creative and literary ends\u201d (p. 303). In particular, I can see how the practice of mode-changing can work towards advancing 21st-century skills and student-centred learning by providing exposure to modes of representation and expression that go beyond written text. After completing this exercise, I feel more confident with approaching a multimodal redesign of my own instructional content in a way that would support digital literacy.<\/p>\n\n\n\n

References<\/h2>\n\n\n\n

Chapel (2017, June 29). Keeping track of points<\/em> [Online forum post]. Twine Forum. https:\/\/twinery.org\/forum\/discussion\/comment\/23447\/#Comment_23447 <\/a><\/p>\n\n\n\n

Dobson, T., & Willinsky, J. (2009).\u00a0Digital literacy. In D. R. Olson & N. Torrance (Eds.),\u00a0The Cambridge handbook of literacy\u00a0<\/em>(pp. 286-312). Cambridge University Press.\u00a0https:\/\/go.exlibris.link\/7G5xqPXN<\/a><\/p>\n\n\n\n

Fry, J. (2017, March 27). Twine \u2013 Adding Pictures [Video]. Youtube.\u00a0https:\/\/www.youtube.com\/watch?v=DRETz9wnOkk<\/a><\/p>\n\n\n\n

Lee, E. (2022, February 13). Task 5: Twine story. ETEC 540 Reflections<\/em>. https:\/\/blogs.ubc.ca\/etec540elainelee\/2023\/02\/13\/115\/<\/a><\/p>\n\n\n\n

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review<\/em> 66<\/em>(1), 60-92. http:\/\/newarcproject.pbworks.com\/f\/Pedagogy%2Bof%2BMultiliteracies_New%2BLondon%2BGroup.pdf<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

This week’s task involved changing the semiotic mode of our\u00a0week 1 task. I’ve opted to redesign my original task by creating an audio-driven trivia game using Twine. During the game, users are invited to guess the items in my bag based on the sounds that they make. Twine Game: Play ‘What’s in My Work Bag’ … <\/p>\n

Continue reading “Task 7: Mode Bending”<\/span><\/a><\/p>\n","protected":false},"author":90231,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-137","post","type-post","status-publish","format-standard","hentry","category-tasks","entry"],"_links":{"self":[{"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/posts\/137","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/users\/90231"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/comments?post=137"}],"version-history":[{"count":28,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/posts\/137\/revisions"}],"predecessor-version":[{"id":177,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/posts\/137\/revisions\/177"}],"wp:attachment":[{"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/media?parent=137"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/categories?post=137"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubc.ca\/rgch540\/wp-json\/wp\/v2\/tags?post=137"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}