Categories
Linking Assignment

Link 6

Mixtape/Playlist by Anne E.
Image from Canva

View Anne’s Original Task
View Anne’s Modebending Task


In her mixtape/playlist approach, Anne E. created a collection of songs and videos based on the mental associations she made between music and video and the contents of her bag. Each song includes an image from Spotify the artist’s album/song art and each video includes the embedded video link with static preview image. Both are accompanied by a brief explanation or quote from the piece being linked.

Production and Tools

Anne E. is a web designer, and her curation of songs and videos is neatly arranged in a visually appealing way on her blog. Although we both used audio, my audio is original content and hers is curated using hyperlinked visual images in the form of album/song art.

Literacies & Theories

Khan describes curation as the process in which a person “intrinsically links information to knowledge and meaning-making” and allows them to “add to a narrative around a topic” (Khan & Bhatt, 2019, p. 1).

In her own words, Anne explains how these playlists connect to who she is:

“Reflecting on this task, I would say the main affordances of this mode of communication are both experiential and cultural – you may not learn anything about the specific items I carry, how I use them, what my life is like, or what type of work I do, but you can learn something about where I sit culturally in our world from the songs I have chosen and how I like to connect emotionally with music.”

She also explains how it allowed her to demonstrate her own meaning-making:

I’ve been able to curate my own collection of information and link it together as I see fit, much how Bush (1945) envisioned with his Memex machine in 1945.

I connected immediately with the idea of curating a playlist and can remember the thrill of sitting by the boombox ready to record songs to make a mixtape in my youth. It’s something so many of us do in our non-academic lives yet translates immediately to several academic contexts. Many of us would not take the leap to use this format in our academic lives, but I’m glad Anne did.


References

Khan, S. & Bhatt, I. (2019). Curation. In R. Hobbs & P. Paul Mihailidis (Eds.), The International Encyclopedia of Media Literacy. (pp. 1-9). John Wiley & Sons, Inc. DOI: 10.1002/9781118978238.ieml0047

Categories
Linking Assignment

Link 5

Poetry by Manize N.
Photo by Thought Catalog on Unsplash

View Manize’s Original Task
View Manize’s Modebending Task


As an English major and literature lover, my affection and interest in poetry came late. As an angsty teenager, I railed against the genre because I had difficultly understanding the obscure meanings and messages in the words of long-gone poets, and let’s face it, I had no life experience to understand it. The difference came when I heard poetry – the rhythm and cadence – and it became lyrical. When spoken, poetry is lifted off the page and transformed into a transcendent and magical experience – like listening to the waves crashing at the seaside, birds chirping, or the symphony.

Hearing Manize’s poem, What’s in my bag, you ask? evoked that same kind of magic for me.

Production and Tools

As I was interested in everyone’s production tools and process, I reached out to Manize to ask for more details:

I recorded the video on my laptop using a program called Camtasia. I have version 9. It is a highly intuitive audio and video recording and editing tool. I used my regular iPhone earphones/microphone to record the audio. I was able to add the background music mp3 directly into Camtasia. I downloaded the .mp3 from a royalty-free platform called Purple Planet (https://www.purple-planet.com/).

Our process was similar in that we both recorded our own voices and incorporated other sounds while producing our audio files. I did change my voice with Adobe Audition to create a voice for my character, but Manize’s voice remains unchanged. We shared a short exchange about our reluctance to record our own voices – is there anyone who loves the sound of their own voice? – but it is Manize’s voice reading her poem that makes this production so evocative. Listening to her voice and words, my heart swelled with admiration and emotion, and I got goosebumps.

Literacies & Theories

Both Manize and I privileged more traditional literacies in our decisions to write poetry and narrative. But by making them multimodal, they become alive, which makes them more accessible and engaging for our audiences, as well as for ourselves.

Manize shared this reflection about her experience with this multimodal task:

This exercise was challenging, because it was difficult for me to grasp initially what was required exactly. However, as I progressed through the task, I was able to connect this to the example of “Transformed Practice” (NLG, 1996, pg. 83), in the sense that I was able to recreate the meaning or redesign this task of meaning in a different context. At the heart of learning is motivation. While doing this task, I realized that I was able to express myself better through a poem as opposed to taking a picture and writing about the items. Because I had the freedom to choose the way I wanted to learn, I was more motivated to learn. As an educator, I was able to connect this to the concept of “Situated Practice” (NLG, 1996, pg. 85), as it further reaffirmed my belief that a learner’s affective and sociocultural need must be accounted for and guided learning experiences must be created to enable the same.

I’m with her. When we were given the opportunity to produce multimodal texts, we had more agency and motivation than if our only option was to produce traditional texts. Multimodal production celebrates a range of literacies giving individuals the power to express their identities and share their experiences. This week, I encountered a Tweet by @GholdyM with a powerful message about honouring one’s literacies and subsequently, one’s identities:

As educators, we need to honour, respect, and champion all the different literacies our students possess – the traditional school literacies and the ones they have developed in their outside, daily lives – and the way that we can do that is by creating opportunities for students to use those literacies in the classroom. We need to bring meaning-making production and assessment into the 21st century by designing teacher and learning opportunities that inspire creativity, engagement, and new media (Kalantzis & Cope, 2010).


References

Kalantzis, M. & Cope, B. The Teacher as Designer: pedagogy in the new media age. E–Learning and Digital Media 7(3) https://doi.org/10.2304/elea.2010.7.3.200

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-92.

Categories
Linking Assignment

Link 4

Digital Games by Jennifer L.

View Jennifer’s Original Task
View Jennifer’s Modebending Task


Production and Tools

I was curious and unsure about how Jennifer approached producing this video because I’m not familiar with the Nintendo Switch and its capabilities. Did she record her screen with another device? Can you screenrecord on the Switch? So I asked her, and she responded:

I used the video capture option but the downside to that is it can be max 30 seconds long, so I took about 5 videos. You can transfer over images/videos via QR code on the switch so I sent it to my phone, then airdropped it to my computer (lmao seems so onerous in hindsight! but it was pretty easy and quick). I pieced it all together in iMovie, and then did the voice over using Voice Memo on iphone (no script, so I had to do a few takes), and airdropped that audio file, and imported it into iMovie. That’s about it! Oh, and the video ‘title card’ I whipped up using photopea.com

Jennifer created this demo by screenrecording within the Switch and bringing it into other content-authoring software to finish it off. Across everyone’s modebending task, I have been pleasantly surprised that everyone’s process and production tools have been different, and I let Jennifer know this:

In the Breakout of the Visual, Bolter discusses how technology  levels the playing field for novices who want to produce texts, and though he’s discussing digital publishing of print text, the ideas about the ease design and production are still valid across multimodal text productions:

  In the 20th century, digital technology in the form of desktop publishing and computer-controlled photocomposition refashioned the practice of printing, and in comparison with the earlier mechanical techniques, digital printing seems to foster heterogeneity in both form and content. One reason is that the computer opens the printing process to small groups and even individuals. Amateurs can create their own camera-ready copy and make selective use of or ignore altogether the stylistic practices of professional typographers. (2010, p. 49).

Jennifer says she “whipped up” the title card for her video using photopea.com, just as I used canva.com to create the images with text overlay on my linking assignment page as a workaround to not being able to figure out text hovering within WordPress.

Literacies & Theories

Jennifer’s experience playing Animal Crossing is valuable because the game is so popular it has become a social, cultural, and political phenomenan, and gives her a kind of gamer cred and capital I don’t possess because I’ve never played the game. Jennifer has access to another lifeworld and extension of her real-life identity through her Animal Crossing character. When she enters the virtual game world of Animal Crossing to curate her bag, Jennifer is limited by the objects in the game to some extent, as she cannot create her own objects from scratch. She overcomes this by assigning meaning to her chosen objects to represent other things. In the case of my selection of sound effects, I was also limited in what sounds were available to me in GarageBand however, theoretically I had the power and resources to create my own sounds from scratch, but found it easier to use existing sounds. Both Jennifer and I used a similar process of my assigning our own meaning to the sounds and objects we used. In doing so, we both overcame the material constraints of our content-authoring tools to make and disseminate meaning in our productions that convey our intended messages and meaning, as well as reveal our identities and life-worlds, which were the intended outcomes of the modebending task. (Kress, 2010, p. 185).

In her own words, Jennifer discusses how digital games are an important opportunity for students to experience multimodal texts and how the playing and production within them is valued literacy in her classroom:

“The increasing saliency of cultural and linguistic diversity and the multiplicity of communications channels and media” require us to redefine what literacy means to us now (Group, 1996, p.63). Literacy then, is not just language but a social practice that encapsulates multimodal meaning-making. This can include involving the visual, audio, spatial, and behavioural. For students, creating videos or producing small pieces of media to represent understanding falls under this new definition of literacy. It makes sense. The way students have taken ownership over their media consumption and production necessitates that we as educators address this. Rather than asking students to just tell me about themselves in a letter, activities such as these also help with teaching students what literacy means and open up avenues for them to show understanding in future assignments.”


References

Bolter, J. D. (2010). Writing space: Computers, hypertext, and the remediation of print (2nd ed.). Lawrence Erlbaum Associates. doi:10.4324/9781410600110

Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-92.

Categories
Linking Assignment

Link 3

Podcast by Deirdre D.
Image from Canva

View Deirdre’s Original Task
View Deirdre’s Modebending Task


Though we approached our tasks using different genres, both of our productions are personal and telling of our identities, which Deirdre highlighted in her reflection, through commenting on her and my Task 1 posts, and in her own linking assignment back to my original and mode bending tasks.

My reaction to Deirdre’s Modebending:

Production and Tools

Deirdre created a podcast that was as engaging as it was authentic. A lot of digital productions are scripted and canned to some extent, but listening to Deirdre and her friend, I felt like I was there with them in the same room as an observer. 

Both of our productions involved recording audio and editing, but I assumed my work was more edited (inclusion of voice and sound effects, returning to re-record the date) than Deidre’s, and I was correct in my assumption. I contacted her via her blog for more info about her production tools and process:

I used Audacity on my microsoft surface pro to record my conversation (the conversation was facilitated with an iphone, placed near the computer, on speaker mode).

Deirdre didn’t need anything more than her devices and Audacity, which is a free program, to record a brilliant podcast, which speaks to the accessibility of the production format for folks who want to get into producing their own podcasts – fancy sound recording and equipment are not required.

Literacies & Theories

Deirdre’s podcast production about the items Moms carry in their Mom pocket emphasizes the collective culture and discourse of Moms, an important but undervalued subculture. Deirdre recognizes that the items in her Mom Pockets™ (if it’s not trademarked, get on it, Deirdre!) are “what The New London Group (1996) might describe as the representation of a shared cultural context” because are Dad Pockets even a thing? (One of our classmates did title his Task 1 post as, “What’s in the bag, dad?” – because he carries a photo of his 17-year-old son when he was 3 – awwww!!!)

I’m not a mother, but I think that motherhood is one of the most difficult, beautiful, and brave jobs on the planet, but unfortunately, also one of the least respected, as the value of women’s work is unpaid and otherwise undervalued – see Women’s Unpaid Labor is Worth $10,900,000,000,000. I am curious about the world of motherhood and was immediately pulled into Deirdre and her friend’s conversation about what it means to be a Mom. Mom Pockets™ may seem like a kind of silly and trivial topic, but it is worth the insightful and in-depth discussion Deirdre and her friend give it, as Mom Pockets™ represent the role of mothers and are a glowing example of their care and love for their children. Mom Pockets™ embrace children’s curiosity about the world and are an ultimate sign of love and affection.

If you are a podcast listener, you know there’s a podcast for everyone about everything. The New London Group highlights this about our new media environment:

For example, one of the paradoxes of less regulated, multi-channel media systems is that they undermine the concept of collective audience and common culture, instead promoting the opposite: an increasing range of accessible subcultural options and the growing divergence of specialist and subcultural discourses (1996, p. 14)

Deirdre’s voice as a Mom and authentic, engaging “conversational language and the personae and relationships of ordinary life” (New London Group, 1996, p. 16) would be embraced with open arms and celebrated by the podcast community.


References

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-92.

Categories
Linking Assignment

Link 2

ASMR by Judy T.
Photo by Elice Moore on Unsplash

View Judy’s Original Task
View Judy’s Modebending Task*

*disclaimer – Judy’s redesigned task is no longer available for viewing at the link provided in her blog


Quite a few colleagues across both courses produced audio recordings of their What’s in your bag? items creating soundscapes for their lives and workplaces, but Judy T. took a particularly clever approach and recontextualized her original text by creating an ASMR video.

ASMR is a wildly popular trend and genre of videos you’ve either never heard of, watch/listen to avidly, or have explored using Incognito mode in your browser: seeking out the experience can be completely innocuous for the promise of it producing relaxing and euphoric sensations, or if you’re into it, a more erotic or arousing experience. You do you.

Full disclosure, I only listened to enough of Judy’s redesign to get an idea of what she produced, because hearing repetitive sounds triggers a fight-or-flight response within me as a person with (self-diagnosed) misophonia.

Production and Tools

Regarding Judy’s decision to remix two YouTube clips, I asked myself these questions from the New London Group (1996), “‘Why not that?’ as well as ‘Why this?’” After an unsuccessful attempt at recording her own sounds, Judy combined and remixed two YouTube videos to represent the items in her bag. Capturing clear and crisp audio requires not only the right sound recording equipment and silent space but knowledge and expertise in audio editing that goes beyond the novice. When putting together my own audio I didn’t even consider attempting to record my own sound effects because better ones were available to me within GarageBand.

I reached out to Judy to ask for some specifics about her editing and production process, and she shared this with me:

I downloaded YouTube videos from here: https://www.y2mate.com/en68

All you need to do is copy the YouTube link and plot it in.

Then I edit and compiled the videos together here: https://clideo.com/merge-video
You might need to play around with it to see how to merge. You will need to decide first what time frame of the videos you want to use.

Judy’s redesign work that remixes two YouTube videos is meta and a nod to how the trend was born and skyrocketed to popularity on YouTube.

In my own modebending of this task and reflection, I wrote about the concerns I share with the New London Group (1996), Dobson & Willinsky (2009), and many others, about the availability of more sophisticated and pricey content-authoring tools like Adobe Audition and Garageband to teachers and students, but Judy created her production with free web-based tools accessible to all.

Literacies & Theories

Though others took a similar approach using recorded sounds to represent the items in their bags, Judy’s unconventional choice to redesign the original task by recontextualizing her bag’s contents using ASMR was unique and intriguing because, in my novice understanding of the term, it hybridizes her original production, as defined in New London Group (1996) by Fairclough (1992), and sets it into a distinct and unique cultural phenomenon:

The term hybridity highlights the mechanisms of creativity and of culture-as-process as particularly salient in contemporary society. People create and innovate by hybridising, that is by articulating in new ways, established practices and conventions within and between different modes of meaning.

ASMR is an intriguing, if not somewhat strange cultural phenomenon, and one that continues to grow as more and more videos are produced. There is a massive incentive to produce ASMR videos because of YouTube monetization, and most producers of ASMR videos are women, and most would be considered classically beautiful. There’s a whole lot to unpack when discussing ASMR, nonetheless, I am impressed by Judy’s remediation of the task in this format. If you’d like to read more about it, Jamie Lauren Keiles’ fantastic piece in the New York Times introduces ASMR in a serious, intelligent manner and discusses ASMR’s rise in popularity and some of the issues it faces in widespread social acceptance. 


References

Dobson, T., & Willinsky, J. (2009). Digital Literacy. In D. Olson & N. Torrance (Eds.), The Cambridge Handbook of Literacy, 286-312. Cambridge University Press.

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-92.

Categories
Linking Assignment

Link 1

Video Letter by Jasmine P.

View Jasmine’s Original Task
View Jasmine’s Modebending Task


Affected by how the pandemic has reshaped our lives this past year, Jasmine completely reenvisions her original task by delivering a heartfelt video of a letter to COVID. By situating her production so heavily in the context of our global pandemic and anthromorphosizing the virus, she harnesses the power of our collective feelings and lived experiences to speak directly to the vicious, unsentient, and unempathetic parasite that has caused all of us so much stress, anxiety, and pain, creating an emotionally engaging, important piece of work.

I appreciate that Jasmine recognizes that even in a difficult time, lessons can be learned to embrace living in a more fulfilling way. She shares an inspiring message when she says,

You’ve definitely taught me that I need to live a little more in the moment and appreciate the simple joys in life, and I know I will use these lessons moving forward.

Production and Tools

Curious about how everyone’s content-authoring tools and process, I asked Jasmine for more details:

I used my laptop mic (I wish I had a Yeti mic, they’re great) and Audacity to record the audio. I then put it together in Camtasia. The visuals were all from Pixabay and the music was from Bensound (all royalty-free). I then uploaded it to YouTube as an unlisted video.

Jasmine’s video production includes soft background music that evokes sentimentality, and videos with imagery that represent the slow, painful passage of time in a waiting period, as well as the emptiness, loneliness, and isolation during the pandemic in contrast to what life was like before with crowds of people in outdoor and indoor public spaces.

In her own words, she says,

“The end product and incorporation of the letter I wrote, the narration, music and video clips turned what was a static image into something meaningful for me. It is probably the first time that I have actually reflected this deeply on the changes in our lives that we’ve experienced over the last year. Putting it together did stir some emotion”

You can hear the emotion in her voice, especially as she nears the end of her letter.

Jasmine’s production was multimodal and used visuals and audio to convey mood and meaning, and my production was 100% audio with no visuals. Like music and images, sound effects can create a mood and convey meaning, and though our productions were different, I think the impact of our end result is the same. In creating our video and audio files, similar techniques were used to edit and time our visuals and sound effects in order to affect mood or create meaning. One could choose to listen to a video much in the same way they listen to a pure audio file and create their own visuals and meaning-making, or choose to watch the video for more direct access to the author’s meaning-making.

Literacies & Theories

In the New London Group’s discussion of the role of design in multiliteracies and meaning-making, design and redesign processes are described as powerful tools for the transformation of meaning-making for both the designer and learner. Jasmine and I both privilege this pedagogical stance that champions modebending as a transformative learning process. Through producing her video letter, Jasmine reflects deeply on how much life has changed during the pandemic, and this process of reflection during this redesign creates a new layer of meaning for her that the first task did not create.

The following from the New London Group spoke to Jasmine and I:

Through these processes of Design, moreover, meaning-makers remake themselves. They reconstruct and renegotiate their identities (1996).

By recontextualizing her original design and situating it in the context of the pandemic, she has revealed much more about herself, how she sees the world, and importantly, what she’s learned to share a powerful message of hope that brightens this darkness.


References

The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1), 60-92.

Categories
Tasks

Task 12

Speculative Futures

This week’s task was to create two speculative narratives on our potential relationship with media, education, text and technology in the next 30 years, and I’ve fictionalized myself for both narratives.

The first narrative is an interactive vignette about brain/computer interfaces in Inklewriter and the second is a chat story created with the TextingStory app on iPhone – the upload exceeded the 20mb file size for WordPress, so I’ve hosted it here.


Speculative Genres

My introduction to speculative design and fiction was through Margaret Atwood’s Oryx and Crake trilogy, mentioned by Dunne & Raby (2013) as not only a masterful example of speculative literature but a provocation of ideas surrounding “social, cultural, and ethical implications of science and technology.” What makes the trilogy speculative instead of sci-fi is that everything in the post-apocalyptic world Atwood designs could have technically existed within the possibilities of 2003 and beyond’s technology and science. If you think lab-grown but non-animal protein Beyond Meat or an Impossible Burger is disgusting, how do you feel about lab-grown chicken? But only the edible parts of a chicken – like the breasts – without the rest of the chicken, or at least without the unnecessary parts? If you want to read for yourself, check out the book, or read this blog site’s excerpt from Oryx and Crake regarding the chicken, or ChickieNobs. There’s a nod to this in the first narrative.

My narratives take inspiration from coursework in ETEC 522 and ETEC 523 and my exploration of exciting emerging technologies such as chatbots (Alex in the second narrative is an AI chatbot),  VR/AR and immersive experiences, the upcoming 5G revolution and its impact on Internet of Things and device connectivity, the potential of posthumanistic brain/computer interface technology via neuralnanobot implants. I’ve also been inspired by the 2020 dystopian adolescent fiction novel Feed by M.T. Anderson, where the feed is a brain/computer interface in a society driven by consumerism and corporate interests (sound familiar?) and the Netflix show Upload where the less resourced 2 gigs run out of data and exist on pause until the next month’s data recharge.

The first narrative also touches briefly upon the issues of the quantified self and our desire to learn more about ourselves and the world in quantitative ways: whether it’s through DNA testing, FitBit or Apple Watch daily steps tracking, social media and app use to check into locations, keeping up with our likes/faves and streaks, maintain a record of the beers we’ve imbibed or birds we’ve seen, we are chasing our quest for knowledge, our goals, our self-esteem and happiness using digital technologies. Admittedly, I engage in some of the above mentioned forms of tracking and measure my quantified self through social media and app use, and I have an understanding of some of the risks in sharing my personal data for the enjoyment I receive in return. Rutsky (2018) explains the draw and risks:

The attraction of these technologies lies precisely in their promise to allow users to be free, active creators and producers. Yet, this promise of increased freedom, creative expression, and mastery is premised upon converting virtually every aspect of life, nature, and culture into quantitative terms, into data – including human life.

As the world becomes more digitized and technologically advanced, some of the speculative futures imagined by revered thinkers such as Kurzweil, Orwell, Atwood, Anderson, Huxley, and even Musk have or will become a reality instead of science fiction, and one thing is certain: our lives have become inextricably linked with technology. And we are either unwilling or unable to remove ourselves from it completely. When I began the MET program I was much more of a tech Pollyanna and bought into the idea of techno-utopianism much more than I do now. I personally find it impossible to rid myself of everyday technologies I know might be harmful or exploitative from a personal and collective data point of view, and I think we have all had to embrace technology in ways that have expanded our comfort zones to remain relevant, either culturally, socially, or economically. Dunne & Raby (2013) and countless others have cautioned against wholeheartedly accepting technology for all its promise and possibilities without a consistent and vigilant critique of it – and ourselves. Technology is not a runaway train or autonomous being. We have created it, and we must act ethically and reflectively in our creation and use of it.


References

Dunne, A., & Raby, F. (2013). Speculative everything: Design, fiction, and social dreaming. MIT Press.

Rutsky, R. L. (2018). Technological and posthuman zones. Genealogy of the Posthuman. https://criticalposthumanism.net/technological-and-posthuman-zones/

Categories
Tasks

Task 11

Algorithms of Predictive Text

This week’s task to use the predictive text feature of our smartphones to generate a microblog about a prompt resulted in the following:

This is not my idea of a good job offer but it’s ok. The only way I can find a new one is the best thing for me. LOL I’m so excited to have a new phone. I think it’s ok if you don’t want me to go back to work. The only reason why I don’t want to go back to work is because it’s not too much fun for me. I have to get tested for this one day and then I’m gonna try to get it done before the end of the week. LOL I hope you are doing ok today. I think it’s too bad I don’t know how much it will work out for me. The first time we had the same experience with that one day I have been accepted to a PhD program at the university of Toronto and the other day that we were doing this is the best way to get it done. The following day I was like oh wow lol ???? I didn’t know if it would be a nice day to go out there to see if I could go to the park for a while. The first two seasons of this year were also in May by two and three, the only time in May last year of that period was a little disappointing. I think I will be able to make a decision to go back to work tomorrow. I don’t think it’s so weird to say I am so sleepy ????. The first time in May was a little bit more fun than the last time. I think it’s the best thing to do. The only way to get a little better is to go back to sleep.

The microblog above best reflects simple everyday language used in casual text messaging conversation, rather than more sophisticated language used in novels or academic texts, and even more simplistic than the less sophisticated language used in magazines or blogs. In this way predictive text is reflective of the style and voice of my text messaging. I begrudgingly admit to overusing LOL, which came up as an option every time I typed a period. Every time I typed good the word lord was included in the next option. I do say good lord a LOT. There are other words that came up as predictive text options that I attribute to the following:

  • when I text my mom goodnight I often use the word sleepy
  • when I discuss work with a good friend who was furloughed last year
  • I’ve been texting friends recently to share the amazing news that I have been accepted to a PhD program at the University of Toronto

As much as I think the predictive text has learned from me, I don’t think it has a lot of range or sophistication, and it clearly hasn’t picked up on all the cursing I do – it usually takes me several attempts to type duck every time I want to use it – and I’m shocked an option for y’all never came up with other pronoun options. I was annoyed the same few beginning sentence options repeated themselves over and over again. I could only begin a sentence with I followed by a limited verb set have, think or don’t or The followed by first, only, or following.


Algorithms: Harmless or nefarious or somewhere in between?

On the surface, useful everyday technologies like Siri, spam filters, and predictive text that use neural networks and language in corpuses such as the Enron emails’ unfettered conversations and the past 50 years of texts used in Word2Vec seem fairly harmless (Herman, 2019; McRaney, 2018). But a few ideas in this week’s material are cause for alarm: Cathy O’Neil shares with us that algorithms learn from the past to shape the future and that their output is as biased as the data input that feeds them, and Alistair Croll shares that “algorithms shit where they eat” causing predictions to become reality and that “output is tied to input in unexpected and not obvious ways” (Mars, 2017; )

Last February I read about OpenAI’s text generation project that was supposed to be open but became shrouded in secrecy, because the company’s mission to create open source software was thwarted by ethical concerns about the software being misused in harmful or destructive ways. I went down the rabbit hole and found a similar text generation website called Talk to Transformer that uses Inferkit‘s neural networks to generate text and played around with it. Though the technology was impressive, there’s something unnatural and a bit bizarre about the following screenshots from last February. FYI, the first example is NSFW.

The output seems to be generated randomly, and in the above examples, it would seem the corpus might come from fiction texts, and the NSFW example seems to be pulled from the genre of erotic fiction.

But what if the software allowed for the user to input other parameters that would tighten up the corpus and shape or meaning of its generated output? What if I could generate text to pass off as my own academic work? I tried it again for the purpose of demonstrating how text generation can be used to autocomplete some of the ideas in this blog post, and I used it with this prompt:

On the surface, the creation of useful everyday technologies like Siri, spam filters, and predictive text that use neural networks and language in corpuses such as the Enron emails’ unfettered conversations and the past 50 years of texts used in Word2Vec’s corpus seems fairly harmless.

And Talk to Transformer came up with this:

On the surface, the creation of useful everyday technologies like Siri, spam filters, and predictive text that use neural networks and language in corpuses such as the Enron emails’ unfettered conversations and the past 50 years of texts used in Word2Vec’s corpus seems fairly harmless. And indeed, many are hailing Word2Vec as a powerful breakthrough for understanding the shared nature of human communication. However, the very real possibility of issues relating to fairness and trust has important ramifications.

The Sroufe Lab at Stanford University and the BCG Digital Finance Lab have since used Word2Vec to answer the very basic question: how do you build trust between bots? What is the algorithm that should an average person trust?

Fairly convincing? How about this one?

On the surface, the creation of useful everyday technologies like Siri, spam filters, and predictive text that use neural networks and language in corpuses such as the Enron emails’ unfettered conversations and the past 50 years of texts used in Word2Vec’s corpus seems fairly harmless. But dig a little deeper and you’ll find a more sinister subtext—a vast, never-ending collection of the human past being explored by a criminal mind and monetized for the benefit of an oppressive, surveillance state. It’s about using machines to perform forensic analysis and identity theft, to expose people’s hidden (often mentally ill) activities and information that can be used to produce a false report and “gotcha” moment.

What if I could upload the entire corpus of my academic writing, so it could learn my voice? Then what if I could generate text pulled from relevant articles and journals based on a research project of my choosing? We know that a group of students from MIT built a text generator and used it to generate scientific articles that passed the peer-review process and were published in journals. The misuse of this technology for academic dishonesty is just one example of a potential harmful use of algorithmic technology. When algorithms are already so widespread and poorly understood, their ability to “make it unfair for individuals but sort of categorically unfair for an enormous population as it (sic) gets scaled up” is a bit frightening (Mars, 2017). Much needs to be done to create awareness for users of everyday technologies that use algorithms and to design ethical frameworks for the creation and implementation of algorithms.

Herman, C. (Host). (2019, June 5). You’ve Got Enron Mail! [Audio podcast]. Brought to You By… https://art19.com/shows/household-name/episodes/354d6bd0-d3f6-4536-80b5-c659fc47399f

Mars, R. (Host). (2017, September 5.) The Age of the Algorithm [Audio podcast]. 99 Percent Invisible. https://99percentinvisible.org/episode/the-age-of-the-algorithm/

McRaney, D. (Host). (2018, November 21). Machine Bias (rebroadcast) [Audio podcast]. You Are Not So Smart. https://youarenotsosmart.com/2018/11/21/yanss-140-how-we-uploaded-our-biases-into-our-machines-and-what-we-can-do-about-it/

Categories
Tasks

Task 9

Golden Record Curation Networks

This task first required us to complete last week’s task on curating our 10 selections from the Golden Record and enter our selections into a Canvas quiz so that our professor could create a data file for us to upload to Palladio, a data visualization tool from Stanford. The data file uploaded to Palladio to get this visualization includes names of students in our course and each of our 10 selections from the Golden Record, but other than that, there were no other data points. After brute force exploration and clicking around within Palladio, I started to see visualizations of data that started to make sense to me. One showed the connected networks of students with a numbered node in the center, as shown below, and I decided to further investigate the network containing Sarah Hain, Lyon Tsang, Melissa Philips, and myself.

Network with Lyon, Melissa D., Melissa P., & Sarah

At first, I thought the number 4 represented how many songs we had selected in common between the four of us, but that’s not the case. In our network, there are two songs all four of us selected: Percussion (Senegal) and Johnny B. Goode (U.S.). The network below shows our four-way connection.

I isolated each member of the network to compare with another member of this network to visualize our two-way connections. Below, you can see one example of this visualization comparing the two Melissas and their selections.

After visualizing each two-way connection, I drew this network with numbered nodes that show the degree of connectivity and totalled up the number of connections each member had with other members. Melissa D. and Sarah have the most connections with others at 16 selections, followed by Melissa P. at 14 selections, and Lyon with 12 selections.

Explaining the Quantitative with Qualitative

I went to Lyon, Melissa P., and Sarah’s blogs to investigate my connection with them and in each, I found a piece of qualitative information that I interpreted to explain our shared two-way connections.

from Sarah H.:

“I chose my song selection as what I believe to be a good representation of our diverse culture on Earth. I wanted to be inclusive of a variety of styles including words and music to help with the interpretation of what we are sharing. Offering this variety to hopefully include something that could be understood. I also wanted to try to capture the joyful life on Earth rather than maybe the actual reality with what we are experiencing now with a pandemic on our hands. Although it is important to paint a truth, I think it is important to show the joy over the gloom at this time.”

As I said in last week’s task, I chose more happy, upbeat, peaceful, or evocative selections. In this way, Sarah and I purposefully chose songs we interpreted as joyful, and as a result we had 6/10 selections in common.

Our network:


from Melissa P.:

Nonetheless, I formed a criteria that I felt was somewhat “fair”, and yet it is still based upon my understanding of the world, perspectives, value judgements, and the little understanding that I hold in regards to the cultures of the world.  However,  my main criteria was that every continent where humans reside be represented. My secondary considerations to help me narrow it down were that I was looking to provide a variety in musical instruments or genres, represent different time periods, and hopefully include songs that represented certain unique aspects about the Earth itself (water, animals) and/or intimate details about the human condition.

The tenth selection was the most difficult, but eventually I realized that the majority of the pieces are quite somber, and I decided to select a piece that represents that there is joy and fun to be had on Earth. I think that this is arguably the most uplifting piece of music on the Golden Record.

Though Melissa and I share 6/10 selections, she gave more consideration to making sure there was equal representation and distribution of songs to each continent, and though my choices were somewhat diverse and in alignment with hers, my approach was different as I did not seek to make selections that were diverse across geography, time, and in instrumentation. In fact, I leaned toward songs I interpreted as having more layers of instrumentation. Melissa P. and I state our active selection of joyful songs.

Our network:


from Lyon T.:

I began by eliminating pieces with lower audio quality.

I don’t think the two panpipe recordings sounded that great, for example.

I was also drawn to instruments.

The Bach pieces show off a solo violin, a solo piano, and an orchestra. Flowing Streams featured a guqin, while the manipulation of human voices was prominent in Tchakrulo and Iziel.

Lastly, I looked for rhythm.

It is illustrated well in Percussion (Senegal) by a steady beat, while the jazzy Melancholy Blues shows how rhythm can be stretched and more fluid. The energy generated by rhythm is apparent in Johnny B. Goode and El Cascabel.”

Lyon and I shared 4/10 selections, and he and I share a preference for instrumentation as well as rhythm. His latter preference for rhythm may provide a better explanation for our connections as we share 3 selections which I would say are upbeat and the reason why I selected them.

Our network:


Other Interesting Visualizations
Most Popular Selection

The most popular selection from the Golden Record was the Percussion track from Senegal, with 16 out of 21 students selecting it, and this visualization is shown below.

Least Popular Selection

Not shown is the visualization of the least popular track, String Quartet No. 13 in B flat, selected by only 2 out of 21 students.

Wedding song and The fairie Round

Only women selected these two songs, and only the two Melissas selected both of them, as visualized below.

Strongest and Weakest Degrees of Connectivity

My strongest degrees of connectivity were with Melissa P., Sarah, H., and Erin M. with 6/10 selections in common.

Binal K. was my weakest connection with only 1 shared selection in common.

Categories
Tasks

Task 8

Golden Record Curation

How am I such a space nerd and music lover and have never heard of the Voyager Golden Record sent into space in 1977 until now? Did I miss that episode of Cosmos?

If the idea of a musical time capsule were conceptualized today it might be that we would send a fully loaded iPhone instead. By the time anyone discovered it, the battery would be long dead, and wouldn’t the radiation of outer space zap all the digitized music off of it? This is one of the problems with the digitization of information: it can easily become lost. In the context of analog vs. digital, perhaps an analog record has a better chance of surviving the long journey into deep space and posterity, though both the record and the digital files without their machines would be rendered useless (Smith, 1999).

This assignment was super rad, and I went all geeky and made a spreadsheet with my criteria. Disclaimer: I’ve never taken any music theory courses, so my meter/chord observations below are most likely not at all accurate.

Selection Criteria

My selections show a clear preference for complexity in regards to multiple layers of instrumentation over more simplistic works, and a preference for works with consonance over dissonance, even or free metering over odd metering, and for music I interpreted as feeling more happy, upbeat, peaceful, or evocative. Contrary to Timothy Ferris, the lead producer of the Golden Record, and his lack of consideration for “the idea that we’d somehow be threatening someone” with the record’s selections, I intentionally excluded works I felt were threatening or ones that made me feel anxious as I listened, with the exception of Beethoven’s Fifth because of its lasting cultural relevance (Taylor, 2019). I wonder if he second-guessed himself when he saw Independence Day (see GIF below). I’m thinking we really don’t want to upset unknown extraterrestrial species.

via GIPHY

One of the last concerts I went to before the pandemic shut everything down was Dan Mangan, a Vancouver artist who I fell in love with after hearing Troubled Mind, arguably his most upbeat song, because the majority of his music is overwhelmingly melancholy. I’ll never forget how a few songs into the show at the FirstOntario Performing Arts Centre in St. Catharines, in between songs when Mangan was tuning his guitar, a guy sitting right in front of me yelled “PLAY A HAPPY SONG!” and Mangan chuckled and said, “You’re at the wronggggg show” as the crowd erupted in laughter. Even if the Golden Record’s producers weren’t sure extraterrestrials “would lounge back and listen to the music and experience it the way we do,” I think we have to imagine they might be just like us and find beauty and enjoyment in music that represents the full range of human experience and emotion but at some point lean more toward the upbeat and happy (Taylor, 2019). For this reason, I also mostly rejected works that were melancholy, with the exception of the Wedding Song, which after listening to the podcast to learn it was a lament about a woman marrying too young, had to be included if for no reason other than sending a message to the people of planet Earth.

Reflection

My personal selections were difficult for me to reconcile because while I understand the need for diversity and representation, my preferences are mostly of Western origin, which isn’t that surprising considering I grew up in a Western culture. The one exception to this was the Kinds of Flowers from Java, Indonesia. Though Ferris claims to have aimed for diversity and global representation during the selection of songs on the record, I thought it was interesting that a disproportionate number of the selections (over 25%) just happened to be from U.S. and former Soviet Union nations, the two countries engaged in the Space Race.


References

Smith, A. (1999). Why digitize? Council on Library and Information Resources. https://www.clir.org/pubs/reports/pub80-smith/pub80-2/

Taylor, D. (Host). (2019, April 22). #65 Voyager Golden Record. [Audio podcast]. Twenty Thousand Hertz. https://www.20k.org/episodes/voyagergoldenrecord

Spam prevention powered by Akismet