While completing the Detain/Release simulation by Porcaro (2019), I found myself uncertain about many of the decisions I had to make because I didn’t feel like I had enough information to make a fair choice. I noticed that the prosecution rarely suggested releasing someone, and when it did, I tended to agree. However, most of the time, detention was recommended, which left me feeling unsure about my judgments. The information I had to base my decisions on was minimal, considering the consequences. I tried to base my choices on factors like the individual’s age, mental health, and whether they posed a threat or had a history of violence, but these elements were not always clear or available. This experience made me realize just how often large organizations make unfair decisions, and how much we rely on technology and systems to try to fix complex problems.
Reflecting on how algorithms influence decision-making, I found it unsettling to think about their role in legal matters. As Malan (2013) states, algorithms are just “sets of instructions to solve problems,” but it’s still concerning to consider how they’re used in crime prediction. It made me think about other areas where people are ranked or categorized, like hiring processes. For example, I have heard that there are automated systems that screen resumes based on specific keywords or qualifications. This process is problematic because it can overlook the full context of a person’s experience or potential (O’Neil, 2017).
In the end, the simulation really opened my eyes to how algorithms are shaping our world and made me question how much we trust these systems to make decisions about people’s lives (Prompts for predictive text stories, n.d.).
References
O’Neil, C. (2017, April 6). Justice in the age of big data. Retrieved June 18, 2019, from ideas.ted.com website: https://ideas.ted.com/justice-in-the-age-of-big-data/
Porcaro, K. (2019, January 8). Detain/Release: simulating algorithmic risk assessments at pretrial
Prompts for predictive text stories: r/predictivetextpromptsLinks to an external site. [Online forum]. (n.d.). Reddit. Retrieved August 12, 2022.
TED-Ed. (2013). What’s an algorithm? – David J. Malan.