The Self-Driving Human

Grad school project
Artist
performance, machine learning
Python, Fabrication, Hardware, Python, Tensorflow

The self-driving human is a device and performance where an intelligent portable agent makes decisions for participants in the real world. It is my masters thesis at ITP.

;

Every day millions of people decide to grant their smartphone a bit more control over their lives…in pursuit of health, happiness and power, humans will gradually change first one of their features and then another, and another, until they will no longer be human.

~ Yuval Noah Harari in Homo Deus

As technology increasingly becomes integrated with our daily lives, we rely on it more and more to make decisions for us, from things such as how we should get from one place to the next (Waze), to what we should have for dinner (yelp, tripadvisor), to what content we should see on the internet (social media), to who we should date (dating apps). What would a future feel like when all of our decisions are made by these machines? The self-driving human simulates this scenario by making choices for the human in areas that are currently not decided by technology.

Basic decision the device can make
Basic decision the device can make

It’s a portable device that detects objects around the person using a camera and machine learning, and gives commands to the user on how to interact with the environment. How do the choices made by the algorithm collide with the humans desires when they’re disconnected from the biases and emotions of that the person has learned throughout his or her life?

Hand-held prototype
Hand-held prototype

The device is portable and works totally offline using machine learning on the edge, allowing for real-time response even where there is no internet connection, and maintaining privacy as all data stays on the device.

It can fit into a fanny pack with a spy camera observing the environment
It can fit into a fanny pack with a spy camera observing the environment

For the performance it is carried by me in the real world, where I listen to its commands and attempt to do as we’re instructed, no matter how uncomfortable it makes me.

Context

This thesis is heavily influenced by previous performance art pieces where someone was given instructions by a piece of technology or a human to perform. These include: Nicole He’s The Best Art, where a machine generated art projects for her to make, Anastasis’ The Sybil Society, where identities and conversations were created and performed by people, Lauren McCarthy’s Social Turkers, where she would go on daily online dates and be instructed by human Mechanical Turk workers on what to do and say, and Max Hawkin's Randomized Living, where he lets randomized computer programs decide where he lives over two years. It’s also influenced by projects that explore the subjectiveness and black-box nature of machine learning algorithms, such as the Normalizing Machine by Mushon Zer-Aviv , Dan Stavy and Eran Weissenstern, in which participants attempt to identify who looks normal from previous participants and a machine analyzes these decisions and adds them to its aggregated algorithmic image of normalcy, and So Kanno and Yang02 ‘s Asemic Languages, in which a robot invents and draws new characters that look as if they are important, but in reality are purely aesthetic, showing that a robot only knows what it has been taught.

There have been lots of writing around these subjects that I’ve read. About decision making and choice, Thinking, Fast and Slow by Daniel Kahneman explores the two systems of the mind and their affects on our decision making and choices - this book revealed to me the massive amounts of decisions we make and are not aware of, and how they are influenced in different scenarios. Algorithms to Live By by Tom Griffiths and Brian Christian explore how algorithms used by computers, can be applied to human decision making. Essays in 25 Way of Looking at AI were hugely influential, including the Purpose Put into the Machine by Stuart Russel, which discusses purposes that humans put into machines and the failure when the machine’s objectives differ from our own. Homo Deus by Yuval Harrari was the largest influence for me to dive into this thesis, in particular this quote: “Every day millions of people decide to grant their smartphone a bit more control over their lives… In pursuit of health, happiness and power, humans will gradually change first one of their features and then another, and another, until they will no longer be human.”

Photos

Initial prototype
Initial prototype
Version of the device with the camera attached directly to the enclosure
Version of the device with the camera attached directly to the enclosure
Asking: 'how's your day going' to a barista
Asking: 'how's your day going' to a barista
What should I do in a bar?  Let's compare the Classic Dan vs. the New Self-Driving Dan as instructed by the device.
What should I do in a bar? Let's compare the Classic Dan vs. the New Self-Driving Dan as instructed by the device.