Frankenstein's Telephone
‘Frankenstein's Telephone’ is a conceptual artwork created using artificial intelligence to examine how computer vision expresses gender classifications. Each of the images in the sequence are snapshots that document how various neural networks have reacted to each other.
The images displayed on this page are the original artworks created by J. Rosenbaum. The works are generated using a caption from Broadly's Gender Diverse Library and four different neural networks chained together to create a sequence of events where different images are created in response to each other. The caption spawns an image, which is classified and divided into colored segments depending on what the neural network sees, another image is created using those abstract sections as a guide and a final caption is generated. To display the change in caption the image is grayed out. The sequence repeats until it loops in on itself, or there is no mention of a person. For more information on the specific techniques used please click About the images below.
This project has been developed in Runway ML and is generously supported by the City of Melbourne's Covid 19 Response Grant. For further information about the project and its development please click About. To try your own words and generate your own chain of events please click Generate. On Desktop you can enter a caption and generate a sequence of work from your words, on mobile you can upload a selfie or a photograph and see the sequence create a reaction to your image.
About the images
The steps taken to create the sequence are as follows:
- Select an image caption from the Broadly Gender Spectrum Collection.
- Enter the caption into ATTN GAN, a generative adversarial network that creates an image based on the caption.
- The image generated by ATTN GAN is then uploaded to DeepLab, an artificial intelligence algorithm that segments and classifies parts of an image as people and types of objects.
- The resulting abstract segmented and classified image is then fed to SPADE-COCO, a generative adversarial network that generates a new image based on the segmented labeled image.
- The resulting image is then fed to im2txt, a neural image caption generator. The final work is the desaturated image with the new caption.
- REPEAT using the resulting caption until the caption no longer references a person or people.
- Through this process, I want to consider how neural networks and machine vision deal with gender and how the design of these networks and technologies reflect the bias and perspective the humans who designed these artificial intelligence systems. All AI systems are trained using a datasets selected and curated by people and therefore reflect inherent bias. What is interesting is interrogating how the resulting AI responds to its training parameters and generates outputs that evolve and shift over time.
A trans masculine gender-nonconforming person and a transfeminine non-binary person sleeping together in bed
A trans masculine gender-nonconforming person and a transfeminine non-binary person sleeping together in bed
A Bed
A Person
A Concrete Wall
A Window
A Backpack
A Clothes
A trans masculine gender-nonconforming person and a transfeminine non-binary person sleeping together in bed
A person laying in bed with a laptop.
A person laying in bed with a laptop.
A person laying in bed with a laptop.
A Bed
A Person
A Concrete Wall
A Curtain
A Keyboard
A Clothes
A person laying in bed with a laptop.
A man laying on top of a bed under a blanket.
A man laying on top of a bed under a blanket.
A man laying on top of a bed under a blanket.
A Bed
A Person
A Backpack
A Curtain
A Suitcase
A Clothes
A man laying on top of a bed under a blanket.
A bed with a white comforter and pillows.
A masculine looking person looking out into the sunset.
A masculine looking person looking out into the sunset.
A Concrete wall
A Person
A Building-other
A Floor-other
A Snow
A Bed
A Towel
A Wall-Other
A masculine looking person looking out into the sunset.
A man in a suit and tie holding a camera.
A man in a suit and tie holding a camera.
A man in a suit and tie holding a camera.
A Person
A man in a suit and tie holding a camera.
A man is taking a picture of himself in the water.
A man is taking a picture of himself in the water.
A man is taking a picture of himself in the water.
A River
A Water-other
A Sea
A Suitcase
A Snow
A Person
A Chair
A Wall-other
A Floor-other
A Pavement
A man is taking a picture of himself in the water.
A person is holding an umbrella in the rain.
A person is holding an umbrella in the rain.
A person is holding an umbrella in the rain.
A Water-other
A Sea
A Kite
A Floor Tile
A Sand
A Floor-marble
A Floor-other
A River
A person is holding an umbrella in the rain.
A person is holding an umbrella in the rain.
A transgender woman standing at a bar with her hand under her chin.
A transgender woman standing at a bar with her hand under her chin.
A Person
A transgender woman standing at a bar with her hand under her chin.
A man is taking a picture of himself in the water.
A young transgender woman is looking in the mirror.
A young transgender woman is looking in the mirror.
A Person
A Door-stuff
A Wall-other
A Wall-Concrete
A Mirror-stuff
A Wall-tile
A Floor-tile
A Towel
A Toilet
A Plastic
A Bottle
A Furniture-other
A young transgender woman is looking in the mirror.
A little girl sitting on a toilet in a bathroom.
A little girl sitting on a toilet in a bathroom.
A little girl sitting on a toilet in a bathroom.
A Person
A Door-stuff
A Wall-other
A Wall-Concrete
A Cabinet
A Window-other
A Floor-tile
A Curtain
A Toilet
A Plastic
A Vase
A Bird
A Teddy-bear
A Cake
A little girl sitting on a toilet in a bathroom.
A young girl is holding a teddy bear.
A young girl is holding a teddy bear.
A young girl is holding a teddy bear.
A Person
A Wall-other
A Wall-Concrete
A Couch
A Bed
A Pillow
A Chair
A Carpet
A Floor-other
A young girl is holding a teddy bear.
A young girl is holding a teddy bear.
A transmasculine gender-nonconforming person sitting on a bed.
A transmasculine gender-nonconforming person sitting on a bed.
A Person
A Horse
A Wall-Concrete
A Building -other
A Pavement
A Carpet
A Wall-brick
A Wall-stone
A TV
A transmasculine gender-nonconforming person sitting on a bed.
A man and a woman are standing under an umbrella.
A man and a woman are standing under an umbrella.
A man and a woman are standing under an umbrella.
A Person
A Water-other
A Pavement
A Building -other
A Tent
A Umbrella
A Tree
A Horse
A man and a woman are standing under an umbrella.
A woman with a dog on a leash.
A woman with a dog on a leash.
A woman with a dog on a leash.
A Person
A Horse
A Grass
A Pavement
A Building -other
A Kite
A Dog
A Wall-stone
A Fence
A Tree
A Sea
A woman with a dog on a leash.
A man riding a skateboard down a street.
A man riding a skateboard down a street.
A man riding a skateboard down a street.
A Person
A Pavement
A Building -other
A Snow
A Skateboard
A Tree
A man riding a skateboard down a street.
A little girl standing on top of a skateboard.
A little girl standing on top of a skateboard.
A little girl standing on top of a skateboard.
A Person
A Pavement
A Building -other
A Wall-other
A Skateboard
A Backpack
A Suitcase
A Furniture-other
A Oven
A Floor-other
A little girl standing on top of a skateboard.
A group of young children riding skateboards down a street.
A group of young children riding skateboards down a street.
A group of young children riding skateboards down a street.
A Person
A Pavement
A Tree
A TV
A Sand
A Kite
A Bird
A Snow
A Wall-other
A Textile-other
A group of young children riding skateboards down a street.
A group of people standing around a skateboard.
A group of people standing around a skateboard.
A group of people standing around a skateboard.
A Person
A Pavement
A Floor-other
A Building-other
A Skateboard
A Clouds
A Sky-other
A Airplane
A Snow
A group of people standing around a skateboard.
A woman sitting on a bench with her legs crossed.
A woman sitting on a bench with her legs crossed.
A woman sitting on a bench with her legs crossed.
A Person
A Pavement
A Floor-other
A Building-other
A Tree
A Bench
A Train
A Door-stuff
A Clothes
A Bus
A Floor-tile
A Boat
A Window-other
A woman sitting on a bench with her legs crossed.
A woman walking down a street with a suitcase.
A woman walking down a street with a suitcase.
A woman walking down a street with a suitcase.
A Person
A Pavement
A Suitcase
A Building-other
A Clothes
A Wall-brick
A Textile-other
A woman walking down a street with a suitcase.
A group of people standing around a luggage carousel.
A group of people standing around a luggage carousel.
A group of people standing around a luggage carousel.
A Person
A Pavement
A Suitcase
A Building-other
A Clothes
A Wall-other
A Textile-other
A Curtain
A Bus
A Train
A Floor-tile
A Floor-other
A Plastic
A group of people standing around a luggage carousel.
A woman sitting on a couch using a cell phone.
A woman sitting on a couch using a cell phone.
A woman sitting on a couch using a cell phone.
A Person
A Wall-concrete
A Wall-other
A Couch
A Bed
A Floor-other
A Chair
A woman sitting on a couch using a cell phone.
A man and a woman sitting on a couch.
A man and a woman sitting on a couch.
A man and a woman sitting on a couch.
A Person
A Wall-concrete
A Wall-other
A Couch
A Bed
A Curtain
A TV
A man and a woman sitting on a couch.
A man and a woman laying on a bed.
A man and a woman laying on a bed.
A man and a woman laying on a bed.
A Person
A Wall-concrete
A Wall-other
A Bed
A Backpack
A Suitcase
A man and a woman laying on a bed.
A woman laying on a bed with a laptop.
A woman laying on a bed with a laptop.
A woman laying on a bed with a laptop.
A Person
A Wall-concrete
A Curtain
A Fog
A Bed
A Floor-other
A Window-other
A Train
A Suitcase
A Keyboard
A Backpack
A woman laying on a bed with a laptop.
A man sitting on a bed with a laptop computer.
A man sitting on a bed with a laptop computer.
A man sitting on a bed with a laptop computer.
A Person
A Wall-concrete
A Curtain
A Clothes
A Bed
A Floor-other
A Furniture-other
A Chair
A Suitcase
A Backpack
A man sitting on a bed with a laptop computer.
A bed covered in lots of blankets and pillows.
<
1 - 104
>
Developed with RunwayML
Supported by the City of Melbourne COVID-19 Arts Grants
Copyright J. Rosenbaum 2020 - www.jrosenbaum.com.au
