S04E32
Sketching out some ideas around the relation between the shared indistinguishable surface of interactive fiction games and using GAN’s to create art. What comes out when I put this thing in?
Full Show Notes: https://www.thejaymo.net/2021/08/28/301-2132-the-prompt-in-interactive-fiction-and-ai-art/
Watch 301 on youtube: https://www.youtube.com/c/jayspringettSupport: https://thejaymo.net/support/
Webshow: http://comeinternetwith.me
Website: https://www.thejaymo.net/Permanently moved is a personal podcast 301 seconds in length, written and recorded by @thejaymo
Listen
Subscribe
Watch
Support the Show
Help keep things up and running
The Prompt in Interactive Fiction and AI Art
One of my earliest computing memories is the arrival of a strange beige box with keyboard. An BBC Acorn.
My Mum was a teacher and had borrowed it from her school for half term. I canât remember which Uncle came round and showed me how to use its magics. Insert the 5 Âźâ floppy, type some strange summoning incantations written on a piece of paper. Hear the clicks and wurrs from the disk drive and ⌠a world would arrive.
Go north, Go west. Pick up Gold Bar, Look At Room, Open Door.
I have no clue how old I was. Well before I got to use an RM window box machine at my primary school definitely.
First contact with the command line was also first contact with Interactive Fiction. I mentioned IF last year in the episode âRooms As UX Metaphorâ and since then I’ve continued to read around the subject. The excellent podcast Game Studies Study Buddies recently did an episode on Mary Ann Bucklesâ 1985 dissertation âInteractive Fiction: The Computer Storygame âAdventure.ââ
Inspired, I’m finally reading Nick Montfortâs 2005 book: âTwisty Little Passages: An Approach to Interactive Fictionâ.
I have thoughts, let’s sketch them out.
As mentioned back in Episode 21-29 I’ve also been playing with AI image generation. Most recently CLIP Guided Diffusion and CLIPIT Pixel Draw. If you follow me on Twitter you might have seen some of the results I posted.
The more I use these tools, the more I experience a little of what K Allado-McDowell described in conversation with Mat and Holly on interdependence.fm last year. When they were talking about their experience of co-writing their book Pharmako AI with GTP-3. To work with a neural net and its outputs is like spelunking or steering a boat under its own power. Like walking through dark hallways or moving through symbolic space.
You put in a prompt and see what unfolds.
This of course is similar to engaging with interactive fiction. In both cases one is embedded within a system that has a model of the world.
In the case of interacting with AI, outputs from a literal trained model. With interactive fiction, a constructed model by an author. With a structure, filled with records, objects, lists and associated procedures, methods, and functions.
Again, both of these worlds are accessed and interacted with at the command line.
Can you see where I’m going here? A UX experience that rhymes.
Buckles wrote in 1985 that:
One of the fascinating aspects of Adventure is that the reader must figure out how the game and narrative works, i.e.
1. How to communicate with the computer/narrator
Interactive Fiction: The Computer Storygame “Adventure” by Mary Ann Buckles
2. How to make moves
As scholarly work developed, different terms to describe the person using Interactive Fiction programs emerged. Bucklesâ Reader was first out the gate, but Operator, Player and User were all tried. In Twisty Little Passages Montfort settles on âInteractorâ. I like it too. A word as good as any to also describe the experience of using machine learning tools to create.
Once one has learnt to communicate with the machine, step 2 is to learn âHow to make movesâ.
The 2011 book, âIF Theory Reader‘ contains a fascinating essay by Andrew Plotkin called ââCharacterizing, If Not Defining, Interactive Fiction. It is about âThe Interfaceâ of IF.
The command line or parser is so tightly bound with the Interactor and the game world that they are indistinguishable. The surface of the world.
Plotkin comes up with a working definition of IF as:
A game that is controlled by textual input, understood as its natural-language meaning (to some degree), and that provides a simulated game world, which behaves according to natural rules (to some degree).
Characterizing, If Not Defining, Interactive Fiction â Andrew Plotkin – IF THEORY READER
Anyone who has worked with CLIP should immediately recognise something of their experience in that quote too.
The most important part of creating any work with AI is âThe Promptâ. What comes out when I put this thing in?
The summoning words that set the world in motion. Some generative artists keep their best prompts to themselves. Over on the blog AI Weirdness, Janelle Shane recently showed examples of CLIP works generated in the style of Carmine Nottyors. An artist that doesnât exist, yet as a prompt, produces striking images.
Prompt exploration is very much like the way an Interactor explores the literal and figurative grammars of a IF world.
Again as Buckles wrote in 1985:
âThe reader’s interaction with the story extends to conversing with the narrator on a primÂitive level. To explore the cave and find the treasures, the reader must learn how to use its “hands and eyes âŚ. The reader must learn how the author programmed the narrator to “think” and what kind of language the narrator understands.â
Interactive Fiction: The Computer Storygame “Adventure” by Mary Ann Buckles
Mat Dryhurst kindly sent me over the Promptist Manifesto by Johanezzz which is not currently on clearnet, but there is a line in there that struck me âconcentrated on creating the potential for each artist to participate in the making of art.â It is the participation thatâs important here, returning Plotkin itâs about using prompts to explore what is possible.
At the surface of both AI models and IF world models is the command line. And as the Promptist Manifesto says âTHE PROMPT MUST ALWAYS BE YOURSâ
As I said, this is just a first sketch of an idea. But I have a hunch that there may be a lot of useful work and concepts to be found in the last 35 years of Interactive Fiction writing.
The script above is the original script I wrote for the episode. It may differ from what ended up in the audio due to time constraints.
If youâd like to support this blog and its various projects, please consider making a regular contribution here. It genuinely helps me keep things up and running, so thank you!
5 Comments
Kill Time | Weeknotes | thejaymo
August 29, 2021 at 12:43[…] The Prompt in Interactive Fiction and AI Art […]
A Napster Moment For Collective Storytelling | 2133 | thejaymo
September 4, 2021 at 21:30[…] The contents read like RPG text adventure inventories from interactive fiction. (see also, last week’s episode). […]
This Week's Podcast | 2135 - thejaymo
September 20, 2021 at 18:12[…] Much of the detail in that episode came from research for my Solarpunk novel. And I also think the last three episodes have contributed something. Thoughts that have been rattling around for a long […]
'Making Moves' In DALL¡E mini | Weeknotes - thejaymo
June 20, 2022 at 18:43[…] year on Permanently Moved I talked about the Prompt in Interactive Fiction and AI Art and the similarities between the […]
New Cultural Technologies | 2231 - thejaymo
August 6, 2022 at 21:47[…] my first tentative steps with AI models and image generators. I’ve had thoughts over the last 12 months. Recently Iâve come to the conclusion that the short term impact of these technologies are under […]