The Prompt in Interactive Fiction and AI Art | 2132

S04E32

Sketching out some ideas around the relation between the shared indistinguishable surface of interactive fiction games and using GAN’s to create art. What comes out when I put this thing in? 

Full Show Notes: https://www.thejaymo.net/2021/08/28/301-2132-the-prompt-in-interactive-fiction-and-ai-art/

Watch 301 on youtube: https://www.youtube.com/c/jayspringett

Support: https://thejaymo.net/support/
Webshow: http://comeinternetwith.me
Website: https://www.thejaymo.net/

Permanently moved is a personal podcast 301 seconds in length, written and recorded by @thejaymo


The Prompt in Interactive Fiction and AI Art

One of my earliest computing memories is the arrival of a strange beige box with keyboard. An BBC Acorn.

My Mum was a teacher and had borrowed it from her school for half term. I canโ€™t remember which Uncle came round and showed me how to use its magics. Insert the 5 ยผโ€ floppy, type some strange summoning incantations written on a piece of paper. Hear the clicks and wurrs from the disk drive and โ€ฆ a world would arrive.

Go north, Go west. Pick up Gold Bar, Look At Room, Open Door. 

I have no clue how old I was. Well before I got to use an RM window box machine at my primary school definitely.

First contact with the command line was also first contact with Interactive Fiction. I mentioned IF last year in the episode โ€˜Rooms As UX Metaphorโ€™ and since then I’ve continued to read around the subject. The excellent podcast Game Studies Study Buddies recently did an episode on Mary Ann Bucklesโ€™ 1985 dissertation โ€˜Interactive Fiction: The Computer Storygame โ€œAdventure.โ€โ€™ 

Inspired, I’m finally reading Nick Montfortโ€™s 2005 book: โ€˜Twisty Little Passages: An Approach to Interactive Fictionโ€™.

I have thoughts, let’s sketch them out.

As mentioned back in Episode 21-29 I’ve also been playing with AI image generation. Most recently CLIP Guided Diffusion and CLIPIT Pixel Draw. If you follow me on Twitter you might have seen some of the results I posted.

“The Forest City At Night” – CLIPIT PIXEL DRAW 500 Iterations

The more I use these tools, the more I experience a little of what K Allado-McDowell described in conversation with Mat and Holly on interdependence.fm last year. When they were talking about their experience of co-writing their book Pharmako AI with GTP-3. To work with a neural net and its outputs is like spelunking or steering a boat under its own power. Like walking through dark hallways or moving through symbolic space.

You put in a prompt and see what unfolds.

This of course is similar to engaging with interactive fiction. In both cases one is embedded within a system that has a model of the world. 

In the case of interacting with AI, outputs from a literal trained model. With interactive fiction, a constructed model by an author. With a structure, filled with records, objects, lists and associated procedures, methods, and functions.

Again, both of these worlds are accessed and interacted with at the command line. 

Can you see where I’m going here? A UX experience that rhymes.

Buckles wrote in 1985 that:

One of the fascinating aspects of Adventure is that the reader must figure out how the game and narrative works, i.e.

1. How to communicate with the computer/narrator
2. How to make moves

Interactive Fiction: The Computer Storygame “Adventure” by Mary Ann Buckles

As scholarly work developed, different terms to describe the person using Interactive Fiction programs emerged. Bucklesโ€™ Reader was first out the gate, but Operator, Player and User were all tried. In Twisty Little Passages Montfort settles on โ€˜Interactorโ€™. I like it too. A word as good as any to also describe the experience of using machine learning tools to create.

Once one has learnt to communicate with the machine, step 2 is to learn โ€˜How to make movesโ€™.

The 2011 book, โ€˜IF Theory Reader‘ contains a fascinating essay by Andrew Plotkin called โ€‹โ€‹Characterizing, If Not Defining, Interactive Fiction. It is about โ€˜The Interfaceโ€™ of IF.
The command line or parser is so tightly bound with the ‘Interactor’ and the game world that they are indistinguishable. The surface of the world.

Plotkin comes up with a working definition of IF as:

A game that is controlled by textual input, understood as its natural-language meaning (to some degree), and that provides a simulated game world, which behaves according to natural rules (to some degree). 

Characterizing, If Not Defining, Interactive Fiction โ€” Andrew Plotkin – IF THEORY READER

Anyone who has worked with CLIP should immediately recognise something of their experience in that quote too.

The most important part of creating any work with AI is โ€˜The Promptโ€™. What comes out when I put this thing in? 

The summoning words that set the world in motion. Some generative artists keep their best prompts to themselves. Over on the blog AI Weirdness, Janelle Shane recently showed examples of CLIP works generated in the style of Carmine Nottyors. An artist that doesnโ€™t exist, yet as a prompt, produces striking images. 

Prompt exploration is very much like the way an Interactor explores the literal and figurative grammars of a IF world.

Again as Buckles wrote in 1985:

โ€œThe reader’s interaction with the story extends to conversing with the narrator on a primยญitive level. To explore the cave and find the treasures, the reader must learn how to use its “hands and eyes โ€ฆ. The reader must learn how the author programmed the narrator to “think” and what kind of language the narrator understands.โ€

Interactive Fiction: The Computer Storygame “Adventure” by Mary Ann Buckles

Mat Dryhurst kindly sent me over the Promptist Manifesto by Johanezzz which is not currently on clearnet, but there is a line in there that struck me โ€œconcentrated on creating the potential for each artist to participate in the making of art.โ€ It is the participation thatโ€™s important here, returning Plotkin itโ€™s about using prompts to explore what is possible. 

At the surface of both AI models and IF world models is the command line. And as the Promptist Manifesto says โ€œTHE PROMPT MUST ALWAYS BE YOURSโ€

As I said, this is just a first sketch of an idea. But I have a hunch that there may be a lot of useful work and concepts to be found in the last 35 years of Interactive Fiction writing.

Watch


The script above is the original script I wrote for the episode. It may differ from what ended up in the audio due to time constraints.

If youโ€™d like to support this blog and its various projects, please consider making aย regular contribution here.ย It genuinely helps me keep things up and running, so thank you!

Prefer Email? ๐Ÿ“จ

Subscribe to receive new posts straight to your inbox!

Or subscribe to my physical mailing list from ยฃ5 a month


Leave a Comment ๐Ÿ’ฌ

Click to Expand

9 responses to “The Prompt in Interactive Fiction and AI Art | 2132”

  1. […] The Prompt in Interactive Fiction and AI Art […]

  2. […] The contents read like RPG text adventure inventories from interactive fiction. (see also, last week’s episode). […]

  3. […] Much of the detail in that episode came from research for my Solarpunk novel. And I also think the last three episodes have contributed something. Thoughts that have been rattling around for a long […]

  4. […] year on Permanently Moved I talked about the Prompt in Interactive Fiction and AI Art and the similarities between the […]

  5. […] my first tentative steps with AI models and image generators. I’ve had thoughts over the last 12 months. Recently Iโ€™ve come to the conclusion that the short term impact of these technologies are under […]

  6. […] people felt that Interactive fiction specifically meant the exploration of nonlinear narratives via a command prompt using natural language processing. The co-creation of the story space rather than an exploration of it. Like in 1975’s Colossal […]

  7. […] Encountering new human computer interfaces and computational forms have always been weird. See Episode 2132 on Interactive Fiction and AI Art for example. […]

  8. [โ€ฆ] From the command line, or parser a user can abracadabra new things into existence. The same interface allows a user to not only explore a world, but create it. Very much like the AI interfaces of today. [โ€ฆ]

  9. […] Latest Innovations and Promising Future and the video version of the Permanently Moved episode The Prompt in Interactive Fiction and AI Art is prominently embedded at the top of the […]

Leave a Reply

Your email address will not be published. Required fields are marked *