New Cultural Technologies | 2231

The invention of ML tools is as significant as the printing press. These technologies will underpin the creative practice & economy of the 21st Century

Full Show Notes:

Watch 301 on youtube
Support the Show!
My Blog

Permanently moved is a personal podcast 301 seconds in length, written and recorded by @thejaymo

New Cultural Technologies

A year ago (Episode 21-29) I talked about my first tentative steps with AI models and image generators. I’ve had thoughts over the last 12 months. Recently Iโ€™ve come to the conclusion that the short term impact of these technologies are under estimated and under discussed 

In the last year alone things have gone from CLIP and VQ GAN running on Google’s Colab cloud compute platform. To DALLยทE 2, Midjourney, Dall-E mini etc. ML models are now household names.

Iโ€™ve been playing with Nvidia’s NeRF software recently. You take a bunch of photos of a location from different angles and it figures out a 3D model based on the set data. It’s wild. There’s also some code where you plug in a photo of a dog, and it spits back a 3D model. Itโ€™s not great, but it will be. 12 months. 

The speed and rate of development is staggering. Googleโ€™s Magic Eraser or Photoshop’s Content Aware are pedestrian. 

Articles at the moment are about the aesthetics of DALLยทE 2. Or discussing the copy and moral rights of the artist a model has been trained on. The open source community up in arms about Githubโ€™s copilot.

The problem is, these discussions are post quod. Much has been settled in law for decades. Sui Generis database rights were established in 1996, Copyright itself is an archaic idea from 1710

For me conversations about the training content of AI models are the same as the ones about our collective cultural imagination. Both ML models and the MCU are shaped by the same capitalist logics.

AI Models are complete worlds. Snapshots of The Culture.

Each one is different. Shaped by the preferences and biasโ€™ of the neural network used and the content it looked at. DALLยทE 2 is a complete world the same way Wikipedia is.

These models are a new substrate. Cultural technologies. 

Different models produce different images. Each has its own vibe, pallet, shape, quality. Regardless of the prompt. That’s CLIP, that’s Guided Diffusion, thatโ€™s Midjourny etc. 

AI models are like film stocks. Kodachrome vs โ€‹โ€‹Fujicolor Pro. 

A photographer’s style is as intangible as the filmstock they use. But until recently we wouldnโ€™t have dreamt of saying any of that should be under copyright.

Dan Hon, talking about style transfer in his newsletter recently said: 

You pay to have it [the model] create images in a certain photographerโ€™s style and, well, nobodyโ€™s stopping you from then using those images in whichever way you wish.

Replace photographer with artist, musician, fashion designer, architect whatever. The sentence still holds. 

We are in a really weird place in culture. In 2018 everything changed. The Blurred Lines lawsuit. 

The worst copyright decision ever made in history

Until 2018 the law was clear. A song is the: Chords, Melody, and Lyrics. Blurred Lines sounds nothing like Marvin Gaye’s Gotta Give It Up. But they feel the same. 

A jury of Pharellโ€™s peers thought this is something that can be owned. They judged that heโ€™d infringed on Gayeโ€™s vibe.

So now, apparently, you can own a groove. Or rather, own the copyright over how a song makes people feel.

Pharell, producing Blurred Lines, did style transfer.

Of course I have sympathy for photographers who find that the addition of their name in a prompt causes an image to look a certain way. But do we really want to live in a world where the style and vibe of a creative work is copyrightable?

Spawning from AI models is a totally different thing to sampling.

Holly Herndon has been banging this drum for years. We need to talk about this now before all the really crazy stuff arrives. She saw it all coming. 

Gregory Coleman is the most sampled musician in history. The drummer who played the Amen Break. Yet he died homeless in 2006 at the age of 62. This is a huge failure of copyright. The system is completely broken. 

Letโ€™s say that style is copyrightable. Letโ€™s think it through. 

Itโ€™s 1969. Coleman having just recorded with the Winstons picks up his sticks 

Tist Tist ta tss, tist ta tss. (Makes spang-a-lang noises)

Ah ah ahh. That’s swinging buddy. 

You canโ€™t do that. 

That’s been Kenny Clarkeโ€™s since 1939.

What does this mean for Reggae, trap, blues, folk? Whatever?

Post Blurred Lines, this is the world we are in already. Calls to remunerated artists whose names are style modifiers in prompts under the current system – is straight up right accelerationist.

The development of ML tools is as big a deal as the printing press. The technology that begat copyright in the first place. But models are a medium. They aren’t copied with paper and ink. New things emerge (are spawned) out of them.

It’s clear too, that these new technologies will underpin the creative practice and economy of the 21st Century. 

Over the next 20 years the creation of, and ownership of these new cultural technologies has to be redrawn. The entire framework. Culture, copyright, creative remuneration . 

But this future speculative paradigm will emerge out of the conversions and positions we take today. 

The current media environment encourages us to take sides. To develop coarse arguments based on reactionary headlines. The biggest cultural contribution anyone can make to benefit the artists of future, today. Is to develop a nuanced position. 

Think about the coarse arguments about sampling back in the 90โ€™s. Then think about Coleman dying homeless and alone.


The script above is the original script written for the episode. It may differ from what ended up in the edit.

If youโ€™d like to support this blog and its various projects, please consider making a regular contribution here. It genuinely helps me keep things up and running, so thank you!

Prefer Email? ๐Ÿ“จ

Subscribe to receive new posts straight to your inbox!

Or subscribe to my physical mailing list from ยฃ5 a month

Leave a Comment ๐Ÿ’ฌ

Click to Expand

6 responses to “New Cultural Technologies | 2231”

  1. […] and the official virtual store. This sort of infrastructure will be even more important in the new spawning paradigm brought about by imagesynthesis […]

  2. […] the developments in Permissive IPs, AI generation. my continuing engagement with Solarpunk, and other World Running endeavours: I am 100% convinced […]

  3. […] the type of world and reality that gets reflected back to us by mirror of culture. Another reason developments in AI are so important. Whats going on is a battle for control over the type of dreams we are going to have next after the […]

  4. [โ€ฆ] is a useful insight into how LLMs are currently being developed and used. Prompt engineering, weights and attention mechanisms are all constraining and [โ€ฆ]

  5. Jay avatar

    The Alms Race: The escalating development of product features providing direct financial plumbing (and community) tools to users occurring across the legacy Web2 ecosystem.

Leave a Reply

Your email address will not be published. Required fields are marked *