... in art

Towards an auto-generative Public Domain?

A couple of days ago,  I came across the website generated.photos (via the Verge) a new service that offers 100.000 computer generated portrait images and positions them as an alternative to traditional stock photos. The Verge article highlights the fact that the pictures can be used “royalty free” and the generated.photos website claims that “Copyrights … will be a thing of the past”. This made me postulate on twitter that we might very well be witnessing the emergence of an “auto-generative public domain”.

It has since become clear that the creators of generated.photos do not intended to contribute the output of their algorithms (or for that matter the algorithms themselves) to the public domain: By now the website has been updated to note that the images are available for non-commercial use only. A new terms and conditions page states that “Legal usage rights for content produced by artificial intelligence is a new, largely unknown domain” only to go on to list a number of restrictions on the use of the “materials and software” made available on generated.photos.

As noted in the terms of conditions the copyright status of images (and other types of artworks) that are autonomously created by AI-powered software is largely unsettled. As Andres Guadamuz notes in his excellent overview post on the topic, there are generally two schools when it comes to the question if computer generated artworks are (or should be) protected by copyright. One school argues that copyright protection only attaches to works that have been created by humans and as a result computer generated artworks can by definition not be copyrighted. The other school points out that such works are not created without any human intervention (someone needs to start up the software and set basic parameters) and that whoever initiated the generation of these works should be considered the creator and receive at least a minimum level of (copyright) protection as a reward for their investment.

In the case of generated.photos it is evident that the people behind the project have made a considerable investment into the project. The website states that they have shot more than 29.000 photos of 69 models that have subsequently been used as a training set for the software. Judging by notes on their website, the 100.000 images made available on the website have been created using the open source generative adversarial network StyleGAN that is freely available via GitHub. It remains to seen if creating photos (which are copyright protected) that are then used to train a out of the box GAN does indeed mean that the output of the network is (a) protected by copyright and (b) that the copyright belongs to the entity that trained the GAN.

While it seems to be at least possible that the creators of generated.photos do have a legitimate copyright claim in their output, that does not necessarily invalidate the idea that we are witnessing the emergence of an auto-generative public domain, i.e circumstances in which computer algorithms produce a (possibly endless) stream of artworks, that are indistinguishable from human created works and that are free from copyright and can be used by anyone for any purpose.

In terms of quality, the images provided by generated.photos are still far from indistinguishable from human made stock photos, but it is clear that it is only a matter of time before the technology gets good enough to produce high enough quality outputs at scale. Projects like the next Rembrandt illustrate this development is not limited to stock photography but will likely happen across the full width of human creative expression.

The future: AI driven on demand creation of visual assets

Such a development would dramatically upend a large number of creative professions. It seems like it will only be a matter of time before stock photography and other forms of creative work where the primary draw is not the specific style of a particular creator will be replaced by AI-generated output that will cost almost nothing to create. Once AI powered systems will be able to deliver high quality creative output at zero marginal cost the question if these outputs are protected by copyright or not will be largely meaningless (a single system releasing its output into the public domain will render any attempts to enforce copyright futile).

From the perspective of those making a living by creating stock photos, background music and other forms of creative work that is about to be eaten up by AI, the emergence of this “auto-generative public domain” must feel dystopian. Under these conditions the primary question that we must ask ourselves is not how we can fit works created by computer algorithms within the framework of copyright law. Instead we should ask ourselves how we can create the conditions for human creators to leverage these technologies as tools for their own creative expression. Instead of mourning a future in which humans are no longer employed to shoot endless variations of the same stock photos, we should look out for entirely new forms of creative expression enabled by these tools.

© Piet Mondrian, 85 Waterloo Street Warrenton VA 20186, USA

15 Oct 2018 | 863 words | copyright art united states business travel

On the 16th of July 2015, a couple of hours before flying back to Amsterdam i rented a car in downtown Washington D.C and drove for a about an hour to Warrenton, VA to take a photo of a residential property located on one of the main thouroughfares of the small town:

85 Waterloo Street Warrenton VA 20186, USA

So what triggered my interest in this rather unremarkable building in an unremarkable town? The house on Waterloo Street was home to HCR international, a company that since 1998 has been managing the copyright in the works of the Dutch born artist Piet Mondrian (1872 - 1944). As a result the name of the company featured prominently in the copyright notices alongside reproductions of the works of Mondrian on Museum websites and exhibition catalogues all over the world.

I had developed an interest in HCR international when we were working on the “Wiki loves Art/NLpublication in 2010. During the work on the book i became aware of the somewhat dubious reputation that a certain Hillary Richardson (presumably the H and the R in HCR international) had among museum curators who dealt with works by Piet Mondriaan. Apparently Ms Richardson was rather demanding when it came to providing permission for preproductions of Mondrian’s works. Not only was she known for asking high royalty rates (see this 2015 NY Times article for examples), she was also known to be very specific with regards to the copyright notices. According to a 2011 art magazine article, HCR generally demanded that copyright notices are placed vertically alongside any reproductions, that Mondriaan name must be written with one ‘a’ (the original Dutch spelling is with ‘aa’). Evidence from around the web also seems to indicate that she insisted that HCR international is named in all copyright notices.

So how did the copyrights of the most famous 20th century artist from the Netherlands end up in a residential house in Warrenton, Virginia? Like many other artists from continental Europe, Mondriaan had to flee from the Nazis. During a short stay in Paris in 1934 he became friends with the American artist Henry Holtzman. In 1940 Holtzman arranged for Mondrian’s passage from London to New York City, where he rented an apartment-studio for Mondrian. During the next three and a half years he was one of Mondrian’s most intimate associates.

When Mondriaan died of pneumonia in 1944 he willed his estate (including the copyrights) to Holtzman. Holtzman continued to live for a considerable period but eventually died in 1987. His estate, including the Mondriaan copyrights, fell into the hands of his three children, who set up the Mondrian/Holtzman trust. In 1999 they hired the art historian Hillary Richardson to manage the copyrights on behalf of the trust and, as a result, from 1999 onwards HCR international managed Mondriaan copyrights from the House in Warrenton, VA.According to its website (2015 version), the Mondrian trust…

… aims to promote awareness of Mondrian’s artwork and to ensure the integrety of his work. We intend to carry forward his legacy and influence a new generation of artists by managing and encouraging copyright use for Mondrian’s artwork. The trust grants licenses and copyright permissions to those whishing to reproduce Mondrian’s images.

In reality, as evidenced by the way that Ms Richardson operated, it is fairly clear that HCR international was not primarily concerned with Mondrian’s artistic legacy and integrity but rather interested in bringing in licensing revenue. In an email exchange between Ms Richardson and me in 2010 she declined an to contribute to our publication because “Mondrian is keeping me very busy!”.

Things changed when the Mondriaan copyrights expired on the 1st of January 2015. When i contacted Ms. Richardson again in early 2015 to see if she would be willing to talk about how  the fact that Mondriaan’s work was now in the Public Domain, she declined pointing out that because of the expiration of the Mondriaan copyrights, she was no longer working for the trust:  

Dear Paul Keller, Thank you for your inquiry. Due to the expiration of Mondrian’s copyrights worldwide–except for many in the US and in Spain, I decided not to renew my contract with the Mondrian Trust for the limited rights. That has given me the opportunity to consult for a producer of educational art apps and to use myart historical background researching works in private collections here in Washington, many of which span several centuries and cultures. They are new and rewarding challenges after 16 years working withMondrian’s incredible images …

That email was singend off with a new adress for HCR international:

HCR International 4100 Cathedral Avenue Washington DC

So when i visited the house on 85 Waterloo street in July 2015 both the Mondriaan copyrights and HCR international were no longer residing there. Still, looking at the house on that hot summer day, I could not stop but wondering how Mondrian, the 20th century icon of modernist abstract art, would had felt knowing that more that half a century after his death his copyright would be administered from a small residential property in rural Virginia.

More pictures of the house and Warrenton, VA in this flickr album

CARNE Y ARENA

06 Dec 2017 | 907 words | art exhibition review vr migration mexico united states

In retrospect the whole process of actually getting to experience Alejandro G. Iñárritu’s situated VR installation CARNE Y ARENA at the Fondazione Prada in Milano now looks like a privileged white man’s version of what the protagonists of the installation have gone trough: The almost overwhelming uncertainty if i would ever manage to get there (the result of overwhelmed web servers that could not keep up with the demand for the microscopic amount of tickets available), the realisation that a group only travels as fast as it’s weakest members (an object lesson taught by a group of Filipino women who boarded the flight to Milano with way too much carry on luggage causing the worst boarding mess that i ever experienced) and the ability of those whom you have entrusted with your fate to extract extra compensation (the taxi diver who needed to be bribed into accepting payment by credit card).

While CARNE Y ARENA is primarily described as a possibly genre-defining Virtual Reality experience, the actual VR element (as in the 3D environment projected through the headset) is probably the least interesting bit of it, even though the cinematography is stunning and the choreography of the actions unfolding around you is equally master-full.

Rather it is the use of the supporting sensory triggers that both makes and breaks the illusion created by the VR headset (the whole experience was probably helped by the fact that as a result of my hurried attempts to get there in time i was thirsty for the duration of the experience): The coldness in the holding cell crates a feeling of being out of control that primes you for the desert scene. The cold, rough desert sand and the unidentifiable scent immediately situate you in the desert. As long as you are “alone” in the desert (and later during the helicopter overpasses) the wind machines complete the illusion created by the VR headset.

Once the exhausted migrants appear the illusion starts getting strained. For me this had little to do with the the fact that they were clearly identifiable as rendered characters (as the Verge complains), or even the fact that you could walk into the characters (according the NYT review this seems to be a feature that i did not recognise as such) but rather the fact that i was unable to physically relate to them within the parameters of the simulation. As the group came under attack by the border patrol my urge was to get closer to the other protagonists and to somehow protect or comfort them. But my attempt to hold on to the foot of a frightened child broke the simulation as there was noting to touch and no-one i could comfort.

In the end the very limitations of the simulation amplify the message. Regardless how much i wanted to identify with the the harassed group of migrants, and as much as i experienced the sensory overload of being alone in the dark desert at the mercy of armed men, the limitations of the technology reminded me of my real status as a distant observer. That divergence between your desire to relate, fuelled by the state of the art manipulation of your senses and your inability to completely escape your situated-ness in the real world creates (or at least it created for me) a very profound understanding what it means to be the other (in this case one of the migrants).

Contrary to what i had expected it is not the technical perfection of the installation that constitutes the empathy machine, but the fact that you are reminded that you are indeed only “virtually present” that delivers the message. As confronting as the last scene, where the simulation finally acknowledges your presence and the border patrol officer approaches you shouting and with his assault rifle aimed at you, may be, it was the fact that i could simply leave that brought home the point that for the migrants this option does not exist.

Still, leaving the desert scene left me shell shocked and i spend a long time watching the video testimonials of the migrant protagonists in the decompression room that constitutes the last part of the experience. It is impossible to tell if these were so captivating because of the state i was in or because of the fact that i was alone with them or because of the accomplished videography and performance or because of all of these aspects combined.

In the end the most interesting question is how this way of story telling can ever scale in any meaningful way. The way it is set up in Milano (individual 15 minute slots) the total capacity is somewhere around 5000 visitors in half a year. There are currently 3 instances of CARNE Y ARENA (the other ones are im Mexico City and in Los Angeles) which seems utterly insufficient to reach anyone beyond a very determined part of the global cultural elites, who are likely the ones who are least challenged in their belief systems by the urgent social message encoded in this technological masterpiece. It is not me who needed the exposure to the desperate realities of migrants fighting for their dignity under the conditions of massive global disparities, rather it is someone my above mentioned taxi driver (who was not even aware of the fact that the Prada foundation is a Museum and not the seat of the eponymous luxury goods company).

1 plus 8 - the room is a map of the territory

07 Apr 2013 | 300 words | algorithms art exhibition review travel

Yesterday we saw 1+8 at the opulent Galata branch of SALT. 1+8 is a dynamic eight-screen video installation about Turkey and her eight neighbours based on the feature film of the same name directed by Cynthia Madansky and Angelika Brudniak. I usually do not have much patience for video installations but 1+8 managed to capture my attention for quite some time. If you are to believe the catalogue text this thanks to an the brilliance of a ‘custom made algorithmic computer program’ powering the display:

“The installation invites the audience to become immersed in the contemplation of life at the eight borders of Turkey. The multi-screen projection lends itself to experience simultaneity and inter-connection on a physical level. The choreography of video’s on the eight screens, is created dynamically with the help of a custom made algorithmic computer program allowing for a unique viewer experience, whereby the projections will never appear the same way twice.”

Not sure in how far the algorithm contributed to my enjoyment here. Being a bit obsessed about maps i was much more delighted by the way the room (a large rectangle) was used as a map of the territory, with the videos projected on those parts of the wall that correspond with the actual borders between Turkey and its eight1 neighbours (this of course only works with a country like turkey which is an even bigger rectangle):

turkey in a box

Also, it appears that the border regions between Turkey and its six Asian neighbours are really fascinating/beautifull which makes me want to travel there at some point in the future


  1. One of the things learned here is that the Turkish consider the Autonomus Repubic of Nakhchivan a neghbouring country (which – it should be noted – has the tiniest possible border with Turkey). ↩︎ ↩︎

The internet giveth and the internet taketh away (piracy edition)

02 Sep 2012 | 295 words | art music piracy technology

Turns out that theverge does music reporting of sorts. their recent history of dubstep music (‘beyond lies the wub‘) contains two short passages that highlight the impact of digital technology on art (in this case dubstep music).

The first passage highlights how digital piracy killed the music industry might have actually driven the quality of music production in the past dececade or so:

“They cost nothing if you know how to get them for free, which most people did,” says Martin Clark. “The VSTs [Steinberg’s audio plug-in architecture] were available on peer-to-peer sites. So suddenly it’s democratized, right? You have zero cost to acquire a studio. You have this like, infinite [potential]. Anyone can be a producer if they can get a hold of these. From that pool you have a much larger pool to select who makes interesting music, as opposed to just who can make music. It’s no longer a question of whether you can make music, because the software is distributed, it’s accessible.”

On the other hand it seems that the same technology has also contributed to the decline of the very pirate radio stations which were once considered the backbone of London’s urban music culture. turns out that the same developments that allow pretty much everyone to become a producer, make running a pirate radio station a pretty silly exercise:

“It’s totally changed,” according to Boomnoise. “I mean, if you sit down at a computer with an internet connection, you can find pretty much anything you want to listen to, whether or not it’s in the radio format. And what happened was, I think with the internet was a shift from the local to the global, essentially, a shift away from having a very localized audience.”

Read the full article here

The jetlag society [one possible future for the book]

11 Jul 2011 | 296 words | art publishing books ebooks

the jetlag society unbound book

The Jetlag Society is one of the projects that was on display at the graduation show of the Sandberg Institute last weekend. The Jetlag Society consists of a video installation (on display in the rather amazing vondelbunker) and an unbound book (above).

“The Jetlag Society is an unbound book on how technology influences time, space and our synchronization with the world. While bound books have weight, smell and are above all tangible, it’s digital form can be quick changing and endlessly linked to other relevant information. The Jetlag Society is a name, a feeling and an unbound book that makes the idea feel timeless, interconnected and constantly in motion” (from the Jetlag Society, In • Preface 00’00”)

The unbound book consists of the front and back covers of a book that have been individually silkscreened. the actual text is available at at read.thejetlagsociety.net for online consumption and as an .epub or .mobi download. To access the text you purchase the unbound book which comes with login credentials (in the form of a silkscreened captcha) that enables you to access the content at the website).

I actually quite like the concept of making you buy a physical fetish like object that enables you to consume the the actual text on an e-reader of your choice. It makes me feel much less guilty when purchasing an ebook, gives you all the satisfaction that well crafted objects give you and maintains one of the most important properties of physical books: that you can pull it out of your shelf and show it to people when you refer to something in it…

The Jetlag Society is the final exam project of Sandberg students Brigiet van den Berg (NL), Nikki Brörmann (NL) & Simona Kicurovska (MK)

Stock trades, art and algorithms

26 Sep 2010 | 686 words | algorithms art economy future modernity technology

If you ask me one of the more fascinating things going on out there right now is high-frequency trading. High-frequency trading (HFT) occurs when traders program computers to buy and sell stocks (or other financial products) in quick succession under certain, pre-defined circumstances. (a good starting point to learn more about HFT is this planet money episode or this ai500 article by Joe Flood).

Apparently High Frequency trading enables successful trading firms to skim of enormous surplus off these transactions (up to 1 million USD per day according to the planet money episode mentioned above). Not surprisingly this behavior can also act as a destabilizing factor wrecking havoc on stock markets. It has been one of the contributing factor’s to the ‘flash crash‘ which saw the Dow-Jones index plunge nearly 1,000 points in seconds on the 6th of may 2010.

If you believe wikipedia (which of course you should not) High Frequency trading is currently responsible for 70% of the equity trading volume in the US. Needless to say the practice is generating a fair share of controversy among economists.

At the core of this controversy are the merits of HFT: does is make macro-economic sense (because it ensures the liquidity of markets and limits market volatility) or is it detrimental to the economy at large (because it extracts value from markets based on no other fact than that prices tend to move)?

While this debate is going on it appears that there are even stranger things occurring in the field of high frequency trading: in August the Atlantic reported on research undertaken by a market data firm called Nanex that unearthed trading patterns that do not seem to make sense even by the high obfuscation standards of HFT. The article in the Atlantic claims that these strange patterns are the result of ‘mysterious and possibly nefarious trading algorithms’ whose ways and reasons of operation are known to no-one:

Unknown entities for unknown reasons are sending thousands of orders a second through the electronic stock exchanges with no intent to actually trade. Often, the buy or sell prices that they are offering are so far from the market price that there’s no way they’d ever be part of a trade. The bots sketch out odd patterns with their orders, leaving patterns in the data that are largely invisible to market participants.

When you visualize this you get something like this (graphs by Nanex):

According to the Atlantic it is unclear what exactly causes these patterns to emerge. The Nanex researchers have come to the conclusion that these algorithms are most likely an attempt by trading firms to introduce noise into the marketplace in order to realize a competitive advantage:

Other firms have to deal with that noise, but the originating entity can easily filter it out because they know what they did. Perhaps that gives them an advantage of some milliseconds. In the highly competitive and fast HFT world, where even one’s physical proximity to a stock exchange matters, market players could be looking for any advantage.

On the other hand there are much more poetic explanations for the emergence of these patterns, that abandon the idea that these patters serve a purpose all-together:

On the quantitative trading forum, Nuclear Phynance, the consensus on the patterns seemed to be that they simply just emerged. They were the result of “a dynamical system that can enter oscillatory/unstable modes of behaviour,” as one member put it. If so, what you see here really is just the afterscent of robot traders gliding through the green-on-black darkness of the financial system on their way from one real trade to another.

Whatever they are, these patterns are also outright beautiful. The above visualizations remind me on the work of german artist Jorinde Voigt, who’s stunning drawings (pdf) often rely on algorithms as a source:

Konstellation Algorithmus Adlerflug 100 Adler, Strom, Himmelsrichtung, Windrichtung, Windstärke -Jorinde Voigt Berlin, Oktober 2007

p.s:Sara says that these stealth trading bots remind her of the tiger in Jonathan Lethem’sChronic City instead. p.p.s: Also just finished reading ‘the Fires‘ by the aforementioned Joe Flood. brilliant book, highly reccomended.

More ruralism and less urbanism

23 Nov 2009 | 73 words | art exhibition photos urbanism

Spend yesterday afternoon at the paris photo exhibition/fair in the über-horrible carrousel du louvre in Paris. The whole thing did not really live up to the hype (and the long queues) but fortunately there was one photo that made it worth having ventured into the belly of the cultural-industrial beast:

‘un poco de historia, la havanna, mayo 1971’ by José A. Figueora.

Bonus: services provided by Dr. Paul of Sese Island, East Afirica

Parallel infrastructures

Over the last year or so Sara (together with Suzanne Valkenburg and Eefje Blankevoort) has explored the world of vacation parks in the Netherlands. Many of these parks that had originally been designed for dutch families to spend their summer vacations have – over the years – attracted new types of temporary and permanent residents: Kenyan athletes competing for price money in dutch running events, Afghani refugees, African agriculture students, Dutch drop outs and polish contract workers and their families. Slowly these vacation parks have morphed into an almost invisible buffer zone, assigned to those people that mainstream society attempts to keep out of sight.

The website www.beloofdeland.org (‘het beloofde land’ (‘the promised land’) is the name of one of these parks) documents 5 of these vacation parks through video, text and photo’s, contrasting their current status with archival material from times when these places where the unchallenged territory of families on vacation. Installations based on this online documentary can be seen in the context of the Made in Arnhem exhibition (from 12 september until 25 october), in the Open Air Museum Arnhem (inside a 1950s vacation house by dutch architect Gerrit Rietveld – from 13 september until October 27th) and in De Verdieping in Amsterdam (from 26 september – October 4th).

Yellow suzuki swifts issued to polish temporary workers by their temp-working agency ‘Exotic Green‘ in front of vacation homes in Patersven/Zundert (foto: Suzanne Valkenburg).

Eye [gif animation]

28 Feb 2009 | 53 words | art technology work

Back during the dot-com craziness of 1999-2000 I worked as a gif animator for a while (at an outfit called interbrand in Amsterdam) and i still have a weakness for this particular form of art.

Today, != points to this wonderful example that is used as a background effect on the e-l-i-s-e weblog:

meanwhile... is the personal weblog of Paul Keller. I am currently policy director at Open Future and President of the COMMUNIA Association for the Public Domain. This weblog is largely inactive but contains an archive of posts (mixing both work and personal) going back to 2005.

I also maintain a collection of cards from African mediums (which is the reason for the domain name), a collection of photos on flickr and a website collecting my professional writings and appearances.

Other things that i have made online: