2016 What does it mean to feel 47% happy and 21% surprised? "Choose how you feel; you have seven options" is a video work that revolves around this question as it looks at software that derives emotional parameters from facial expressions. It combines human accounts and algorithmic processing to examine the intersection of highly cognitive procedures and ambiguous experiences. Born from a fascination with the technological achievements, the work interrogates the discursive apparatus the software is embedded in.
This work builds on my research into the workings of expression analysis technologies and the assumptions that underlie it, scrutinising the claims that are made by the companies developing the software.
The research is published as a longform by The Institute of Network Cultures.
3 projections, 9′09″ (∞ loop).
In collaboration with Cristina Cochior I went manually through the Eye's public collection, and catalogued faces by surrendering them to an emotion detection algorithm. Cutting from one face to another,its uncritical selection produced a new portrait of emotional gradients moving in-between anger and happiness.
This project was part of the Piet Zwart Institute ResearchLab at the Eye Film Museum in Amsterdam and was exhibited there from 12th April - 24th April. The exhibition focussed on the boundaries of the archive. Studying the structures and cultural impacts of our media technologies, it concentrated on the intricate and usually hidden aspects of EYE's extensive archive.
Single projection, 11′32″ (∞ loop).
Emotion recognition software is being used both as a tool for ‘objective’ measurements as well as a tool for training one’s facial expressions, eg. for job interviews. Emotion Hero is a literal translation of the paradoxical relation between these applications of the technology.
Emotion Hero is a two-part artwork. On the one hand is a video-game that is freely downloadable for everybody with an Android device (see Google Play). Inspired by Guitar Hero, the user scores points by following given cues. It provides detailed feedback on the mechanics of the face (eg. “You showed on 10% Joy when you had to show 100%, smile 99.32% more.”), revealing that rather than being a window into the brain, the face is a controllable surface.
The second part is a projection that shows the aggregated scores of the game. In order to substantiate their discourse, companies in facial expression measurement employ a huge amount of data collection and processing. The results are displayed in a fixed grid, recalling historical practices that, trough extensive measurement and administration, also aimed to delineate something which is conceptually undelineated: think of Duchenne de Boulogne, Lombroso, and Charcot.
Emotion Hero is a playful invitation to open up the box of expression analysis to reveal the assumptions that underlie this technology.
The game's emotional intelligence is powered by Affectiva (I was also interviewed by them). This project is produced as part of the Summer Sessions Network for Talent Development in a co-production of Arquivo 237 and V2_ Lab for the Unstable Media, with support of the Creative Industries Fund NL.
It has been exhibited at the State Festival 2016 (Berlin, DE) and Digital <Dis>orders (Frankfurt, DE).
By layering and contrasting different news elements The Spectacular Times re-contextualises news and makes explicit the intangible notions that lie beyond an increasingly universal guise of news reporting. Not in an effort to tell apart true from false, left from right, or right from wrong, but in order to accentuate a variety of articulations of news.
This web based project uses user defined variables to animate news headers, texts and images, which are directly sourced from different news websites world wide. By adjusting these parameters (among which region, scope and speed) the spectator actively perceives how news content is de- and reformed through its aesthetics.
2015 In western society, images are generally perceived as objective traces of events. As evidence that things happened as how they are captured in the frame.
As Susan Sontag elaborates, this counts for photographic images in particular. They are seen, not as subjective statements about the world, but rather as pieces of it —as fragments of a reality. Photographic images are often seen as unbiased; they carry in them the "burden of truth". We use them to give meaning, to asses and to judge. It exactly is in this passivity of the image, that its aggression lurks.
Fragments of Reality is a newspaper that assembles descriptions of five images of one event: a press conference with Jeroen Dijsselbloem and Yanis Varoufakis. Each interviewee was shown one of the images, in an attempt to highlight how we read events trough photographs.
It considers an event not as a single factual moment, but as the cumulative of subjective experiences, inherently proposing that an image is always lacking in its representation of that which it presents.
It was part of the exhibition Encyclopedia Of Media Objects, organised by the Piet Zwart Institute and held at the V2_ Institute for unstable media in June 2015.
2013 Adam is security guard at a nursing home with comatose patients. During his night shifts he has unsettling visions of someone drowning. He seeks his comfort in the company of his pregnant girlfriend. Days of Water is a story on guilt and shame; and on a longing for hope.
I wrote and directed this film for my graduation as film director for fiction at the Utrecht School of the Arts.
It was accompanied by research on spectatorial emotion and the influence of emotions on the spectator's sympathy for the protagonist.
2012 For the visitors of the Crossing Border festival in The Hague we desgined an installation to collaboratively contribute to a poem.
Based on the input of the user, a sentence is added to the poem, originating from digitalised texts of artists participating in the festival.
The text was combined with an audiovisual presentation that changed depending on the user's input.
More info is available at the project website.
2012 The Colour of Blue. A diptych about two Tanzanians: a miner and a lobster fisher. How do they live, work and survive; and how do they see their own future? Each of the two men is in his own way depending on nature, everyday gambling for a good catch.
This documentary was shot complementary to our work at the Kilimanjaro Film Institute in Arusha.
Documentary, 14′42″. The full film is available on Youtube.
2010 A short HKU project on the future of social media, when it was still an upcomming phenomenon. It is made in two weeks for a series of shorts with a given start and ending image.
We asked ourselves: what happens if our online identity lives on after we die? Do we still live on if a part of our online identity does? How can this virtual identity be shaped?
2′10″, available on on YouTube.