Pater_Noster_2020

We can’t ignore the fact that this exhibition was initially six months earlier. The reasons are still pressing and urgent, and our world has changed significantly since then. Not only did we gain a novel genotype virus, but also our socio political world has reorganised under what proceeds as the New Normal. The latter is the unfolding paradigm under which technological surveillance, socio-geometric constraints of human interaction, biopolitical signifiers, border control and national lockdown rhythms have become prerequisites to mitigate the consequences and calamities of the pandemic. However, the existential questions that do emerge from the pandemic, are not answered by the disappearance of its consequences: if the present heralds a glimpse of what the New Normal will bring, is it the future we want? In response to the emergencies of the New Normal, this exhibition went through an update. The visitor finds itself present as subject and observer of a simulated surveillance state. In the exhibition facial recognition algorithms extract and compute emotional profiles of the visitors which are then processed into characters (BB_Worker) of a 3-channel gaming engine. An AI surveillance system displays, detects, calculates, and predicts the collective- and individual interactions of the BB_Workers. The gaming engine is an adjusted version of Joshua Epstein’s computational model of Civil Violence (2002).

The Exhibition

Keywords:
Artificial Intelligence, Unreal Engine, Surveillance Capitalism, Computational Social Science, GAN


Upon entering the exhibition the portrait of the visitor will be captured through facial recognition. From the collected portraits an emotional profile is generated through a facial expression recognition algorithm, but with full integrity to the anonymity of the subjects encountered. Only their emotional profile is captured and not their identity.
For the sake of testing purposes an AI generated portrait Stylegan2 is processed through the classifier.

3-Channel UE4 Engine, Generative Soundscape by Oystein Fjeldbo, Wood
Generative Soundscape by Oystein Fjeldbo
1-Channel UE4 Engine, Generative Soundscape by Oystein Fjeldbo, Jetson Hardware, PTZ camera
Wood
Aluminium Profiles, 1 channel Real-time surveillance stream

Facial Profiling


Upon entering the exhibition the portrait of the visitor will be captured through facial recognition. From the collected portraits an emotional profile is generated through a facial expression recognition algorithm, but with full integrity to the anonymity of the subjects encountered. Only their emotional profile is captured and not their identity.
For the sake of testing purposes an AI generated portrait Stylegan2 is processed through the classifier.

AI Generated Subject

Pater_Noster_2020 Snapshots

Keywords:
Evolutionary Algorithm, Unreal Engine, Agents, Blobs

All images below are screenshots of the simulation. The variety of BB_Workers are created with an evolutionary algorithm in Blender.

BB_Workers are expressions of the emotions of the visitors
Variation in expression

BB_Worker Surveillance

The gaming engine is populated with virtual surveillance cameras that are channeled through a 'deepstream' system that observes the collective behaviour of the BB_Workers. The Darknet AI framework is used and the YOLOV4 model is trained on a synthetic dataset.

Real-time detection in Gaming Engine
Custom made data-labelling game