TuringGaia @Meta.Morf 2024 | Trondheim

TuringGaia is the title of the umbrella Artistic Research PhD project and refers to a speculative scenario where the biosphere and technosphere have reached a profound state of symbiotic interdependence. In this scenario the technosphere, contributes to Earth's self-regulation alongside the biosphere. The TuringGaia project is divided in three chapters: a generative audio-visual installation, a performance, and the final chapter is a VR installation. Not all chapters have been developed yet, but below you can read and/or see the kernel of each chapter.

Entering ThermoDome | April 18 - August 18 2024

Keywords:
Mixed media installation, AI, Inworld.ai, Large Language Models, GPT-4, Gaming Engine

The first chapter is a generative installation, titled Entering ThermoDome that is on display during Meta.Morf 2024 four month period @Kjoppmansgate-Ung-Kunst. In this audio-visual installation the protagonist named Markov-NPC, an AI-driven Non-Playable Character (NPC) is embedded in a virtual ecological zero-player game. Markov-NPC is not only able to explore a virtual environment autonomously, it can also narrate and communicate its environmental journey and internal computational ‘experience’.

The long-term installation serves as an open-ended sandbox, where every day NPC-Markov faces different pressures of an environment under siege of a changing climate. It also collects data, such as pixel-based entropy, temperature, color variation, location-based events, perceived objects, etc. Markov-NPC has two main goals: reduce entropy in the environment, and collect money from its artefacts. These two simple goals seem straightforward but often present an existential conflict to the NPC, because the variables are entangled in the dynamic environment and depending on the temperature. The temperature of the environment is determined by the logistic . Tis means it can be constant, periodic or chaotic. The state of the environment and Markov-NPC's interactions can be followed by the visitor from day to day during the exhibition, as every day offers new possibilities and/or challenges. The effects of the climate and the changes Markov-NPC makes to the environment, are not only reflected visually, but can also be heard in the generative soundscape created by Øystein Fjeldbo.


Stage and Screen

Data Visualisation

Video of Markov-NPC

Screenshots

Entering ThermoDome @V2_ | September 21 - October 13 2024

Keywords:
Mixed media installation, AI, Inworld.ai, Large Language Models, GPT-4, Gaming Engine


Exhibition View Credit V2_

Exhibition View Credit V2_

Composing the ((Non)Human) | April 20 2024

Keywords:
Audio-Visual Performance, Touchdesigner, Gaming Engine


TuringGaia: Composing the ((Non)Human) is a 30 minutes audio-visual performance that explores ((Non)Human) agency through an AI-driven NPC within a virtual ecosystem. Central to this exploration is NPC-Markov, equipped with an advanced cognitive architecture that intertwines algorithmic interactions with environmental affordances, creating a complex audio-visual narrative on artificial agency and environmental engagement. The performance connects to an NPC in a Gaming Engine (UE5). The NPC operates in a zero-player game as entropy mitigator of a virtual world under siege of a chaotic climate, offering a metaphorical take on survival tactics amidst the climate crisis, highlighting themes of adaptation and resilience. A Large Language Model (Inworld), acting as a meta-narrator, deepens this narrative, expressing NPC-Markov’s explorations and reflections through a synthetic voice (Elevenlabs). By blending the footage generated by NPC-Markov with advanced audio techniques, Composing the ((Non)Human) crafts a dynamic narrative that evolves in real-time, showcasing the fusion of digital storytelling, gaming environments and soundscapes.

Photo Juliane Schütz.

Photo Juliane Schütz.

Photo Juliane Schütz.

Excerpt

Markov's Umwelt (Images coming soon) | August 11 - September 22 2024

Keywords:
Audio-Visual VR Installation


(Epilogue) Turing Gaia: Markov's Umwelt (TG|MU) represents the concluding chapter of the Turing Gaia artistic research project. This immersive audio-visual VR installation, was exhibited at the Science Centre Trondheim, alongside the installation Turing Gaia: Entering Thermodome (TG|TD) and the performance Composing the ((Non)Human), both presented at Kjøpmannsgata Ung Kunst. Markov's Umwelt transports participants into the Thermodome, a virtual ecosystem grappling with the effects of climate change. The virtual reality installation invites the audience to position itself in the Umwelt of Markov-NPC. Not as a distant viewer, as in the installation TG|TD, but immersively, offering the audience to take control, an navigate Thermodome to experience the heat dominated environment.

Photo Martinus Suijkerbuijk.

Photo Martinus Suijkerbuijk.

Screenshots.