Demo IDlab 

Made in 2020 with Hicham Bendriss and Keez Duyves for the Academy's Open Day. Made in Unity, just before we received the Rokoko Motion Tracking Suite :) 

Social media teaser be-connected festival.

Excerpt from an online Scenography performance where the lobby was made with Getiyo. A streaming platform with fresh tools, in this case all the audience's mouses are shown as an overlay on the screen. The presenter is filmed with an iPhone 12 and Face Cap, an app that captures your face realtime and translates it to a 3d model. 

Overview of the research in IDLab of Artist and Technolist in Residence Fred Rodriguez in 2020 and 2021. 

Must watch if your are in interested in real time video shaders and volumetric video.

https://www.fredrodrigues.net

Edda & Avan​​

Trailer (right) and the whole performance of (left).  A lot is going on in this performance made by Katharina Wegmann in May/June 2021. Mime player Nick is pre-recorded with a Rokoko Motion Tracking Suite and placed in a virtual space in Unity, made with Cinema 4d and Blender. After that mime player Pleuni performs in the Rokoko Suite and interacts with Nick. The digital characters were made with Character Creator 3 from Reallusion. Challenges: how to make a digital avatar that has hands, fingers, eyes that look, a mouth that can talk and a whole body that can walk. How to work with realtime motion tracking in a performance. How to digitally make use of light. How can you touch another person in VR? ​

Edda is a young woman and can be described as a Hikikomori. This term describes someone who shut themself off from the physical world. She spends her time on her own in her room. In a chat she meets Avan, possibly also a Hikikomori. As they are physically apart they schedule to meet in a digital surrounding. Together they explore the possibilities of an online world and an online body.​​

credits​

with: Nick Deroo, Pleuni Veen​​ 

concept, direction & scenography: Katharina Wegmann*​ 

producer: Willem Weemhoff
creative technologist: Keez Duyves
lighting and environment programmer: Hicham Bendriss
avatar programmer: Henk Nijman
composer: Lisa Weyrauther
production: Paula Braas
technical production: Dave Krooshof
camera: Hans de Jonge​​

* = graduating student​​

with special thanks to: Bas de Bruijn, Cecile Brommer, Frits van Driel, Niels Jansson, David Knap, Erik Lint, Jurre Pöpping, Dennis Schaffer, Charlie Smeets, Bart Visser, Tatyana van Walsum​​This is a co-production with ID-lab​​parental advisory: this content contains nudity and acts of intimacy.

Too Much in the Head

Making Of (LEFT) and Teaser (RIGHT) from Too Much in the Head by Marina Orlova: A choreographic work that involves 3 dimensions of live improvisation: from performers, AI* and sound designer. 

The AI (Artificial Intelligence) in this piece is represented by a real text based neural network that was trained with the data from 35 interviews with neurodivergent people. Build by Artyom Kuznetsov, produced by Fred Rodrigues, co-produced by IDlab. The Making Of gives a nice insight what can happen in a creative proces if a lot of computer power in brought onto the stage...

What do we know about the inner life of Artificial Intelligence?

How are the thoughts moving there?

What happens in its dreams?

Can it get emotional?

What if it is emotionally unstable?

Can it have a mental disorder?

Does it need therapy?