We mainly used ESP-32 microcontrollers and send the data with the OSC protocoll via Wifi to the Computer that is running Chatainge. Like:Īrmchair + scale + speaker = bossa nova chair (a chair that plays relaxing bossa nova music when somebody sits on it)īut you could easily come up with more elaborate contraptions by adding sensors and effectors to the object. We mainly thought about how to connect an object with a sensor and sometimes an effector. If you can not come up with smart objects you can take some inspiration from the ones we build, earlier in this Wiki. Let them sit in a chair, swing on a swing or step on a carpet. After all, the audience is on its own during your performance. Think about what a person would reflexively do, when prompted to interact with an object. For us it helped to not think to much out of the box when we where creating the objects.

Building those objects was a trial and error process. An armchair, a cup, a picture frame and so on. Thus our smart objects where mainly things you would find in such a room. Our performance was taking place in an living room type area. When the player collided with one of the relevant city’s marked by a flag the room atmosphere would change, in this new scene you could discover new story’s and elements depending on which city you where in.īecause the monitor we used displaying the Unity map was placed in a central spot of our finished demo, we decided to add some additional features to the map program such as playing back video files and a black screen which also could be triggered with OSC signals. By tilting the teddy forward you could accelerate the player model on the map and by pressing the belly of the teddy you could turn the player 90° clockwise. In our final presentation for example you could move the „player“ over the map using the gyroscopic inputs as well as the pressure sensor we installed inside a teddy bear. That way actions taken on the map could trigger outcomes in our physical setup or in reverse the input to our program could be made using the ordinary objects which had been outfitted with microcontrollers in our room. We used this Unity library to communicate with OSC signals with the Chataigne software. Unity’s 2D game engine made it easy to build a flat plain with an image of the wold map and much like a top down RPG-Game a player representing the object could explore the map. At one point in the performance a representation of an object was able to move over the world map to uncover past events in different Citys. We used the game engine Unity to create an interactive Map.

Casparcg after effects settings