Immersive interactive experiences
When the audience becomes part of the artwork
The context
Digital art centers want to go beyond classic immersive projection. They want visitors to interact with the artworks: touch a wall to reveal content, scan a drawing and watch it come to life, steer a virtual boat...
The challenge: creating experiences that work with 1 or 50 simultaneous visitors, no queues, no touchscreens, running 7 days a week with total reliability.
The projects
Light Stripes — Amsterdam
Interactive light strips reveal Klimt's works when visitors touch the walls. Laser scanner detection, real-time visual effects.
2 walls of 90 m², Leuze ROD4 sensors
Children's workshop — Paris & Hamburg
Children color paper drawings (boats, birds, dinosaurs...), then scan them. Within seconds, their drawing is detected, textured onto an animated 3D model, and appears on the immersive room walls. Their creation comes to life and roams through different worlds: Rousseau's jungle, a prehistoric world...
QR code scanning, real-time texturing on 3D models, LiDAR for touch interactions
Boat race — Hamburg
Alongside the drawings, an interactive boat race. Three physical ship bows equipped with encoders let children steer their boat on screen, navigate through obstacles, and reach treasure island.
TCP/IP encoders, real-time 3D physics engine
My mission
I designed and developed all of these interactive experiences:
Development
- •Full interactivity programming in Modulo Kinetic (Python/JS)
- •Creating real-time visual effects
- •Creating sound effects
Sensor integration
- •2D LiDAR calibration (Leuze, Hokuyo)
- •Scanner and encoder configuration
- •Testing and validation
Coordination
- •Interface between creative studios (Holymage, Spectre Lab) and Modulo Pi
- •Adapting artistic concepts to technical constraints
Installation
- •On-site deployment
- •Final calibration
- •Commissioning
The results
The complementarity between the artistic and the technical dimensions allowed us to achieve a result up to what we imagined. Modulo Kinetic offers advanced rendering tools that allowed us creating what we wanted.