Spatial Instrument – a sensorial shift that makes you perceive space through sound.

This Augmented Reality prototype makes every object in your room play its part in an ever-changing soundscape – challenging your perception and understanding space.

A sensorial translation from sight to sound opens up a new perspective. An experiment to break up how we traditionally validate harmony and balance in interior design.

Machine learning and computer vision allow us to create a digital representation of a room, to recognise and catalogue individual objects.

In an Augmented Reality prototype, we are using this data for sound modulation and spatialized sound emitters, to create an interactive spatial instrument.

A digital 3D representation of space and depth allows you to read and understand your surroundings.

Previously, this kind of information required a custom setup, but having LiDAR in a handheld device, and computer vision AI that can recognise and catalogue individual items in the room, creates possibilities for new experiences.