Third Sight-seeing

Third Sight-seeing: Aesthetic Adventures in Sensory Substitution – Myroslaw Bytz & Nick Heling

A presentation of an augmented reality technology, originally developed for the visually-impaired, which digitally reinterprets optical input into real-time, spatially dynamic sonic output. The talk presented a brief overview of existing implementations of these technologies which, while extremely promising as an adaptive sensory tool for the disabled, have not been widely explored for their potential to introduce new, synaesthetic perceptions of space into human experience. Then they demonstrated a Java/Android phone application that performs these functions, along with a homebrewed (duct-taped!), wearable contraption: a personal mobile interface consisting of a head-mounted camera, a configured netbook running specialized software, and headphones.

Full presentation: