The exhibition explores the creative tension and interplay between Sound and Image. The works showcased engage with possible ways of narration whether guided or enhanced, altered or disrupted through the Sound/Image interface or explored solely through a sense of hearing or a sense of sight.
Curatorial team: Katarzyna Kosmala and Kumiko Kushiyama
In the education of visually-impaired people, learning Braille is an important facilitator of basic communication through reading and writing. In recent years, education that incorporates information through tablet devices has become increasingly popular, but is difficult to use in conjunction with tactile presentation, such as Braille for visually-impaired people. Therefore, this project is developing tactile Braille presentation delivered through everyday tablet devices as a fun way of supporting Braille education. Through the development of this system for learning Braille, we hope to promote an interest in increasing the accessibility of Braille education.
In recent years, dance has been featured in a variety of media, and as such, has led to new forms of dance. Amongst these new forms are combinations of dance and costumes that utilise digital technology such as LEDs. However, these systems do not synchronise easily with other aspects of dance performance, such as music and lighting. Therefore, in this research we propose to develop a device that utilises an algorithm that allows for a performance where lighting reacts to the performer’s movements.
In both childhood and adulthood, training is necessary to read music scores, which sometimes makes music composition and performance difficult to learn and enjoy. In this research, we proposed a system that enables users to play their own handwritten musical notation by using our intuitive musical interface.
Since the 1960s, Optical Music Recognition (OMR) has become established in the field of printed scores. Recently, Yamamoto proposed an interactive musical system that directly utilizes printed music scores as an instrument using matching keypoints. However, little research on handwritten notation has been done, nor on interactive systems for OMR. Therefore we created a system that combines notating with performing in order to make music more intuitive as a way to assist those learning how to read and write musical scores.
Tetsuaki Baba, Yuya Kikukawa, Kumiko Kushiyama, Gocen: Appropriating Simplified Handwritten Notation as a Musical Interface, Journal of Asia Digital Art and Design Association, ADADA, Vol.18, No.1, 2014 [PDF]
This research integrates interactive media technologies, such as motion detectors, light sensors and motion actuators, into the design of architectural modular screen structures in order to create new types of intelligent, interactive screen wall systems. The results will have multiple practical and artistic applications, including architectural sun shading, privacy screening and varied interactive media applications. This work will combine the beauty, utility and spatial qualities found in architectural screen design with the intelligence and interface of interactive media.
This research proposes an interface where users can build cooperative relationships through visual and auditory communication. In this context, “cooperative relationship” refers to users determining their actions while being aware of another user’s actions. We made a transparent screen that measures touch position by using depth camera, and visually mapped sound harmonics by Lissajous curve.