Publications
-
An Interactive Audio System for Mobiles
This paper presents an XML format for embedded interactive audio, deriving from well-established formats like iXMF and SMIL. We introduce in this format a new paradigm for audio elements and animations synchronization, using a flexible event-driven system in conjunction with graph description capabilities to replace audio scripting. The concepts of this new format are explained through the building of a virtual interactive jungle environment. Then we have implemented a sound manager for J2ME smartphones and the iPhone. Guidance applications for blind people based on this audio system are being developed.
-
Augmented Reality Audio Editing
The concept of augmented reality audio (ARA) characterizes techniques where a physically real sound and voice environment is extended with virtual, geolocalized sound objects. We show that the authoring of an ARA scene can be done through an iterative process composed of two stages: in the first one the author has to move in the rendering zone to apprehend the audio spatialization and the chronology of the audio events and in the second one a textual editing of the sequencing of the sound sources and DSP acoustics parameters is done. This authoring process is based on the join use of two XML languages, OpenStreetMap for maps and A2ML for Interactive 3D Audio. A2ML being a format for a cue-oriented interactive audio system, requests for interactive audio services are done through TCDL, a Tag-based Cue Dispatching language. This separation of modeling and audio rendering is similar to what is done for the web of documents with HTML and CSS style sheets.
-
Sound Objects for SVG
In this paper, we will show how an XML language for interactive audio can be used with SVG. After an introduction to the history of sound objects, we will use the example of a computational character with an simple orient behaviour to demonstrate the complementarity of SVG and A2ML. The best way to use these two languages is to synchronize them with a third one, a tag-value dispatching language. We will then present a complex application for which the use of both SVG and A2ML is natural, i.e. a navigation system for visually impaired people based on OpenStreetMap.
