TNA project : Audio-Based CogInfoCom Channels for Spatialized Audio Environments

Acronym : 56-Audio-Based CogInfoCom Channels for Spatialized Audio Environments-Csapo

Project Lead : Adam Csapo From : Budapest University of Technology and Economics

Dates : from 21st October 2012 to 2nd November 2012

Description :



Motivation and objectives :
The motivation of this proposal is to explore the possibility of creating audio-based cognitive infocommunication channels using spatialized audio environments, and to see how this changes user experience compared to audio-based CogInfoCom channels presented through stereo headphones. Cognitive Infocommunications (CogInfoCom) is an emerging interdisciplinary research field at the meeting point between the cognitive sciences and infocommunications. The primary goal of CogInfoCom is to provide a systematic view of how cognitive processes can co-evolve with infocommunications devices so that the capabilities of the human brain may not only be extended through these devices, irrespective of geographical distance, but may also interact with the capabilities of any artificially cognitive system. My research has dealt with creating a formal definition of CogInfoCom channels and a framework for their design and implementation. One of the main contributions of this framework is that it links syntactic elements with semantic interpretations across sensory modalities. Further, it defines cognitive mapping techniques which allow for the user to create a conceptual link between CogInfoCom channels of one sensory modality and CogInfoCom message generated concepts usually encountered through a different modality. Finally, part of my recent research has dealt with creating interpretable tuning models which allow the user to tune high-dimensional generation parameter spaces used to generate CogInfoCom channels through a lower-dimensional set of tuning parameters. The main objective of this project proposal is to create audio-based CogInfoCom channels which make use of generation parameters that are related to spatial configuration. Whereas the use of stereo headphones limits the possibilities for such an approach (even in the case where HRTF are used), the unique infrastructure at the Immersive Virtual Environments Laboratory of the University College London offers unique possibilities for experimentation.

Teams :
We are a small research group working on two branches of cognitive infocommunications (CogInfoCom): dealing with channel-based CogInfoCom (with the goal of creating structured communication through various sensory modalities using signals in which syntactic elements and semantic meaning are intertwined at various levels of cognitive interpretation); and interactive CogInfoCom (with the goal of implementing such channels as well as interactive patterns not building on channel based communication so that the human-network interaction can become both effortless and effective).

Dates :
starting date : 21 October, 2012
ending date : 02 November, 2012

Facilities descriptions :
http://visionair-browser.g-scop.grenoble-inp.fr/visionair/Browser/Catalogs/THINKLAB.UK.html

Recordings & Results :
None

Conclusions :
The main aim has been achieved by the implementation of a SDM tuning model in the Octave audio architecture and API. Produced the initial assessment of the technical implementation. A full assessment should be planned as future work.