TNA project : Exploring opportunities for immersive CogInfoCom channels in smart homes

Acronym : 37-Exploring opportunities for immersive CogInfoCom channels in smart homes-Csapo

Project Lead : Adam Csapo From : Budapest University of Technology and Economics

Dates : from 6th December 2013 to 19th December 2013

Description :



Motivation and objectives :
The motivation of this proposal is to explore immersive -- and possibly portable -- augmented reality devices for future experiments and applications in cognitive infocommunications (CogInfoCom), with special focus on smart home applications. CogInfoCom is an emerging interdisciplinary research field at the meeting point between the cognitive sciences and infocommunications. The primary goal of CogInfoCom is to provide a systematic view of how cognitive processes can co-evolve with infocommunications devices so that the capabilities of the human brain may not only be extended through these devices, irrespective of geographical distance, but may also interact with the capabilities of any artificially cognitive system. My research has dealt with creating a formal definition of CogInfoCom channels and a framework for their design and implementation. One of the main contributions of this framework is that it links syntactic elements with semantic interpretations across sensory modalities. Further, it defines cognitive mapping techniques which allow for the user to create a conceptual link between CogInfoCom channels of one sensory modality and CogInfoCom message generated concepts usually encountered through a different modality. Finally, part of my recent research has dealt with creating interpretable tuning models which allow the user to tune high-dimensional generation parameter spaces used to generate CogInfoCom channels through a lower-dimensional set of tuning parameters. The main objective of this project proposal is to discover immersive augmented reality devices which could be used to develop and test CogInfoCom channels for immersive scenarios.

Teams :
We are a small research group working on two branches of cognitive infocommunications (CogInfoCom): dealing with channel-based CogInfoCom (with the goal of creating structured communication through various sensory modalities using signals in which syntactic elements and semantic meaning are intertwined at various levels of cognitive interpretation); and interactive CogInfoCom (with the goal of implementing such channels as well as interactive patterns not building on channel-based communication so that the human-network interaction can become both effortless and effective).

Dates :
starting date : 06 December, 2013
ending date : 19 December, 2013

Facilities descriptions :
http://visionair-browser.g-scop.grenoble-inp.fr/visionair/Browser/Catalogs/VPCC.GE.html

Recordings & Results :
CogInfoCom channels group sensory messages that convey meaning on the same concept. This project was about to find CogInfoCom channels which complement virtual sketching application with audio-based channels representing concept of “curviness”.

Conclusions :
Two main mapping approaches could be developed: - High-level direct mapping (iconic representation through simple/complex harmonic structure) - Low-level direct mapping (“parameter mapping”: line slope variations -> pitch)