Title : Research on creation of remote live dance performances using immersive environments.



Project Lead : Alain Baumann From : Kniclab (None)

Dates : from 2014-03-03 16:51:04 to 2014-07-15 13:13:24

Description :

Motivation and objectives :
The project will study and experiment the development of novel product for the culture and performing arts industry using the infrastructure provided by Visionairs partners (i2CAT and Fraunhofer IPK). The ambitious objectives, defined for this project, bring together cutting-edge visualization and interactive systems (CAVE), experimental performing arts researchers (Konic and HZT), low-latency video-transmission solutions (remote video stream realization) and advanced networks technologies. The joint trans-national action (TNA) performed by Visionair project members Fraunhofer IPK and I2Cat propose a breaking through scenario where creation, control, transmission and visualization of contents takes place at the same time in an interactive manner. The experimentation proposed, will make use of a CAVE (Cave Automatic Virtual Environment) to set up an immersive environment where an artist creates and controls visual contents, through physical interaction with the CAVE and real-time remote visualization. This experimentation is a great opportunity to explore new frameworks and possibilities for arts, based on the collaboration between multiple actors coming from different fields of the performing arts, culture and new technologies. At technical and artistic level, this TNA proposes multiple challenges: - Firstly, study about the creation of audiovisual contents and interaction with them using a CAVE for artistic purposes. - Secondly, research and experimentation of software and hardware methods that will allow remote visualization of the contents created in the CAVE using Ultragrid and NGNs (Next Generation Networks). - Thirdly, experiment with multiple configurations (e.g.: different perspectives, camera configurations, number of dancer/performers, etc.) and evaluation of the whole system: CAVE, artist, audience - Fourth, explore the use of different network typologies (e.g.: OpenVPN, NGN) between connected nodes, in order to analyze and study possible network topologies and configurations of interest for HQ video streaming. - Finally, research on live realization (i.e.: live video stream selection) for an augmented experience of the user (audience) and improve the control of the artist on the final result. This TNA aspire to open new ways of experimentation and creation using advanced visual environments formats in the field of telematics and distributed events. The potential utilities of the results are very rich from a technical point of view and also from the artistic perspective. The complex scenario that have been propound, opens up new experiments and leads virtual performances to a new horizon of possibilities and will contribute to break technological and conceptual frontiers. The TNA has mainly to strands, which are described below. The first experimentation will propose different scenarios that will analyze multiple aspects such as user (artist) experience, usability of the system, artistic impact, potential use cases as a result of the experimentation, effect on the audience, etc. A calendar will be provided with the layout for each day, number of cameras, dancers, tools to be used, 3D content and background, etc. The objective is to make an intense experimentation for each configuration and provide a deep analysis of the results. This experimentation will be lead by Konic, Hochschulbergreifendes Zentrum Tanz Berlin (HZT) and Fraunhofer IPK during their stay in IPKs facilities. The second aspect take into consideration, will be analysed through the results obtained of the several distinct transmissions between Berlin and Barcelona (one per day), which will make use of the infrastructures of the i2CAT Foundation and Fraunhofer IPK. Representatives from i2CAT will coordinate the experimentation between Berlin and Barcelona. Konik Theatre will send a representative to the Fraunhofer IPK facilities to carry out the artistic performance using the CAVE. HZT will collaborate with Konic in the artistic side, and also will make use of i2CAT's equipment for the realization and visualization of the contents generated. Fraunhofer IPKs personnel will be in charge to configure and define the parameters of interaction between the artist and the CAVE. I2CAT will be managing the capture, distribution and visualization of contents.

Teams :
Main activity is focused on the application of interactive technologies to artistic projects. // It provides a practice led and research driven education in contemporary dance, choreography and performance. Close connection between academic education and professional artistic practice characterizes the programmes which offer an experimental approach to study, combine practice-led artistic and research driven education, and practical career guidance.

Dates :
starting date : 02 July, 2014
ending date : 13 July, 2014

Facilities descriptions :
http://visionair-browser.g-scop.grenoble-inp.fr/visionair/Browser/Catalogs/VPCC.GE.html

Recordings & Results :
Konic and HZT are entities with great interest in the research of what cutting-edge technologies could bring to culture and performing arts. More specifically, they explore through contemporary dance and body expression and advanced visualization systems. This project joint two highly skilled facilities, Fraunhofer IPK and the i2CAT Foundation, to explore simultaneously with the use of a CAVE (an immersive virtual environment) and advanced software and infrastructures for transmitting media content. The project proposed two venues, Berlin and Barcelona, to experiment with several configurations the production of live contents, to be distributed in real-time, and its local and remote realization. Artists from Konic and HZT were in Berlin, supported by i2CAT and IPK technical staff, investigating how to interact with the CAVE (using different devices and sensors) and recording with multi-camera distribution. At technical and artistic level, this TNA proposes multiple challenges: - Firstly, study about the creation of audiovisual contents and interaction with them using a CAVE for artistic purposes. - Secondly, research and experimentation of software and hardware methods that will allow remote visualization of the contents created in the CAVE using Ultragrid and NGNs (Next Generation Networks). - Thirdly, experiment with multiple configurations (e.g.: different perspectives, camera configurations, number of tracking targets, etc.) and evaluation of the whole system: CAVE, artist, audience - Fourth, explore the use of different network typologies (e.g.: OpenVPN, NGN) between connected nodes, in order to analyze and study possible network topologies and configurations of interest for HQ video streaming. - Finally, research on live realization (i.e.: live video stream selection) for an augmented experience of the user (audience) and improve the control of the artist on the final result.

Conclusions :
- developed a software to generate dynamic geometries based on the performers input - cameras captured the performance at high definition resolution - dance compositions were developed in iterative manner, exploring the interactive and graphic possibilities offered by the system - established network connection between IPK and I2Cat, three cameras were remotely controlled in order to do the live editing - conducted experiments mapping various parameters of the dancers movements to the form generation, e.g. hand distance to object size (scale), generating lines or textured surfaces, changing the viewers perspective, mixing various form generations simultaneously - dance and visual explorations were developed interactively - on the last day a 45 minutes performance was offered to a audience at IPK and in connection with Barcelona




Project Images :

image.9AZOTX.png
image.0YJLTX.png


Other project resources :

VISIONAIR-IPK_ REPORT Alain Baumann.pdf


.



Visionair logo

VISIONAIR / Grenoble INP / 46 avenue Felix Viallet / F-38 031 Grenoble cedex 1 / FRANCE
Project funded by the European Commission under grant agreement 262044