Project #09.3: FireTraSe: Stereoscopic camera tracking and wireless wearable sensors system for interactive dance performances

Demo

embedded by Embedded Video

Abstract

FireTraSe stands for Fire, Tracking and Sensors. In order to track the movements and follow the gestures of a dancer, we developed tracking algorithms for a stereoscopic video camera and we built a small and light wireless sensors system to be worn by the dancer. The combination of those two complementary methods can be used in many kinds of interactive contexts: to track performers or to track the audience.
Within this numediart project, we have used those results for the artistic project “Fire experiences and projections” proposed by the pyrotechnician Pierre D’Heanens. He developed at ShowFlamme a ramp of 20 fire projectors whose heights can be individually controlled in real time by software. We programmed a flexible pattern generator that allows us to create and combine various complex flame patterns controlled by the movements of a dancer. Additionally, as it is not always easy to work with real fire, we also programmed a flame simulator using a particles generator in OpenGL. It comes as a Jitter objet for the Max environment. It becomes then possible to rehearse with a dancer, by projecting the flame simulation on a wall or on a screen.
At the end of the project we also decided to combine those results with those of the Dancing Viola project (#04.2) and with the pitch detection algorithms developed for the Multimodal Guitar project (#07.1). The level and pitch of the sound can then also control the flame patterns. And the viola player Dominica Eyckmans could then control various sound transformations, prerecorded sound sequences and spatialisation concurrently with the flames.

Results

Documents

  • [2010,inproceedings] bibtex Go to document
    Todoroff Todor, Ben Madhkour Radhwan, Binon Daniel, Bose Ricardo, Paesmans Vincent, « FireTraSe: Stereoscopic camera tracking and wireless wearable sensors system for interactive dance performances – Application to “Fire Experiences and Projections” », in « QPSR of the numediart research program », 2010, pp. 9-24.
    @INPROCEEDINGS{numediart_2010_s09_p3_report,
      author = {Todor Todoroff and Radhwan Ben~Madhkour and Daniel Binon and Ricardo Bose and Vincent Paesmans},
      title = {FireTraSe: Stereoscopic camera tracking and wireless wearable sensors system for interactive dance performances - Application to ``Fire Experiences and Projections''},
      booktitle = {{QPSR} of the numediart research program},
      year = {2010},
      editor = {Thierry Dutoit and Beno\^{i}t Macq},
      volume = {3},
      number = {1},
      pages = {9-24},
      month = {3},
      organization = {numediart Research Program on Digital Art Technologies},
      url = {http://www.numediart.org/docs/numediart_2010_s09_p3_report.pdf}
    }