MediaCycle

MediaCycle LogoThe Medi­a­Cy­cle frame­work offers libraries, plu­g­ins and appli­ca­tions for mul­ti­me­dia nav­i­ga­tion and content-based orga­ni­za­tion by sim­i­lar­ity. Cur­rently sup­ported media types are: audio, image, video, text. Since 2008, it has been fea­tured in: Bud Blu­men­thal Hybrid’s DANCERS! Rela­tional Nav­i­ga­tor, the Audio­G­a­r­den com­pos­ite audio cre­ation tool, the Loop­Jam inter­ac­tive dancefloor.

Demo

Team

The Medi­a­Cy­cle frame­work has been devel­oped by sev­eral mem­bers of the Uni­ver­sity of Mons and the NUMEDIART Institute.

Main con­trib­u­tors (alpha­bet­i­cally):
• Stéphane Dupont (audio fea­tures and play­back)
• Chris­t­ian Fris­son (user expe­ri­ence, cross-platform sup­port)
• Alexis Moinet (devel­op­ment back­end and audio vocoder)
• Thierry Ravet (plu­gin archi­tec­ture and text/mixed media fea­tures)
• Xavier Siebert (image/video fea­tures and segmentation)

Past con­trib­u­tors (alpha­bet­i­cally):
• Gré­gory Bour­guignon (nav­i­ga­tion in image col­lec­tions on Android devices)
• Julien Dubois (ini­tial plu­gin sup­port)
• Thomas Dubuis­son (Flex inter­face)
• Daniel Dzi­amski (nav­i­ga­tion in audio col­lec­tions on Android devices)
• Stéphane Huet (inte­gra­tion into iTunes and Song­bird for audio col­lec­tions)
• Sidi Ahmed Mah­moudi (accel­er­ated video fea­tures plu­gin)
• Cécile Picard-Limpens (audio seg­men­ta­tion and syn­the­sis)
• Raphaël Sebbe (ini­tial brows­ing inter­face)
• Damien Tardieu (audio fea­tures and seg­men­ta­tion)
• Jérôme Urbain (audio segmentation)

Demo videos by Laura Col­menares Guerra.

Related nume­di­art projects

RT-MediaCycle

for Per­for­mances and Video Installations

Loop­Jam

Col­lab Music Map on the Dance Floor

Medi­a­Blender

Inter­ac­tive Mul­ti­me­dia Segmentation

CoMe­di­An­no­tate

towards a usable mul­ti­modal anno­ta­tion framework

iVISIT

Inter­ac­tive Video and Sound Instal­la­tions Tools

Audio­G­a­r­den

towards a Usable Tool for Com­pos­ite Audio Creation

MoVi

Medi­a­Cy­cle Audio and Visu­al­iza­tion improvements

Mul­ti­Me­di­a­Cy­cle

Video Nav­i­ga­tion Tool

AVLaugh­ter­Cy­cle

Laugh­ter Cycle

Behav­ioral Installations

Medi­a­Cy­cle

Audio­Cy­cle

Audio Thumb­nail­ing

Audio Skim­ming

Doc­u­ments

Jour­nals

2010

  • [2010,article] bib­tex
    Tardieu Damien, Siebert Xavier, Maz­zarino Bar­bara, Chessini Ricardo, Dubois Julien, Dupont Stéphane, Varni Gio­vanna, Visentin Alexan­dra, « Brows­ing a dance video col­lec­tion: dance analy­sis and inter­face design », in « Jour­nal on Mul­ti­modal User Inter­faces », vol. 4, iss. 1, pp. 37–46, 2010.
    @ARTICLE{Tardieu2010,
      author = {Damien Tardieu and Xavier Siebert and Barbara Mazzarino and Ricardo Chessini and Julien Dubois and St\'{e}phane Dupont and Giovanna Varni and Alexandra Visentin},
      title = {Browsing a dance video collection: dance analysis and interface design},
      journal = {Journal on Multimodal User Interfaces},
      year = {2010},
      volume = {4},
      pages = {37-46},
      number = {1},
      note = {Special Issue: eNTERFACE'09},
      abstract = {In this article we present a system for content-based browsing of a dance video database. A set of features describing dance is proposed, to quantify local gestures of the dancer as well as global stage usage. These features are used to compute similarities between recorded dance improvisations, which in turn serve to guide the visual exploration in the browsing methods presented here. The software integrating all these components is part of an interactive touch-screen installation, and is also accessible online in association with an artistic project. The different components of this browsing system are presented in this paper.},
      doi = {http://www.springerlink.com/content/j491124555833403/fulltext.pdf},
      issn = {1783-7677},
      keyword = {Computer Science},
      publisher = {Springer Berlin / Heidelberg}
    }
  • [2010,article] bib­tex Go to document
    Urbain Jérôme, Niewiadom­ski Radoslaw, Bevac­qua Elis­a­betta, Dutoit Thierry, Moinet Alexis, Pelachaud Cather­ine, Picart Ben­jamin, Tilmanne Joëlle, Wag­ner Johannes, « AVLaugh­ter­Cy­cle: Enabling a vir­tual agent to join in laugh­ing with a con­ver­sa­tional part­ner using a similarity-driven audio­vi­sual laugh­ter ani­ma­tion », in « Jour­nal on Mul­ti­modal User Inter­faces », vol. 4, iss. 1, pp. 47–58, 2010.
    @ARTICLE{Urbain2010,
      author = {J\'{e}r\^{o}me Urbain and Radoslaw Niewiadomski and Elisabetta Bevacqua and Thierry Dutoit and Alexis Moinet and Catherine Pelachaud and Benjamin Picart and Jo\"{e}lle Tilmanne and Johannes Wagner},
      title = {AVLaughterCycle: Enabling a virtual agent to join in laughing with a conversational partner using a similarity-driven audiovisual laughter animation},
      journal = {Journal on Multimodal User Interfaces},
      year = {2010},
      volume = {4},
      pages = {47-58},
      number = {1},
      note = {Special Issue: eNTERFACE'09},
      abstract = {In this article we present a system for content-based browsing of a dance video database. A set of features describing dance is proposed, to quantify local gestures of the dancer as well as global stage usage. These features are used to compute similarities between recorded dance improvisations, which in turn serve to guide the visual exploration in the browsing methods presented here. The software integrating all these components is part of an interactive touch-screen installation, and is also accessible online in association with an artistic project. The different components of this browsing system are presented in this paper.},
      issn = {1783-7677},
      keyword = {Computer Science},
      publisher = {Springer Berlin / Heidelberg},
      url = {http://www.springerlink.com/content/035125233jpr0384/fulltext.pdf}

Con­fer­ences

2013

  • [2013,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, « Design­ing tangible/free-form appli­ca­tions for nav­i­ga­tion in audio/visual col­lec­tions (by content-based sim­i­lar­ity) », in « Grad­u­ate Stu­dent Con­sor­tium of the ACM Tan­gi­ble, Embed­ded and Embod­ied Inter­ac­tion con­fer­ence (TEI-13) », Barcelona, Spain, 2013.
    @INPROCEEDINGS{MediaCyclingTEI2013,
      author = {Christian Frisson},
      title = {Designing tangible/free-form applications for navigation in audio/visual collections (by content-based similarity)},
      booktitle = {Graduate Student Consortium of the ACM Tangible, Embedded and Embodied Interaction conference (TEI-13)},
      year = {2013},
      address = {Barcelona, Spain},
      month = {February 10-13},
      url={http://www.tei-conf.org/13/}
    }
  • [2013,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, Dupont Stéphane, Moinet Alexis, Picard-Limpens Cécile, Ravet Thierry, Siebert Xavier, Dutoit Thierry, « Video­Cy­cle: user-friendly nav­i­ga­tion by sim­i­lar­ity in video data­bases », in « Pro­ceed­ings of the Mul­ti­me­dia Mod­el­ing Con­fer­ence (MMM), Video Browser Show­down ses­sion », Huang­shan, China, 2013.
    @INPROCEEDINGS{VideoCycleMMMVBS2013, title={VideoCycle: user-friendly navigation by similarity in video databases},
      author={Christian Frisson and St\'{e}phane Dupont and Alexis Moinet and C\'{e}cile Picard-Limpens and Thierry Ravet and Xavier Siebert and Thierry Dutoit},
      booktitle={Proceedings of the Multimedia Modeling Conference (MMM), Video Browser Showdown session},
      year={2013},
      address={Huangshan, China},
      month={January 7-9},
      url={http://mmm2013.org/Video_browser_showdown.htm}
    }

2012

  • [2012,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, Dupont Stéphane, Leroy Julien, Moinet Alexis, Ravet Thierry, Siebert Xavier, Dutoit Thierry, « Loop­Jam: turn­ing the dance floor into a col­lab­o­ra­tive instru­men­tal map », in « Pro­ceed­ings of the New Inter­faces for Musi­cal Expres­sion (NIME) », Ann Arbor, Michi­gan, 2012.
    @INPROCEEDINGS{LoopJamNIME2012,
      author = {Christian Frisson and St\'{e}phane Dupont and Julien Leroy and Alexis Moinet and Thierry Ravet and Xavier Siebert and Thierry Dutoit},
      title = {LoopJam: turning the dance floor into a collaborative instrumental map},
      booktitle = {Proceedings of the New Interfaces for Musical Expression (NIME)},
      year = {2012},
      editor = {Essl, G. and Gillespie, B. and Gurevich, M. and O'Modhrain, S.},
      address = {Ann Arbor, Michigan},
      month = {May 21-23},
      publisher = {University of Michigan},
      url={http://www.eecs.umich.edu/nime2012/Proceedings/papers/260_Final_Manuscript.pdf}
    }
  • [2012,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, Dupont Stéphane, Moinet Alexis, Leroy Julien, Ravet Thierry, Siebert Xavier, Dutoit Thierry, « Loop­Jam: une carte musi­cale col­lab­o­ra­tive sur la piste de danse », in « Actes des Journées d’Informatique Musi­cale (JIM 2012) », Mons, Bel­gique, 2012, pp. 101–105.
    @INPROCEEDINGS{LoopJamJIM2012, title={LoopJam: une carte musicale collaborative sur la piste de danse},
      author={Christian Frisson and St\'{e}phane Dupont and Alexis Moinet and Julien Leroy and Thierry Ravet and Xavier Siebert and Thierry Dutoit},
      booktitle={Actes des Journ\'{e}es d'Informatique Musicale (JIM 2012)},
      year={2012},
      editor={Thierry Dutoit and Todor Todoroff and Nicolas d'Alessandro},
      pages={101-105},
      address={Mons, Belgique},
      month={9-11 mai},
      organization={UMONS/numediart},
      url={http://jim.afim-asso.org/jim12/pdf/jim2012_17_p_frisson.pdf}
    }
  • [2012,inproceedings] bib­tex Go to document
    Baba­can Onur, Fris­son Chris­t­ian, Dutoit Thierry, « Improv­ing the Under­stand­ing of Turk­ish Makam Music through the Medi­a­Cy­cle Frame­work », in « Pro­ceed­ings of the 2nd Comp­Mu­sic Work­shop », Bahçeşe­hir Üniver­sitesi, Beşik­taş, Istan­bul, Turkey, 2012, pp. 25–28.
    @INPROCEEDINGS{MakamCycleCompMusic2012,
      author = {Onur Babacan and Christian Frisson and Thierry Dutoit},
      title = {Improving the Understanding of Turkish Makam Music through the MediaCycle Framework},
      booktitle = {Proceedings of the 2nd CompMusic Workshop},
      year = {2012},
      address = {Bah\c{c}e\c{s}ehir \"{U}niversitesi, Be\c{s}ikta\c{s},
      Istanbul, Turkey},
      month = {July 12-13},
      pages={25-28},
      url = {http://compmusic.upf.edu/system/files/static_files/06-Onur-Babacan-et-al-2nd-CompMusic-Workshop-2012.pdf}
    }

2011

  • [2011,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, Dupont Stéphane, Siebert Xavier, Dutoit Thierry, « Sim­i­lar­ity in media con­tent: dig­i­tal art per­spec­tives », in « Pro­ceed­ings of the 17th Inter­na­tional Sym­po­sium on Elec­tronic Art (ISEA 2011) », Istan­bul, Turkey, 2011.
    @INPROCEEDINGS{MediaCycleISEA2011,
      author = {Christian Frisson and St\'{e}phane Dupont and Xavier Siebert and Thierry Dutoit},
      title = {Similarity in media content: digital art perspectives},
      booktitle = {Proceedings of the 17th International Symposium on Electronic Art (ISEA 2011)},
      year = {2011},
      address = {Istanbul, Turkey},
      month = {September 14-21},
      url = {http://isea2011.sabanciuniv.edu/paper/similarity-media-content-digital-art-perspectives}
    }

2010

  • [2010,inproceedings] bib­tex
    Tardieu Damien, Siebert Xavier, Maz­zarino Bar­bara, Blu­men­thal Bud, « An inter­ac­tive instal­la­tion for brows­ing a dance video data­base. », in « IEEE Inter­na­tional Con­fer­ence on Mul­ti­me­dia \& Expo », Sin­ga­pore, 2010.
    @INPROCEEDINGS{Tardieu2010,
      author = {Damien Tardieu and Xavier Siebert and Barbara Mazzarino and Bud Blumenthal},
      title = {An interactive installation for browsing a dance video database.},
      booktitle = {IEEE International Conference on Multimedia \& Expo},
      year = {2010},
      address = {Singapore},
      month = {July 19-23}
    }
  • [2010,inproceedings] bib­tex
    Urbain J., Bevac­qua E., Dutoit T., Moinet A., Niewiadom­ski R., Pelachaud C., Picart B., Tilmanne J., Wag­ner J., « The AVLaugh­ter­Cy­cle Data­base », in « Pro­ceed­ings of the Sev­enth con­fer­ence on Inter­na­tional Lan­guage Resources and Eval­u­a­tion (LREC’10) », Val­letta, Malta, 2010.
    @INPROCEEDINGS{Urbain2010LREC,
      author = {J. Urbain and E. Bevacqua and T. Dutoit and A. Moinet and R. Niewiadomski and C. Pelachaud and B. Picart and J. Tilmanne and J. Wagner},
      title = {The AVLaughterCycle Database},
      booktitle = {Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10)},
      year = {2010},
      address = {Valletta, Malta},
      organization = {European Language Resources Association (ELRA)}
    }
  • [2010,inproceedings] bib­tex
    Urbain J., Bevac­qua E., Dutoit T., Moinet A., Niewiadom­ski R., Pelachaud C., Picart B., Tilmanne J., Wag­ner J., « La base de don­nées AVLaugh­ter­Cy­cle », in « XXVI­IIe Journées d’Etude sur la Parole », Mons, Bel­gium, 2010, pp. 61–64.
    @INPROCEEDINGS{Urbain2010JEP,
      author = {J. Urbain and E. Bevacqua and T. Dutoit and A. Moinet and R. Niewiadomski and C. Pelachaud and B. Picart and J. Tilmanne and J. Wagner},
      title = {La base de donn\'{e}es AVLaughterCycle},
      booktitle = {XXVIIIe Journ\'{e}es d'Etude sur la Parole},
      year = {2010},
      pages = {61-64},
      address = {Mons, Belgium}
    }
  • [2010,inproceedings] bib­tex
    Fris­son Chris­t­ian, « Con­cep­tion cen­trée util­isa­teur de pro­to­types inter­ac­t­ifs pour la ges­tion de con­tenu mul­ti­me­dia par sim­i­lar­ité », in « Ren­con­tres doc­tor­ales de la Con­férence Fran­coph­one sur l’Interaction Homme-Machine (IHM) », Lux­em­bourg, 2010.
    @INPROCEEDINGS{DotConIHM2010,
      author = {Christian Frisson},
      title = {Conception centr\'{e}e utilisateur de prototypes interactifs pour la gestion de contenu multimedia par similarit\'{e}},
      booktitle = {Rencontres doctorales de la Conf\'{e}rence Francophone sur l'Interaction Homme-Machine (IHM)},
      year = {2010},
      address = {Luxembourg},
      month = {September 20-23}
    }
  • [2010,inproceedings] bib­tex Go to document
    Fris­son Chris­t­ian, Dupont Stéphane, Siebert Xavier, Tardieu Damien, Dutoit Thierry, Macq Benoit, « Device­Cy­cle: rapid and reusable pro­to­typ­ing of ges­tural inter­faces, applied to audio brows­ing by sim­i­lar­ity », in « Pro­ceed­ings of the New Inter­faces for Musi­cal Expres­sion++ (NIME++) », Syd­ney, Aus­tralia, 2010.
    @INPROCEEDINGS{DeviceCycleNIME2010,
      author = {Christian Frisson and St\'{e}phane Dupont and Xavier Siebert and Damien Tardieu and Thierry Dutoit and Benoit Macq},
      title = {Device{C}ycle: rapid and reusable prototyping of gestural interfaces, applied to audio browsing by similarity},
      booktitle = {Proceedings of the New Interfaces for Musical Expression++ (NIME++)},
      year = {2010},
      address = {Sydney, Australia},
      month = {June 15-18},
      url = {http://www.nime.org/proceedings/2010/nime2010_473.pdf}
    }
  • [2010,inproceedings] bib­tex
    Dupont Stéphane, Fris­son Chris­t­ian, Siebert Xavier, Tardieu Damien, « Brows­ing Sound and Music Libraries by Sim­i­lar­ity », in « 128th Audio Engi­neer­ing Soci­ety (AES) Con­ven­tion », Lon­don, UK, 2010.
    @INPROCEEDINGS{AudioCycleAES2010,
      author = {St\'{e}phane Dupont and Christian Frisson and Xavier Siebert and Damien Tardieu},
      title = {Browsing Sound and Music Libraries by Similarity},
      booktitle = {128th Audio Engineering Society (AES) Convention},
      year = {2010},
      address = {London, UK},
      month = {May 22-25}
    }
  • [2010,inproceedings] bib­tex
    Picard Cécile, Fris­son Chris­t­ian, Tardieu Damien, Macq Benoit, Van­der­don­ckt Jean, Dutoit Thierry, « Towards User-Friendly Audio Cre­ation », in « Pro­ceed­ings of Audio Mostly, an ACM Con­fer­ence on Inter­ac­tion with Sound », Pite\ra, Swe­den, 2010.
    @INPROCEEDINGS{AudioGardenAM2010,
      author = {C\'{e}cile Picard and Christian Frisson and Damien Tardieu and Benoit Macq and Jean Vanderdonckt and Thierry Dutoit},
      title = {Towards User-Friendly Audio Creation},
      booktitle = {Proceedings of Audio Mostly, an ACM Conference on Interaction with Sound},
      year = {2010},
      address = {Pite\r{a},
      Sweden},
      month = {September 15-18},
      doi = {http://dx.doi.org/10.1145/1859799.1859820}
    }

2009

  • [2009,inproceedings] bib­tex
    Urbain Jéröme, Dubuis­son Thomas, Dupont Stéphane, Fris­son Chris­t­ian, Sebbe Raphaël, d’Alessandro Nico­las, « Audio­Cy­cle: A similarity-based visu­al­iza­tion of musi­cal libraries », in « IEEE Inter­na­tional Con­fer­ence on Mul­ti­me­dia and Expo (ICME) », Can­cun, Mex­ico, 2009, pp. 1847–1848.
    @INPROCEEDINGS{AudioCycleICME2009,
      author = {J\'{e}r\"{o}me Urbain and Thomas Dubuisson and St\'{e}phane Dupont and Christian Frisson and Rapha\"{e}l Sebbe and Nicolas d'Alessandro},
      title = {Audio{C}ycle: A similarity-based visualization of musical libraries},
      booktitle = {IEEE International Conference on Multimedia and Expo (ICME)},
      pages = {1847-1848},
      year = {2009},
      address = {Cancun, Mexico},
      month = {June 28 - July 3}
    }
  • [2009,inproceedings] bib­tex
    Dupont Stéphane, Dubuis­son Thomas, Urbain Jéröme, Fris­son Chris­t­ian, Sebbe Raphaël, d’Alessandro Nico­las, « Audio­Cy­cle: Brows­ing Musi­cal Loop Libraries », in « 7th Inter­na­tional Work­shop on Content-Based Mul­ti­me­dia Index­ing (CBMI) », Cha­nia, Crete, 2009, pp. 73–80.
    @INPROCEEDINGS{AudioCycleCBMI2009,
      author = {St\'{e}phane Dupont and Thomas Dubuisson and J\'{e}r\"{o}me Urbain and Christian Frisson and Rapha\"{e}l Sebbe and Nicolas d'Alessandro},
      title = {Audio{C}ycle: Browsing Musical Loop Libraries},
      booktitle = {7th International Workshop on Content-Based Multimedia Indexing (CBMI)},
      pages = {73-80},
      year = {2009},
      address = {Chania, Crete},
      month = {June 3-5}
    }

Mas­ter The­sis (cumulated)

  • [2011,mastersthesis] bib­tex Go to document
    Bour­guignon Gré­gory, « Développe­ment d’outils de nav­i­ga­tion hyper­me­dia (images) pour dis­posi­tifs mobiles (Android) », Master’s Dis­ser­ta­tion , Mons, Bel­gium, 2011.
    @MASTERSTHESIS{Bourguignon2011,
      author = {Gr\'{e}gory Bourguignon},
      title = {D\'{e}veloppement d'outils de navigation hypermedia (images) pour dispositifs mobiles (Android)},
      school = {Universit\'{e} de Mons},
      year = {2011},
      address = {Mons, Belgium},
      url = {http://tcts.fpms.ac.be/publications/tfes/2012/gb.pdf}
    }
  • [2011,mastersthesis] bib­tex Go to document
    Dzi­amski Daniel, « Développe­ment d’outils de nav­i­ga­tion hyper­me­dia (sons) pour dis­posi­tifs mobiles (Android) », Master’s Dis­ser­ta­tion , Mons, Bel­gium, 2011.
    @MASTERSTHESIS{Dziamski2011,
      author = {Daniel Dziamski},
      title = {D\'{e}veloppement d'outils de navigation hypermedia (sons) pour dispositifs mobiles (Android)},
      school = {Universit\'{e} de Mons},
      year = {2011},
      address = {Mons, Belgium},
      url = {http://tcts.fpms.ac.be/publications/tfes/2012/dd.pdf}
    }
  • [2010,mastersthesis] bib­tex Go to document
    Huet Stéphane, « Développe­ment d’extensions d’analyse et de classe­ment pour lecteurs mul­ti­mé­dia », Master’s Dis­ser­ta­tion , Mons, Bel­gium, 2010.
    @MASTERSTHESIS{Huet2010,
      author = {St\'{e}phane Huet},
      title = {D\'{e}veloppement d'extensions d'analyse et de classement pour lecteurs multim\'{e}dia},
      school = {Universit\'{e} de Mons},
      year = {2010},
      address = {Mons, Belgium},
      url = {http://tcts.fpms.ac.be/publications/tfes/2012/sh.pdf}
    }