Project Name:
S.A.R.A. – synesthetic augmented reality application – app and performance

Year:
2012 – 2015

Media:
video projectors and sound driven by iOS application for multiple dancers

Project Website:

s-a-r-a.com

Press:

Cellar door press coverage

Paper: Download our research paper 

Click here to download print quality images.

Short Description:

S.A.R.A. – (synesthetic augmented reality application) is an App exploring the potential of using a mobile device as a unique and wearable musical interface. S.A.R.A. was originally developed as a standalone App to translate the surrounding environment into sounds on mobile devices (iPhone and Android) creating a digitally augmented synesthetic experience. The imagery captured via the mobile device’s onboard camera is translated into synesthetic-inspired sounds.

S.A.R.A. documentary by Mars Studio (Thank you ingenuity Cleveland).


S.A.R.A. – synesthetic augmented reality long description:
S.A.R.A.is an App exploring the potential of using a mobile device as a unique and wearable musical interface. S.A.R.A. was originally developed as a standalone App to translate the surrounding environment into sounds on mobile devices (iPhone and Android) creating a digitally augmented synesthetic experience. The imagery captured via the mobile device’s onboard camera is translated into synesthetic-inspired sounds. In its original development S.A.R.A. has been graciously supported with a 2012 National Endowment for the Arts – New Media Artworks Grant.
To demonstrate the capabilities the technology //benitez_vogl (Margarita Benitez Kent State University and Markus Vogl University of Akron) entered into a collaboration with Kimberly Karpanty (Kent State University) and her Travesty Dance Group in July 2012 to showcase the capabilities of the open source device. The choreography calls for several dancers wearing the app playing on a portable device in conjunction with a mini projector.
The App produces the video and the sound based on the camera input and the movement of the dancers. It investigates the use of wearable computing technology during performance as well as loosely bases it’s technological approach on ludological and synesthetic experiences to let the user explore it’s surrounding environments sonically. The role of performer is also augmented as they are now gatekeepers of what sounds are made as well as what images are projected by deciding what live imagery and angles look most appealing to rebroadcast. Performers can choose to project images on themselves, their co-performers or onto the architectural structures of the venue. This format allows for a completely new interaction with wearable technology – augmenting and mediating their performance via several technological input and output mechanisms while still maintaining choreography as well as allowing for subjective choices during the performance. The Human Computer Interaction between the dancers and the technology as extension of their bodies creates an altered/mediated/mitigated performance environment that is always unique to the specific performance venue.

S.A.R.A. is not only an interface and an interactive software application for consumption, play, discovery and joy but is a jump off point for a larger discussion on transformational strategies in regards to both S.A.R.A. as a wearable musical/performance interface but additionally in the Open Source distribution of S.A.R.A. as a tool.
The technology will be released open source and it is potentially possible to custom craft new versions for every performance or for other dance troupes to adapt the technology with their artistic vision. Creating the App for an existing platform device such as an ipod touch and utilizing a relatively inexpensive laser pico projector.

“Our media rich and technology filled life has given rise to a different level of understanding of digital structures. Media developers and artists alike introduce fresh behaviors in the way we communicate and deal with virtual data. The creation of the S.A.R.A. App hopefully will contribute to interesting dialogues by re-contextualizing the simple act of video capture by letting the user listen to their surrounding environments. Producing and releasing the App open source, letting interested users see and work with the code at no cost introduces an alternative to existing business models and in true educational spirit shall foster creative impacts for artists and performers. Critical thinkers can find a fertile ground for discussion and comments based on our approach to create tools for artists rather than artworks.”


S.A.R.A. @ bal ingenuix – 05/2014

Travesty Dance performed with S.A.R.A. at bal ingenuix Cleveland May 3 2014.
performance @ bal ingenuix 2014
Concept, technology and sound: //benitez_vogl
Choreography and dance: Kim Karpanty, Travesty Dance: Kim Karpanty, Michelle Brown, Tania Mucci, Jenny Sandoval Eccher
Video Credit: Keith Knittel
Photo Credit: Abby Steger


S.A.R.A. @ Cleveland Mini Maker Faire – 03/2014

Kent State University Dance performed with S.A.R.A. at Mini Maker Faire Cleveland March 29 2014.
performance @ mini maker faire cleveland
Concept, technology and sound: //benitez_vogl
Choreography and dance:Kim Karpanty, KSU Dance Caroline Dunn, Katherine Scekeres and Michelle Brown
Photo Credit: Andrew Krigline


S.A.R.A. @ Collider6: data – Emily Davis Gallery 10/2013

Travesty Dance Group performed with S.A.R.A. at Collider6: data – Emily Davis Gallery – University of Akron Sept 12 2013.
performance @ Collider6: data:
Concept, technology and sound: //benitez_vogl
Choreography and dance:Kim Karpanty and Travesty Dance company: Michelle Brown, Tania Mucci, Shannon Sefcik, Jenny Sandoval Eccher
Photo Credit: Jeff Snowden
Video Credit: Nick Lopez

S.A.R.A. performance @ Collider6: data The Emily Davis Gallery University of Akron


S.A.R.A. @ bal ingenuix – Halcyon Lodge – 05/2013

Travesty Dance Group performed with S.A.R.A. at Bal Ingenuix – Halcyon Lodge May 3rd 2013.
performance @ bal ingenuix 2012 Halcyon Lodge:
Concept, technology and sound: //benitez_vogl
Choreography and dance:Kim Karpanty and Travesty Dance company: Michelle Brown, Tania Mucci, Shannon Sefcik, Jenny Sandoval Eccher
Photo Credit: Jeff Snowden
Video Credit: Keith Knittel

S.A.R.A. performance @ bal ingenuix 2013 @ Halcyon Lodge


S.A.R.A. @ Cleveland Public Theater – 03/2013

S.A.R.A. is now in beta version and creates it’s own sounds based on the movement of the phone and the input of the camera.
Furthermore it alters the video input and applies several filters. Travesty Dance Group performed with S.A.R.A. at Danceworks 2013 Short Cuts March 28-30 2013.
This is updated documentation of the performance of S.A.R.A. at the Cleveland Public Theater during Travesty Dance Group’s stellar Dance Works performance.
Choreography and dance:Kim Karpanty and Travesty Dance company: Michelle Brown, Tania Mucci, Shannon Sefcik, Jenny Sandoval Eccher
Concept, technology and sound: //benitez_vogl

Beta premiere @ Cleveland Public Theater danceworks 2013: short cuts


S.A.R.A. @ ingenuityfest Cleveland – 10/2012

These images and the video documentation are from Travesty dance companies‘s ALPHA (app without no generative sound) performance at Collider5: ingenuity at the
2012 Cleveland ingenuityfest
Choreography and dance:Kim Karpanty and Travesty Dance company: Michelle Brown, Tania Mucci, Shannon Sefcik, Jenny Sandoval Eccher
Music By Bill Salak.
Photo Credit: Jeff Snowden
Video Credit: Tony Samangy
Concept and technology: //benitez_vogl

Alpha premiere @ ingenuityfest 2012 Collider5:ingenuity


Thank You:

ingenuity

ksu

ua


Who is behind S.A.R.A.:

The App:

Original concept, production and technology: //benitez_vogl
Margarita Benitez: Associate Professor Fashion Design and Fashion Technologist – Kent State University – The Fashion School
Markus Vogl: Associate Professor Graphic Design Interactive Media – The University of Akron – Myers School of Art

Developers:
Chris Yanc (2014-2015)
Erik Krupa (2012-2013)

The Performances:

Original concept, production and technology: //benitez_vogl

Choreography:
Kimberly Karpanty for Travesty Dance Group and Kent State Dance
Associate Professor Dance Kent State University

Dancers for Travesty Dance Group:
Michelle Brown
Tania Mucci
Shannon Sefcik
Jenny Sandoval Eccher

Dancers for Kent State Dance:
Jennifer Ames
Caroline Dunn
Laiana Lanae Lewis
Katie Scekeres
Brittany L.Tosatto

Costume Design and Production::
Margarita Benitez
Alexandria Petrus
Abby Steger
Caroline Dunn

Photography Documentation:
Jeffrey Snowden
Justin Bastock
Andrew Krigline
Abby Steger

Video Documentation:
Keith Knittel
Nick Lopez
Tony Samangy

Special Thanks:

James Krouse and ingenuitylabs
Bob Huff – Myers School of Art
JR Campbell – The Fashion School
College of the Arts – Kent State University
TechStyleLAB – Kent State University
Vince Quevedo – Kent State University
Betsy Carr – Kent State University
Buchtel College of Arts and Sciences – The University of Akron
Travesty Dance Group
Emily Davis Gallery
Tony Samangy for Collider
Chuck Carnak
Daniel Dudley
Scott Kessler