Archive | Uncategorized RSS feed for this section

Betascape 2012: Art, technology, and magic in Baltimore

27 Sep

This past weekend, I helped to facilitate a relational art workshop in Betascape’s physical computing lab with Kawandeep Virdee.  Betascape is an annual weekend long Art & Technology Exploratorium in Baltimore, MD.  This year betascape was held at the Maryland Institute College of Art (MICA) which was a nice deviation from the technology oriented venues that often host collaborative hands-on explorations in Boston.

Betascape’s keynote speakers included Nathalie MiebachHod LipsonMarco Perry, and Nervous System; talks covered Nathalie’s incredibly complex data-based sculptures, a fascinating look into the future of 3d printing, the DIWire bender for rapid prototyping, and Nervous System’s beautiful nature-inspired computer-generated digitally-fabricated designs.  The labs hosted live 3D printing and scanning demonstrations, workshops in data visualization, and many opportunities for participants to build, program, and make art.

Check out my betascape flickr set for photos.

What is relational art?

Relational Art is an emerging movement in art identified by Nicolas Bourriaud, a French philosopher, who recognized a growing number of contemporary artists used performative and interactive techniques that rely on the responses of others: pedestrians, shoppers, browsers—the casual observer-turned-participant.”

Kawan and I discussed physical computing, which explores how humans and environments engage with computers via sound, heat, motion, light, and other inputs, as a playground to build highly interactive and collectively experienced relational art.  In collaborating with Kawan, I realized that the goals of relational art align closely with the goals of exhibit design in museums; both relational art pieces and museums exhibits seek to provoke dialogue, questions, and ways to collectively interact with ideas.  At a science museum, cultivating skepticism and discussion about research is an important component of the scientific perspective.  It is easy to fall into a one-visitor-per kiosk model when you want to deliver a clear content message in a science museum, but a more social experience can better deliver content with curiosity.

Read more at relational art and complex systems.

ofxTessellationBuilder, a relational art sketch for betascape

For the workshop, I shared an open source relational art piece called ofxTessellationBuilder that allows up to 7 people to interact through touch.  The physical interface was a MaKey MaKey attached to 7 rings which are each grabbed by one person.  One person holds the special earth ring to literally serve as ground in the circuit and the other (up to 6) participants can touch this grounded person to add a specifically colored ring to a dynamic tessellation called the flower of life.

ofxTessellationBuilder screenshot showing colored rings forming a dynamic tessellation

ofxTessellationBuilder screenshot showing colored rings forming a dynamic tessellation

The MaKey MaKey detects touch, but works like a keyboard encoder under the hood, so you can test the software by using the keys ‘a’, ‘s’, ‘d’, left arrow, down arrow, and right arrow (each mapped to a different color).

Things get more interesting when you start to count how many participants are grounded at once; what happens if two or three people connect to ground at the same time (either directly or through one another as a proxy)?  I programmed special behaviors for these situations from 2-6 people grounding at once.  Two people causes colors to merge into one ring, three causes the tessellation to break apart and reform, 4 is a more aggressive explosion, 5 shows participants through a webcam view, etc.  The additional behaviors help encourage participants to physically connect in different ways. ofxTessellation builder came together rather quickly due to some simple magic that helped to make it more interactive.

Simple magic for relational art

  1. Try doubling your sensors:  Detecting heartrate?  How does the experience change when two people can compare heart rate directly?
  2. Leverage emergence through simulation: ofxTessellationBuilder uses a 2D physics engine to simulate forces, collisions, and complex behavior.  I was delighted to see one ring orbiting a larger mass of rings as I had not planned for anything like this.
  3. Use multiple inputs in combination: Having the software respond to different combinations of the 6 keystrokes allows for very complex interactions
  4. Use bright colors: this came up throughout the betascape conference; bright colors are magical and people enjoy interacting with colorful experiences
  5. Simplify technology: the MaKey MaKey’s keystroke behavior made it very fast to test software and handle input (I used keyPressed events rather than parsing arduino serial data).  Museums routinely use keyboard encoders in kiosks and interactives because they are easy to maintain, troubleshoot, and simulate w/ a regular computer keyboard for software testing.

The arduino orchestra

The first day of our workshop was exploratory with demos, discussions, and brainstorming around relational art ideas.  We tinkered with sensors, discussed inputs and outputs, and visioned ways to make experiences more collective.

For the second day, we wanted to focus and build something collaboratively based on our explorations.  The resulting vision was to create an arduino-theramin orchestra using range finders and piezo speakers.  Here’s a time-lapse video of day two showing the physical computing lab jamming on soldering speakers, programming arduinos, and playing custom microcontroller-based musical instruments.

Kawan posted the rangefinder code for the arduino theramin which was tweaked for our workshop by Amy Lee (thanks!). Check out our collaborative notes for the workshop here:

Arduino based theramin with range finder by @not_rollergirl

Arduino based theramin with range finder by @not_rollergirl

Thanks a million to everyone who made Betascape possible and totally magical (especially Matt Forr and Heather Sarkissian)!

Creating Museum Media for Everyone; developing DIY Toolkits for UD and UDL

23 Jun

In May 2012, the Museum of Science in Boston hosted the 2012 Creating Museum Media for Everyone workshop to develop tools and strategies for universal design (UD) and universal design for learning (UDL).  The first two days featured talks and demonstrations from  experts on creating inclusive museum environments and building engaging interactive experiences for visitors with a wide range of disabilities.  For the rest of the week, researchers, accessibility experts, designers, and creative programmers worked together in four teams to prototype a dynamic haptic interface for exploring graphs, gesture-based descriptive audio layers for multitouch surfaces, a physical interface for exploring graphs via data sonification, and strategies for personalizing exhibit and museum experiences to increase accessibility.

Here are some of the outcomes from the workshop which show the power of collaboration in rapid prototyping.  The following demo shows how a user might explore a graph via touch and sound through a physical sonification interface.  Two axes move above a tactile graph which produces sound to represent data:

A similar haptic interface was created with vibration instead of sound to represent data points on a two dimensional graph:

haptic graph exploration tool

haptic graph exploration tool

Touch tables offer interesting accessibility challenges in a shared interactive space like a museum.  This prototype uses an audio puck to allow users to explore a multitouch surface with touch, sound, and vibration:

 touch table with haptic fiduciary markers

touch table with haptic fiduciary markers

The workshop has created some powerful momentum within the accessibility and museum communities.  I had the pleasure of working with Sina Bahram, a doctoral student from North Carolina State University, on the sonification prototype.  Sina has since developed a mobile device platform for exploring astronomy data through touch and sound as seen in this demo created for the 2012 transit of venus across the sun:

Some of the ideas represented in the CMME workshop have already made their way into new exhibit designs at the Museum of Science.  More links as tools/resources are shared publicly!