MOLECULE

Molecule / Test installation

Motion Capture + Lightsabers

Wireless body tracking at 60 fps.
Bokken swords with lights that change color as they move.

Contribution
Russell Jahn
C++ body tracking software + lights and sensors for bokken
Context
A small test installation at PixelPerf Market, Moongoat Coffee
A visitor using an illuminated bokken beside the vertical body-tracking screen at PixelPerf Market.
PixelPerf Market / Moongoat Coffee.

At PixelPerf Market in Moongoat Coffee, visitors could try body tracking on a TV and bokken swords with lights.

Camera-based body tracking #

Visitors could walk in front of a large vertical TV and see lines drawn over their bodies in the live video. No motion capture suit was needed.

A custom C++ application turns video from a high-speed webcam into 3D body points and draws a wireframe over the image at 60 fps.

A visitor winding up an illuminated bokken beside the body-tracking display.
Body tracking + light props / PixelPerf Market.
A visitor pointing an illuminated bokken toward the body-tracking screen.
Live wireframe overlay on the vertical display.

Bokken swords #

Wooden martial arts practice swords (bokken) are fitted with IMU sensors, speakers, and LED strips. The sensors track which way each sword points, and the lights change color to match.

Each direction has a different color. Point a sword north and it always shows the same color, wherever you are.

A visitor spinning a bokken at PixelPerf Market as its lights change color.
Bokken demo / PixelPerf Market.

PixelPerf Market #

Visitors watching the bokken and body-tracking demonstration inside Moongoat Coffee.
The test installation at Moongoat Coffee.
A young visitor holding an illuminated bokken beside the display and Molecule banner.
PixelPerf Market / Moongoat Coffee.

Custom Patch computer #

Patch is retrofitted with a custom, hand-built LED display that renders animated images. It was custom built with specific hardware to stay compact and run the motion capture software at 60 fps.

Patch / animated LED eyes.
Looping LED matrix animation on the custom Patch computer.
Patch / LED matrix animation.

Bokken prototypes #

An early bokken lightsaber prototype held horizontally, with the exposed LED strip illuminated in several colors.
Early bokken lightsaber prototype.
An illuminated bokken prototype leaning upright against a wall.
Illuminated bokken prototype.

Current hardware work #

Current Molecule projects include lightsabers and motion capture devices, with custom software for their lights and sensors.

Enflux motion capture applications + tools →

For project inquiries + collaborations.

Contact me