WiiJ Video VJ Software
Live Visuals with the Nintendo Wii Remote
WiiJ Video is customizable VJ software for mixing video and effects in a live performance environment. It uses the Nintendo Wii remote to manipulate live 2D and 3D video projections in real time. You can control movie clips, OpenGL graphics and effects using gestures and motion tracking, and also record and loop your gestures for a completely improvised performance.
WiiJ Video Demonstration
A demonstration of the WiiJ Video interface.
Using the Wii Remote (a.k.a. Wiimote)
WiiJ Video uses the Wiimote's pointing ability and accelerometers to control movies and effects with simple hand gestures. The two-handed nature when using the nunchuck allows for a powerful control style: selecting effects with one hand and manipulating them with the other.
There are four layers with four effects each. You can control the composite blending of the layers with the D-pad and switch movie clips and effect presets with the buttons. You can also record and loop automations for each effect to layer many effects over each other.
Judgement Day - Finis Omne
This is a music video of a live video performance for the band Judgement Day. The video is entirely improvised using custom-shot clips.
How it Works
Effects are divided into manipulators and generators. Generators can be movies, camera input, cellular automata, spiderwebs and other textures. Manipulators transform the image from the generator into somthing else, like color bias, hue rotation, convolution/blur, kalidescope/mirror transformations, and more advanced effects.
Most of the effects are implemented as shaders in the GPU, so the system is fast enough for real-time performance. WiiJ Video is written in Javascript using the Max/MSP/Jitter platform.
The Wiimote connects via Bluetooth thanks to the aka.wiimote interface by Masayuki Akamatsu. I built a simple USB-powered "sensor bar" using two infared LEDs and attached it to my MacBook Pro for the Wiimote's IR pointing functions.
Gallery
These are some stills from a Hey Three Eyes/French Miami concert at Bottom of the Hill, San Francisco, California.
All photos by Drew Beck
Performance Highlights
I have used WiiJ Video for improvisational cinematography in many different shows for many different types of music. If you would like me to do visuals for your band in the San Francisco Bay Area, please contact me.
- Nelson Mandela Festival @ Afrikaanderplein, Rotterdam, NetherlandsSunday, June 20, 2010
- Go-for-IT! Relaunch Festival @ Hoffmanplein, Rotterdam, NetherlandsWednesday, June 9, 2010
- Battlehooch, Harry and the Hitmen, Moses Campbell, Ghost in the City @ Vulcan Lofts, Oakland, CASunday, March 28, 2010
- Battlehooch w/ Kid Meets Cougar, Signals @ Beauty Bar, Las Vegas, NVWednesday, March 24, 2010
- Battlehooch Break Thru Radio NYC Showcase @ Palm Door, Austin, TXWednesday, March 17, 2010
- Battlehooch Noise Pop 2010 w/ Wallpaper, The Limousines, Butterfly Bones @ Slim's, San Francisco, CAFriday, February 26, 2010
- Judgement Day, La Fin Du Monde @ Annie's Social Club, San Francisco, CAThursday, November 19, 2009
- Maus Haus, Church @ Amnesia, San Francisco, CASaturday, October 10, 2009
- Sugar and Gold, Battlehooch, Vos @ Eagle Tavern, San Francisco, CAThursday, October 8, 2009
- Battlehooch (with The Toy Soldiers) @ Slim's Nightclub, San Francisco, CAThursday, August 20, 2009
- Maus Haus @ Bottom of the Hill, San Francisco, CASunday, July 26, 2009
- Never Knows Best (with So Many Dynamos) @ Hemlock Tavern, San Francisco, CAWednesday, July 15, 2009
- Battlehooch (with Tempo No Tempo and Hot Toddies) @ The Uptown, Oakland, CAFriday, May 1, 2009
- Noise Pop 17 Festival: Maus Haus, Sugar & Gold, Tempo No Tempo @ Benders, San Francisco, CAFriday, February 27, 2009
- Maus Haus, Battlehooch, White Cloud, DJ Gatsby @ Bottom of the Hill, San Francisco, CASaturday, January 24, 2009
- Fused Circus @ The Vet's Hall, Santa Cruz, CAFriday, January 16, 2009
- Half Handed Cloud, Pope of Yes, Fertile Cresent @ The Hemlock, San Francisco, CAWednesday, November 26, 2008
- Battlehooch (with Grand Ole Party, Mr. Tubes)(view video 1) (2) (3) @ The Casbah, San Diego, CAFriday, July 18, 2008
- Battlehooch (with Howl) @ The Smell, Los Angeles, CAThursday, July 17, 2008
- Maus Haus, Dark Meat (view video) @ Hemlock Tavern, San Francisco, CAThursday, May 8, 2008
