WiiJ Video VJ Software

Live Visuals with the Nintendo Wii Remote

video projection

WiiJ Video is customizable VJ software for mixing video and effects in a live performance environment. It uses the Nintendo Wii remote to manipulate live 2D and 3D video projections in real time. You can control movie clips, OpenGL graphics and effects using gestures and motion tracking, and also record and loop your gestures for a completely improvised performance.

WiiJ Video Demonstration

A demonstration of the WiiJ Video interface.

Using the Wii Remote (a.k.a. Wiimote)

WiiJ Video uses the Wiimote's pointing ability and accelerometers to control movies and effects with simple hand gestures. The two-handed nature when using the nunchuck allows for a powerful control style: selecting effects with one hand and manipulating them with the other.

There are four layers with four effects each. You can control the composite blending of the layers with the D-pad and switch movie clips and effect presets with the buttons. You can also record and loop automations for each effect to layer many effects over each other.

Judgement Day - Finis Omne

This is a music video of a live video performance for the band Judgement Day. The video is entirely improvised using custom-shot clips.

How it Works

Effects are divided into manipulators and generators. Generators can be movies, camera input, cellular automata, spiderwebs and other textures. Manipulators transform the image from the generator into somthing else, like color bias, hue rotation, convolution/blur, kalidescope/mirror transformations, and more advanced effects.

Most of the effects are implemented as shaders in the GPU, so the system is fast enough for real-time performance. WiiJ Video is written in Javascript using the Max/MSP/Jitter platform.

The Wiimote connects via Bluetooth thanks to the aka.wiimote interface by Masayuki Akamatsu. I built a simple USB-powered "sensor bar" using two infared LEDs and attached it to my MacBook Pro for the Wiimote's IR pointing functions.

Gallery

Hey Three EyesFrench MiamiHey Three EyesFrench MiamiHey Three Eyes

These are some stills from a Hey Three Eyes/French Miami concert at Bottom of the Hill, San Francisco, California.

All photos by Drew Beck

Performance Highlights

I have used WiiJ Video for improvisational cinematography in many different shows for many different types of music. If you would like me to do visuals for your band in the San Francisco Bay Area, please contact me.

View Complete Show History >

  • CODAME ART+TECH at DEFCON @ Rio Hotel, Las Vegas, Nevada Saturday, August 3, 2013
  • DrumPants performance at CODAME FASHION+MUSIC @ Public Works, San Francisco Wednesday, June 26, 2013
  • DrumPants performance at the Future of TV Conference @ Yerba Buena Center for the Arts, San Francisco Tuesday, June 25, 2013
  • DrumPants performance at the Augmented World Expo ARt Gala @ Santa Clara Convention Center, California Monday, June 3, 2013
  • MLOVE Festival @ Monterey, California Thursday, April 25, 2013
  • Amon Tobin, Maus Haus, Naytronix, Group Rhoda at Noise Pop 21 @ Public Works, San Francisco Friday, March 1, 2013
  • Urban Prototyping Festival @ 5th and Mission, San Francisco Saturday, October 20, 2012
  • C.A.M.P. Music Festival @ Guerneville, CA Saturday, July 21, 2012
  • Battlehooch with Tornado Rider, Kill Moi, & Sporting Life @ Great American Music Hall, San Francisco Friday, June 8, 2012
  • LSD Interactive Video Installation at Art for Art @ R. Blitzer Gallery, Santa Cruz, California Friday, May 4, 2012
  • MLOVE Confestival with DJ Izzy @ Monterey, California Tuesday, April 24, 2012
  • Mini Maker Faire VJacket demo @ Strata Conference, Santa Clara, CA Tuesday, February 28, 2012
  • Noise Pop 20: Maus Haus with Matthew Dear and EXRAYS @ Public Works, San Francisco Friday, February 24, 2012
  • Battlehooch, Sun Hop Fat, Harry and the Hitmen @ Great American Music Hall, San Francisco Friday, February 3, 2012
  • ACM Multimedia Conference: VJacket Demo @ Scottsdale, Arizona Monday, November 28, 2011
  • 3rd Friday at MAH: Interactive Digital Arts & New Media Exhibition @ Museum of Art and History, Santa Cruz Friday, October 21, 2011
  • Android Open Mini Maker Faire: VJacket with Android @ Hyatt Regency, San Francisco Tuesday, October 11, 2011
  • The Lazy Trio @ Cafe Mitanni, Istanbul, Turkey Monday, September 26, 2011
  • Wearable Technologies paper session and VJacket demo @ ISEA, Istanbul, Turkey Saturday, September 17, 2011
  • All Shook Down Music Festival with Crystal Castles, Maus Haus, Battlehooch and more! @ The Regency Ballroom, San Francisco Saturday, August 6, 2011
  • Battlehooch Special All Night Extravaganza! With Ghost and the City (CD RELEASE), Sun Hop Fat, The Panhandlers @ The Independent, San Francisco Friday, July 1, 2011
  • VJacket demo with DJ Hubsche and a special performance by Battlehooch @ Maker Faire Bay Area Saturday, May 21, 2011
  • Noise Pop 2011: Battlehooch with Nobunny, The Downer Party, Exray's @ Bottom of the Hill, San Francisco Friday, February 25, 2011
  • Maus Haus, My First Earthquake at Audyssey presents THE NEIGHBORHOOD @ 111 Minna Art Gallery, San FranciscoWednesday, November 3, 2010
  • Battlehooch with Golden Animals (LAST NYC SHOW!) @ Piano's, New York, NY Monday, October 25, 2010
  • VJacket Unveiling with Maus Haus @ Treasure Island Music Festival!Saturday, October 16, 2010
  • Nelson Mandela Festival @ Afrikaanderplein, Rotterdam, NetherlandsSunday, June 20, 2010
  • WiiJVideo installation and VJacket performance in collaboration with Alina Parigger and Kunstplatform de Kapsalon at the Kunstroute by TukTuk @ Katendrecht, Rotterdam, Netherlands Friday, June 18, 2010
  • Go-for-IT! Relaunch Festival @ Hoffmanplein, Rotterdam, NetherlandsWednesday, June 9, 2010
  • Battlehooch, Harry and the Hitmen, Moses Campbell, Ghost in the City @ Vulcan Lofts, Oakland, CASunday, March 28, 2010
  • Battlehooch w/ Kid Meets Cougar, Signals @ Beauty Bar, Las Vegas, NVWednesday, March 24, 2010
  • Battlehooch Break Thru Radio NYC Showcase @ Palm Door, Austin, TXWednesday, March 17, 2010
  • Battlehooch Noise Pop 2010 w/ Wallpaper, The Limousines, Butterfly Bones @ Slim's, San Francisco, CAFriday, February 26, 2010
  • Judgement Day, La Fin Du Monde @ Annie's Social Club, San Francisco, CAThursday, November 19, 2009
  • Maus Haus, Church @ Amnesia, San Francisco, CASaturday, October 10, 2009
  • Sugar and Gold, Battlehooch, Vos @ Eagle Tavern, San Francisco, CAThursday, October 8, 2009
  • Battlehooch (with The Toy Soldiers) @ Slim's Nightclub, San Francisco, CAThursday, August 20, 2009
  • Maus Haus @ Bottom of the Hill, San Francisco, CASunday, July 26, 2009
  • Never Knows Best (with So Many Dynamos) @ Hemlock Tavern, San Francisco, CAWednesday, July 15, 2009
  • Battlehooch (with Tempo No Tempo and Hot Toddies) @ The Uptown, Oakland, CAFriday, May 1, 2009
  • Noise Pop 17 Festival: Maus Haus, Sugar & Gold, Tempo No Tempo @ Benders, San Francisco, CAFriday, February 27, 2009
  • Maus Haus, Battlehooch, White Cloud, DJ Gatsby @ Bottom of the Hill, San Francisco, CASaturday, January 24, 2009
  • Fused Circus @ The Vet's Hall, Santa Cruz, CAFriday, January 16, 2009
  • Half Handed Cloud, Pope of Yes, Fertile Cresent @ The Hemlock, San Francisco, CAWednesday, November 26, 2008
  • Battlehooch (with Grand Ole Party, Mr. Tubes)(view video 1) (2) (3) @ The Casbah, San Diego, CAFriday, July 18, 2008
  • Battlehooch (with Howl) @ The Smell, Los Angeles, CAThursday, July 17, 2008
  • Maus Haus, Dark Meat (view video) @ Hemlock Tavern, San Francisco, CAThursday, May 8, 2008