What if each pixel in an image corresponded to a specific pitch? What if the brightness level of a pixel determined the length of the note? What if the RGB value of each pixel created three-part harmony?

Seeing Music In Color

Music has many mathematical elements contained therein. The idea to apply pitch to pixels is the concept behind the free software, RGB Music Lab, by Kenji Kojima.

I downloaded RGB Music Lab to try my hand at composing with a picture. During my travels in Turkey last April, one of my traveling companions took this photo of me. Hmmm… I wonder what music I look like, er uh…can I see how I sound?

In this image, I am boating on the Bosphorus Strait, the waterway separating Europe and Asia.

Pixelated Composing

To get started composing, open RGB Music Lab and drag an image onto the right panel, on top of the Mona Lisa image. The program reads the pixels row by row, from the top left to the bottom right pixel, and generates your music.

The settings can be fine-tuned on many levels. For my first piece, I kept most of the default settings and only changed instruments to 3 saxes (Sopr, Alto, Tenor) and increased tempo to 160 BPM. The result is a one minute and 24 second piece. It’s very twitchy, not at all what I imagined this image would sound like! Listen, if you are into twitchy music.

Reduce The Input

I wondered if I took just a snippet of the image; in this case the part of my face centered on my eyes; how would the song change? It turns out, I can’t just change one thing! In addition to changing the image, I adjusted the tempo, the intervals, the tonality, and the instrumentation. Now, this is getting interesting! The result is a 16-second piece, Eyes!

Now to really speed it up! Ooh, I like this two seconds of music.

A Monochromatic Soundscape

In much the same way that a composer works on her project by tweaking and massaging a beginning musical idea or phrase, I continued modifying the image source. After all, it’s the pixels and their RGB values that are providing the foundation for the sound of these compositions.

When listening to Eyes!, I found the last few rows of pixels were more interesting to me than the rest of the music. These rows were very monochromatic in their palette. For that reason, I cut a piece of the monochromatic water from the image and brought that into RGB Music Lab.

This time, I set the instrumentation to voices by choosing #54 Ooh Choir. There are 142 different instruments with everything from clarinet and trumpet and tuba to Rain and Gunshot and Dog. There are nine different types of drum kits, and about that many types of guitars, pianos, and basses.

I also changed the tonality to F harmonic minor. You can choose from major and minor scales, pentatonics, blues, and Gypsy scales. Or you can create your own scale! For a free program, Kenji Kojima has included many features.

In-Depth Free Program

You can have some serious fun exploring all the different settings. I wanted to continue playing with this application and enjoy the sound combinations produced. But if I did that, this edition of Musician’s Motivator wouldn’t get written!

Here is the final (for now) version of Bosphorus Strait by RBG Music and Meg Grace. Enjoy!

If you choose to download this program and compose with your own images, I’d enjoy hearing the music you create. Please send me a link to your composition or send the file itself. Also, let me know whether I can share it with my readers or keep it to myself.

---

Read the next edition of Musician’s Motivator January 27, 2010.