MusicPlant (Version 2.0)
Provides information about Media Art work.  
About MusicPlant

 



 

The Musical Plant is a virtual life that resides in a PC and accepts signals from a MIDI control devices such as a keyboard. This is a mysterious device that when you play any song on the electronic piano, a different song is generated and played back based on that song. When you start playing, a virtual plant displayed on the monitor will start to grow.

The shape of the plant is not fixed, but reflects what you played at the time. A certain rule is assigned between the notes on the scale and the direction in which the branches grow. When the player hits one key on an electronic piano, a branch is added to the plant. Furthermore, if you hit two keys at the same time, two branches will grow at the same time. The plant grows as it receives MIDI signals, and it takes a shape that is determined by the characteristics of the input. The shape thus becomes a reflection of the MIDI input. Some MIDI songs will generate complex shapes while others will generate relatively simple shapes according to the musical form of the MIDI song.
Before the player begins to input a MIDI signal, the primitive plant with a stem is at the center of the PC display. As signals are input, branches are added to the plant. Each MIDI note generates a branch of the plant. The angle of each branch is determined by the musical context of the note. Plant characteristics such as branch angle and length are changed with respect to MIDI parameters such as note number and note intervals.
 

After a while after the performance stops (input of the MIDI signal stops), the plants will be redrawn and the playback of song will begin. Each branches being redrawn creates a series of sounds. When a branch is drawn, the sound assigned to the branch is played, but this sound is not the same as the sound when the branch was generated. It is converted according to certain rules. The sound intervals are derived from the notes that made the branch.

In the drawing where branches are drawn from the base of the plant, the time flow is the same, but the sound produced when redrawing is the original pitch reversed. For example, if the pitch of a major chord is flipped, it becomes a minor chord. This is because a chord made by stacking a minor third and a major third is converted into a chord made by stacking a major third and a minor third. As for the entire song, songs in a major key are converted into songs in a minor key, and songs in a minor key are converted into songs in a major key, so bright music is played back as gloomy music, and gloomy music becomes bright music.
I call this vertical reversing of music.
Vertical reversing means that redrawing proceeds in the same order as in creation, but the sound of each redrawing branch reverses the interval of the original note. That is, when the interval is reversed, higher notes become lower notes. Also, when reversing is applied, minor chords become major chords since the relation of notes is reversed.
The musical plant analogy provides a way to visualize the composition and decomposition processes. For example similar MIDI songs will tend to generate similar plant shapes. The music plant analogy also aids in determining the essential elements of a "good tune". Many well-known songs also sound good when played in reverse order. The more musical the original performance, the more musical the music returned when redrawing. If you play randomly, the music returned when redrawing will also sound random.
Concept 

(1) Visualize Sound structure.
(2) Illustrates the fact that reverse music still holds some texture of original tune.

Exhibition
Watch the Video Real Video In the first half of the video, you can not see the screen clearly, but in the later half of the video, the screen will be closed up.
Prototype version    
Old version  
Production History

When the first version of this work was first released in 2000, it used Microsoft's DirectX technology for rendering. More than 20 years later, when development of a new prototype began, support for DirectX technology had been discontinued, so the entire work was redeveloped from scratch using the same concept. After several rounds of trial and error in developing the prototype version, it underwent significant revisions and was completed as version 2.0 for exhibition at the "Seto Line Art Gallery Project." In addition to revamping the rendering to fit the concept of the "Seto Line Art Art Gallery Project," improvements were also made to enable simultaneous playing of multiple instruments, such as piano and guitar.
Contents of previous versions can be viewed on MusicPlant's Old Versions page.

Exhibition Log
2024/11/23 - 24 Ogaki Mini Maker Faire - NxPC (Stage Performance)
2024/11/14 - 17 MikanoharArt (Kyoto pref.) - Darkroom Exhibition
2024/03/24 NT Kyoto - Darkroom Exhibition
2024/02/01 - 2024/02/29 KANSEI SAKUMACHI (Seto-line (Seto Line Art Gallery Project))