Project Time: 2016 Shown at: ITP Winter Show 2016, STEM Night at New York Hall of Science on Feb 3, 2017 Tech: Arduino, P5.js
“Singin’ in the Rain” is a handmade piano-like instrument, which is played by “raindrops” automatically. The magic is that the “raindrops” showing on the wall will hit the keyboard and play ticking sound. People can enjoy the rain and the rhythm through their voice. In response to people’s voice, the raindrops change patterns to play a variable rhythm on the piano.
Ideation
Inspiration
I want to make an instrument, like a piano, which is played automatically by raindrops. People can enjoy the rain and the rhythm by humming songs, and the raindrops will change their direction according to the human voice.
“Singin’ in the Rain” is the name of my project and also the movie. The poster of this movie strikes a chord with me.
Sketches of idea

Technical Solution
Generate Midi notes in P5.js > Serial communication between Arduino and P5.js
The patterns of the rain come from P5.js. By analyzing people’s voice frequency, different patterns of “raindrops” will be generated, and will play a variable rhythm on the piano.
Paper Prototype


Digital Prototype
ITP Winter Show






I was invited to show this project at the STEM Night at New York Hall of Science on Feb 3, 2017.




Installation Components
Diode: (1N4006)*21Transistor: (PN2222A)*21Super bright LED*21
Projector: LG PB63U Manfrotto arm HDMI HDMI to VGA
Stereo Speakers Stereo Mic USB extension wires *4 Mini USB wire