Hand Music is a computer vision-based multisensory project embarked on by me and my friends when we competed at the 2025 TartanHacks, the largest hackathon in Pittsburgh, where we won 3rd overall place. Hand Music is an instrument that allows the user to play chords and notes using their hands. The user can select different scales, chords, and can select a variety of effects such as volume, distortion, portamento, vibrato, and panning all with their webcam and two hands. The project was implemented using Javascript.
View on GitHub →My high school senior research project was a piano visualizer that was to be an audiovisual piece. I started the project because I felt that music had form and colors that could be expressed through visuals. Thus, I programmed this visualizer in Python. The visualizer uses Pygame for the graphics, and uses a neural network to detect facial emotion using TensorFlow. The facial emotion controls the color of the visuals. The visualizer has 3 visual presets, and allows for live MIDI input or using a MIDI file.
View on GitHub →