result
Designed by
Jiamin Zeng(jz863), Zhenyan Zhang(zz488)
result
Do
Re
Mi
Fa
So
La
Si
Overall, our project successfully implemented a gesture-controlled piano. When the design is powered on, it will automatically run our design program. The seven sensors representing the seven keys in a piano can detect the movement of our fingers and generate a falling down signal to the corresponding GPIO pin. When the callback in our program detects the falling edge from the GPIO pin, it will play the corresponding key sound and the name of that key will be displayed on the RPi screen at its own position with its own color.
For this project, as we have changed sensors during the testing, we did not do much extensions. However, there are many future extensions can be implemented. For example, we can add more sound for the piano, and allow the user to input different gestures at the same time and output the corresponding sounds together. Also, we could add a function to record the sound and replay it when press a certain button. Perhaps we could add other instruments and mimicking its sound, and the user can select the mode for different instruments.