A voice controlled robot using Raspberry Pi

December 11, 2016

Judy Stephen (jls633) & Cameron Boroumand (cb596)

Speech Recognition

We used Google Speech Recognition API so that the robot can listen to user input and recognize keywords.

Object Detection

We use OpenCV to implement a fetch algorithm where the robot will try to find a blue object and go towards it.

Speech Synthesis

We used speech synthesis engine to let the robot reply back to users, such as saying todays date. The robot can also play back songs.


We wanted to create a user friendly final project that would resonate with regular consumers. It would have to be something that could potentially be helpful for everyday life. At the same time we wanted to incorporate speech recognition. Our goal led us to make a pet robot which would utilize both speech recognition and computer vision to create a user friendly environment.


We created a Pet Robot that resembles many of the qualities of your pet at home, except that this one has a microcontroller, a microphone, two servos, and a few wires attached to it. Our Pet Robot reacts to a set of user commands and obediently carries out the tasks it is given. Tell it to “move forward” and it will do so. Ask it to “move right” and it will do so and use its front distance sensor to ensure that it does not run into a wall, in case you were trying to play tricks on it. You may question the robot’s brain capacity, but simply ask it to find a blue or green object in the room. It will find both, and it will even navigate itself towards both of them to prove it to you. Our Pet Robot speaks – you can talk to it and expect a voice response back. We hope that this webpage helps you to understand the design behind our Pet Robot and the various resources we leveraged to enable its multiple functionalities.

We are excited to share our project!

We had so much fun working on this project and learned a lot in the process. We hope you find this website helpful in learning our methodology and tools to create our pet robot.

Learn More

CREATED FOR ECE 5725, Fall 2016

School of Electrical and Computer Engineering

Cornell University

Copyright © , Judy Stephen and Cameron Boroumand

Using theme by BlackTie.co