SmartRock

A home assistant built for cavemen and cavewomen.

Comment

Inspiration

  • We were inspired for home assistant devices such as Alexa or Google Home, but made into a rock form for cavepeople.

What it does

  • Understands speech, controls appliances, plays songs, tells jokes, makes coffee, tells the weather and more!

How we built it

  • Hardware: Raspberry Pi 5, ESP32 microcontroller, blender, bambu labs, C++, tasmota
  • Speech to text: RealTimeSTT, python
  • Intent Reasoning
  • Songs: Bandlab

Challenges we ran into

  • Fine tuning AI is not for the weak willed.
  • Our smart plugs are very finnicky, and are difficult to connect to a mobile hotspot, since the Kent WiFi has things that prevent connecting devices like these.
  • It was also quite a hassle to connect our application to our appliances over WiFi.

Accomplishments that we're proud of

  • Set up AWS Bedrock API
  • Reverse engineered HTTP for smart plugs
  • Put a conversational AI agent onto a raspberry pi through API calls
  • Brewed coffee from a single voice command to the application.
  • Created multiple caveman inspired song covers

What we learned

  • We learned how to work with and train AI agents
  • We learned AWS skills
  • We learned about hardware integration with a raspberry pi
  • We learned that using smart plugs is a horrible experience

What's next for Smart Rock

  • Connecting multiple smart rocks together on a network
  • Smart Rock Groundhog Day Mode

Built With

Share this project:

Updates