Inspiration

We were inspired by apps and AR games that use image detection AI and wanted to learn more about opencv. We came up with ideas that either involve color detection or shape detection, but opted to just include shape detection for this hackathon.

What it does

It allows kids to learn in a fun and interactive way about different shapes, and also provides a surprisingly difficult speed-drawing challenge.

How we built it

We used opencv, numpy, and Canny edge detection to detect and identify shapes in real time. Python, pygame, and moviepy were used to create the game. Procreate and Imovie were used to create all our assets.

Challenges we ran into

We ran into issues with different lighting making it hard to detect the shapes so it is hard to find a threshold to detect only the shapes and not objects and patterns in the background. We also ran into small issues with creating the menu with pygame_menu since it didn't give us much options. We ended up redoing our menu to create our own user interface designs.

Accomplishments that we're proud of

We got opencv to detect and tell us what shape is drawn in real time. None of us worked with opencv before so it was a huge accomplishment for us. We were surprised that all of us stayed up until 7am finishing this project, too!!

What we learned

How to code with opencv and detect real time vision and how to add cutscene movies to pygame.

What's next for ShapeIt!

We were able to figure out how to detect colors in real time through opencv as well. We plan on making our game expand to matching different colors shapes to teach kids about shapes and colors.

Built With

+ 2 more
Share this project:

Updates