KhakiAI

Unleash your dance creativity with our app that generates personalized AI music tracks based on your unique moves.

Comment

Inspiration

We set out to create a tool that unleashes dancers' creativity by syncing their moves with AI-generated music that matches perfectly. Inspired by the vibrant dance scenes on TikTok and Instagram, where beats and moves are inseparable, we wanted to take it to the next level. Imagine dancing to music made just for your style, effortlessly turning your moves into shareable, jaw-dropping videos with custom soundtracks. With our tool, dancers don’t just follow the beat—they create it! It's like having your bb DJ that grooves with you.

What it does

KhakiAI allows users to upload or record short dance 6-second videos analyzed by our AI-powered system. The AI tracks the dancers' movements, tempo, and style, generating a custom music track that perfectly matches the rhythm and energy of the performance. Users can further customize the music by selecting different genres or adding sound effects. The tool then syncs the music with the video, creating a seamless, high-quality dance video that can be shared directly on social media.

How we built it

We built this project with a complex tech stack involving several APIs, LLMs, and programming languages. Throughout our programming process, we broke up the task into various parts and pieced them together as we went. To begin, we focused on a key functionality of dance movement recognition with OpenPose/OpenCV. This recognition outputs a JSON that gets put into a MongoDB Database. Then, we use Llama, Tune AI, and Cerebras to pass the JSON through an LLM quickly to create a low latency, so that the user generates the prompt quickly. SunoAPI then uses the generated prompt to create music for the video. Then, we attach it with Python and output it.

Challenges we ran into

There were many challenges involved in the creation of this project. The Suno AI API doesn't have an official API, so we had to rely on an unofficial version API that uses cookies, which lengthened our ability to complete this project, instead of getting the actual API Key.

Accomplishments that we're proud of

We are proud of the way we made a way for computer vision to detect a way to make dance moves generate a prompt for music to text.

What we learned

We learned about computer vision, flask/next.js implementation, and react. We made proper use of version control. I was experienced and used new AI technologies like Cerebras.

Built With

Share this project:

Updates