Inspiration
At concerts, people often miss out on the real experience because they’re too focused on recording, editing, and posting clips to social media. We wanted to build something that lets people live in the moment without sacrificing the chance to share the best parts of their night. That’s where Lit(m) comes in — an automated system that captures and shares the highlights for you, so you can focus on the music, not your screen.
What it does
Lit(m) is a Raspberry Pi-powered camera system that captures live concert footage, detects the currently playing song, finds the most iconic lyric, automatically clips that portion of the video, and uploads it directly to your Instagram story. The result is a seamless, AI-curated concert highlight — without ever taking your phone out.
How we built it
- We connected a camera to a Raspberry Pi and wrote Python scripts to manage video capture and file handling.
- Analyze the video using Arc Cloud for real-time music recognition.
- Utilize OpenAI to help identify the most popular lyric.
- Send a full concert clip to Twelve Labs to analyze the video and locate the timestamp that matches the lyric.
- We trim the video to only include that portion using ffmpeg.
- Finally, the clip is uploaded automatically to Instagram Stories after successful login.
The whole pipeline is coordinated with a lightweight Flask backend running on the Pi.
Challenges we ran into
a lot.
Accomplishments that we're proud of
We got everything running smoothly on a Raspberry Pi — including multiple API calls and real-time video processing!
What we learned
How to integrate multiple APIs into a real-time pipeline under hardware constraints. How to process audio and video in sync, and apply AI models to enhance user-generated content.
That it's totally possible to bring together music recognition, video editing, and social media automation — even at a concert.
What's next for Lit(m)?
- Add real-time filters and lighting enhancements using computer vision.
- Support more platforms like TikTok and Snapchat.
- Expand beyond concerts to sports events, festivals, or even graduation ceremonies.
- Build a companion mobile app that lets users customize what kind of clips they'd like featured — without ever interrupting the moment.
Built With
- flask
- mongodb
- openai
- python
- raspberry-pi
- twelvelabs
Log in or sign up for Devpost to join the conversation.