Inspiration

I love music production, however getting into it is not easy. It took me countless hours spent to make decent beats, and learning how to use a DAW like FL Studio is not straightforward. There are many technical challenges that even today after using for 5 years, I am still unsure how to navigate with it.

I wanted to make an online DAW that allows for anyone to cook up. This is designed to be as intuitive as possible for beginners to pick up production fast and pros to cook up without the need to be on FL or another DAW.

What it does

  • Beat production functionalities like pattern creation with drums, synthesizers
  • Sound imports for anyone to import their kit, with an algorithm that can detect what kind of sound imports they are (hihats, 808, snare, etc.)

How we built it

Next.js, TypeScript, Tone.js for audio processing, React for UI components, Tailwind CSS for styling, and Gemini for LLM-assisted beat generation. I implemented a custom audio engine that handles complex sequencing, synthesis, and audio export functionality. The audio engine leverages Web Audio API through Tone.js to create high-quality synthesizers with effects chains (reverb, delay) and precise timing for beat sequencing.

Challenges we ran into

  • Getting the UI and audio to respond properly to step adds, pause/play/stop, etc.
  • Implementing reliable audio export functionality that correctly captures all tracks
  • Creating a playback system that maintains timing accuracy
  • Designing an intuitive UI that works for both beginners and experienced producers

Accomplishments that we're proud of

  • Gathered insights from 6 producers to tackle this challenge
  • Made beats
  • Got deployed

What we learned

  • Music production is pretty math-heavy.
  • Building a DAW is hard

What's next for Prod

  • Adding a playlist where users can have multiple patterns
  • Adding a mixer and mixing effects like reverb or EQ
  • Fine-tuning the LLM on patterns. Music production is pretty math-based so I would have the LLM correlate the different types of artists to the math that their music reasonates with and from there do a better job at programming the beats with addition to any other variables they specify.
  • Integrating the LLM with mix effects and playlist arrangement.

Built With

Share this project:

Updates