Inspiration
Our inspiration for this was to leverage the power of AI to make sound design and music making more accessible for everyone.
What it does
Our app is a fully featured digital audio synthesizer that runs entirely in the browser. The app also features an AI assistant that helps the user develop sounds. The user can prompt this assistant with common sound design terminology such as "open" or "plucky", and the assistant will take configure the synthesizer.
How we built it
We built this primarily with React and the Web Audio API. React was used to create the user interface, and the Web Audio API is the primary driver behind the synthesizer. The AI used is Google Gemini.
Challenges we ran into
The biggest challenge we ran into during development was the state management across project. If given the chance, we would prefer to refactor a significant portion of the project.
Accomplishments that we're proud of
One accomplishment that we're proud of is purely the sound of the synthesizer. None of the contributors had any prior experience with audio programming, and we are extremely proud how many features we were able to implement.
What we learned
One thing that we learned is to ALWAYS handle state at the highest possible parent in React.
What's next for aidio
We believe that AIDIO has huge potential in the sound design and audio engineering industry. Although we were only able to implement a prototype during this hackathon, given more time and with more data, we can no-doubt create an amazing product.
We foresee AIDIO being integrated into digital audio workstations to create a smoother learning curve. We can also integrate AIDIO with existing synthesizers to create make even more diverse sounds.
Log in or sign up for Devpost to join the conversation.