πŸŽΆπŸ›‘οΈ Problem Statement

  • Imagine this: What if Drake, before rising to fame, had his music stolen or copied by a larger, more established artist? Unfortunately, this scenario is all too real for countless up-and-coming artists, especially those from marginalized backgrounds such as members of the black community!

  • Moreover, the need for inclusivity and respect in music is underscored by statistics from the Recording Industry Association of America, which reports that as of 2023, over 32% of music listeners have encountered offensive or discriminatory content in songs they've listened to. This highlights a pressing need for tools that enable musicians to identify and rectify potentially harmful content within their music.

🌟Our Inspiration

  • Motivated by the urgent need to empower marginalized aspiring artists and ensure their music remains their own, we initiated the development of SafeTune.

  • According to a report by the International Federation of the Phonographic Industry (IFPI), global music piracy remains a pressing issue, with an estimated 53% of small musicians having their work plagerized and used without knowledge.

  • Utilizing technologies such as Flask, Cohere, and Flow, and our own custom model in Pytorch that compares melodies and lyrics of songs, we've crafted a platform dedicated to safeguarding the originality of small artists' music while promoting inclusivity and respect within the music industry!

πŸ€”What it Does

  • SafeTune ensures your music's uniqueness by analyzing your MP3 file and comparing it against existing songs to check for infringement violations using a custom Dual-headed LSTM model(a recurrent neural network good at capturing and remembering information over long sequences -> useful in our application for song NLP and melody analysis) built from scratch, Cohere, YouTube API, and then storing them on the blockchain using the Flow SDK.

  • Utilizing highly advanced technologies like the seamless Cohere embed, chat, and rerank endpoints and the Spacey library, SafeTune also scrutinizes your music for offensive language or racial comments to uphold inclusivity.

  • SafeTune streamlines your workflow by condensing lengthy music-related documents such as song lyrics into concise and actionable summaries using Cohere Summarize, saving valuable time and resources when learning about some of the songs on our blockchain.

πŸ‘©β€πŸ’» How we built it

  • Backend Development: The backend logic was implemented using Python libraries such as Flask, Librosa, and Spacey for audio feature extraction and analysis and PyTorch for building and training our clever deep learning model.

  • API Integration: We are proud to say we have used every single Cohere API endpoint for various purposes, including Summarize for text summarization, Rerank for analyzing lyrical content, and Chat with RAG (Retrieval-Augmented Generation), Classify, and Embed for semantic analysis. We have also extensively used the Flow API for deploying songs onto the blockchain to ensure full ownership!

  • Frontend Development: The frontend of SafeTune was developed using Next.js, a React framework that provides server-side rendering and a great developer experience, and Tailwind.

🚧 Challenges we ran into

  • Developing the LSTM Model took considerable time as it was our team's first experience with this type of modeling.

  • Integrating Cohere APIs alongside libraries like Spacy and Librosa required careful coordination and troubleshooting.

  • Working with PyTorch for our modeling added complexity, demanding continuous learning and adaptation.

  • Decreasing overall latency demanded iterative optimizations for seamless user experience.

  • Deploying MP3 files on the blockchain, especially with uploading to IPFS for the Flow API, posed a huge problem since we weren't able to find an API for integrating IPFS upload into our app until the last minute🀯

πŸ† Accomplishments that we're proud of

  • Successfully harnessing the full potential of the beautiful Cohere API by seamlessly integrating all endpoints provided by Cohere together!.

  • Mastering the deployment of files on the blockchain using the superb Flow SDK !

  • Launching a fully functional web product, pioneering protection for marginalized artists and their invaluable works.

  • Rapidly acquiring proficiency in Spacy and Librosa within a short timeframe.

  • Collaborating with an exceptional team, leveraging diverse strengths to overcome challenges and achieve success.

✨What we learned

  • Launching a fully functional web product, pioneering protection for marginalized artists and their invaluable works.

  • Rapidly acquiring proficiency in Spacy and Librosa within a short timeframe.

  • Working alongside an outstanding team, we learned how to play against our strengths in order to finish this huge project!

πŸ“ˆWhat's next for SafeTune

  • Our next focus is to continue optimizing our platform to decrease latency even further, ensuring a seamless and responsive experience for all users

  • We aim to implement an integrated web copyright system, providing artists with a comprehensive solution to protect their original work online.

  • In our upcoming development phase, we plan to introduce a robust reporting mechanism that allows users to report copyright infringements efficiently.

  • Add royalties to our blockchain system to allow the artists to earn money as their pieces of art are shared.

🎡Why Safetune

SafeTune stands out as a groundbreaking solution aimed at protecting the original work of marginalized artists while fostering inclusivity and respect in the music industry. By seamlessly integrating advanced technologies like Cohere, and Flow Blockchain, SafeTune provides a user-friendly platform that empowers artists to safeguard their creativity and bridge generational gaps in music preservation.

πŸ… Best Build with Cohere: SafeTune is a frontrunner for the Best Build with Cohere award due to its innovative use of Cohere's API endpoints (Yes we used all of them πŸ˜† !!). By leveraging this technology, SafeTune simplifies the process of protecting original music, making it more accessible for artists facing memory ailments and enhancing their connection to their creative legacy.

πŸ… Best Flow Application: SafeTune is poised to excel in the Best Flow Application category by harnessing the power of Flow Blockchain to revolutionize music copyright protection. By leveraging Flow's decentralized infrastructure and smart contract capabilities, SafeTune ensures immutable and transparent record-keeping, empowering artists with greater control over their creative rights. Tell me this isn't the most unique application of blockchain in a hackathon product!

πŸ… Best GoDaddy Domain Name: SafeTune's domain name, Saveourheritagewith.us, hits all the right notes! 🎢 It's not just a web address, it's a commitment to preserving musical legacies. πŸŽ΅πŸ”’

πŸ… Best Black Hack: As a project committed to empowering marginalized artists, SafeTune embodies the spirit of the Best Black Hack category. By providing a platform that specifically addresses the needs of artists from the black community, SafeTune amplifies their voices and ensures equitable access to music copyright protection tools.

Built With

Share this project:

Updates