MediaSync | Devpost

Inspiration

The content creation industry has been transformed by the introduction of GenAI, making it easier than ever for creators to bring their ideas to life. However, challenges still exist for small businesses and content creators looking to manage their social media presence across multiple platforms. From discovering collaborations to analyzing content engagement effectively, MediaSync addresses these needs by integrating GenAI and machine learning to streamline content generation, platform posting, collaboration discovery, and engagement analysis. We specialize in providing multimodal AI experiences using NLX, to improve accessibility to social media for everyone.

What it does

MediaSync is an all-in-one platform dedicated to making GenAI-powered content creation and automated posting accessible for everyone, especially small businesses. Instead of managing multiple social media platforms and coordinating posts individually, MediaSync simplifies it all with just one click. Our platform automatically generates content and directly posts to several platforms, ensuring a consistent online presence. Plus, with our GenAI video creation tool, you can transform text into engaging videos that enhance your social media impact effortlessly.

How we built it

Our content generation and management system seamlessly integrates various AI technologies to create engaging visual content from text inputs. The foundation of our system is built using Node.js, where we leveraged the capabilities of the Google Generative AI and OpenAI Dall-E APIs to generate descriptive scripts and high-quality images based on provided text. We utilized Eleven Labs for converting these scripts into lifelike audio segments, ensuring a captivating narrative experience. The integration of FFmpeg allowed us to combine the audio and generated images into a cohesive video format, optimizing the output for clarity and performance. We also utilized Google Cloud Storage to upload our video files to a bucket, and allow access to the videos from our frontend.

Challenges we ran into

We faced challenged integrating with NLX, however we pulled an all-nighter and figured it out :)

Accomplishments that we're proud of

Dynamic Content Generation Using Google Cloud: Being able to generate social media posts using the Google Cloud API and having dynamic posts for each platform was a key feature for MediaSync. We were able to work with several API's and integrate the ability to get insights for a particular user and post to a platform.

Seamless MongoDB Integration: Our platform used MongoDB as a context tool to work with NLX. We created an API for a creator recommendation system using MongoDB as our data source, and we were very proud to be able to integrate with it.