landing page
sketch to image

VibeCraft : AI-Driven Collaborative Art Platform for Neurodiverse Artists

Inspiration:

We wanted to create something unique and appealing to Gen-Z, a platform that combines technology with creativity in a way that resonates with this generation. We also saw an opportunity to make a real impact by focusing on an underserved community—neurodiverse individuals. These individuals often struggle with traditional art tools, but they excel in creative expression, often in unconventional ways. We believed that combining AI with art could be the perfect solution to help them channel their creativity.

The Idea:

Our original concept is an AI-Driven Collaborative Art Platform designed specifically for neurodiverse artists. The goal was to provide a digital art space where users could co-create artwork with an AI that adapts to their sensory preferences. For example, it would reduce color overload for individuals who are sensitive to certain visual stimuli and suggest patterns based on their focus levels.

Features:

AI Twist: We planned to use StyleGAN to blend users' abstract doodles into cohesive, artistic images, making the AI a creative partner.
Eye-Tracking: Using MediaPipe and the webcam, the platform would detect signs of overstimulation and adjust the UI to keep users comfortable.
MERN Stack: The platform would use Socket.io for real-time collaboration, allowing multiple users to work on art together.
Adaptive Art Galleries: MongoDB would store user preferences and adapt art galleries with filters based on these preferences.

What We Learned:

Building this platform was a journey of exploring how AI can be used to personalize art experiences. We learned about the intricacies of StyleGAN and how to integrate eye-tracking technology to enhance the user experience for neurodiverse individuals. The real-time collaboration feature was also an exciting learning process, as it involved understanding Socket.io and how to manage simultaneous user interactions seamlessly.

How We Built It:

We used the MERN stack (MongoDB, Express.js, React, Node.js) to build the platform. The AI aspect of the project was powered by StyleGAN for image generation. OpenCV was used for real-time image processing, especially for translating sketches into completed artwork. For eye-tracking, we integrated MediaPipe with webcam data to monitor user focus and adjust the UI in real-time.

Challenges:

Due to time constraints, we weren’t able to fully complete all the features we envisioned. However, as of now, the sketch-to-image functionality is working, and we’ve successfully integrated OpenCV for the image processing part. One of the main challenges we faced was balancing the AI's creativity with user input—making sure the AI's suggestions felt like a collaboration rather than a replacement for the artist's vision. We also faced some technical challenges while trying to integrate real-time collaboration and eye-tracking.

Why It’s Unique:

What sets our platform apart is the personalization powered by AI, specifically designed to cater to neurodiverse artists. This project is a blend of inclusivity and creativity, focusing on a community that is often overlooked. The combination of AI-generated art and personalized adjustments based on sensory preferences is something that hasn’t been done before, and we believe it has the potential to revolutionize how neurodiverse individuals express themselves through art.

Future Plans:

Although the project is still a work in progress, we are excited about its potential. We plan to further refine the AI features, complete the real-time collaboration aspect, and integrate more advanced eye-tracking functionalities. We believe this project will continue to evolve and become a valuable tool for neurodiverse individuals, offering them a platform where they can freely express their creativity in a way that suits them.

“Where passion meets AI.”