Inspiration
Often times tedious task and assignments that require significant practice can be mundane and boring to most students. We wanted to find a way to apply generative AI to solve this challenge, Specifically in the practice of writing a critical skill all students are required however it can be a dull chore.
What it does
Our platform allows students to write practice their writing skills in a fun and engaging way. The students enter a paragraph in a story they write and generate an image using Open AI's Dall-E image generation model.
How we built it
we used Replit and Django to host our project, we connected to the Dall-E via API. In order to generate quality results we had to turn user writing passages into quality prompts. This included parsing and removing filler words in user inputs. We used bootstrap to help build an interactive and visually appealing interface.
Challenges we ran into
We ran into many challenges while building this system. First of all, connecting openai to our system via secret key was a hassle. We were able to get past this roadblock by attending the chatgpt plugin workshop and figuring out how using openai works with our system. We also had issues trying to retrieve and show the image to the user after accepting the prompt. The answer of that problem finally came to us through a lot of trial and error.
Accomplishments that we're proud of
We are really proud of getting the API to connect and retrieve images and submit prompts. This was one of the harder parts of the project and a major milestone in making this project. Once we accomplished this we were able to build our interface and build a consistent and stable prompting format.
What we learned
We learned how to build a full stack web application using Django. This was a new task that multiple team members were new too. It proved to be valuable to learn how to connect the backend and frontend of a web application. In order to build a robust and effective application that is easily accessible to users via the web.
What's next for Visual Tales
We plan to add more features to our platform in order to store whole stories together and have a viewing mode to look through finished stories. We also plan to add security features including a login page and different user roles including teachers and students. In order to allow teachers to better record assignments.
Log in or sign up for Devpost to join the conversation.