-
The Website
Inspiration
This was inspired by RPG games like Deltarune and LLM based projects like AI Dungeon.
What it does
Our project uses the Gemini LLM to creatively guide the player through different scenarios, facing AI-designed enemies with their own twists and quirks. Problem solving and creative solutions to this game are also encouraged by the ML dungeon master.
How we built it
We used a Go backend, React frontend, and the Gemini API as the skeleton of our project. We carefully engineered and curated many prompts working in tandem to create a smooth and robust playing experience. We cleverly manipulated the output formats of the LLM to integrate the AI's decisions into our own representations of the game, such as health bars, stat counters, and inventories.
Challenges we ran into
The documentation for the Gemini model was rather terse, so we spent much time figuring out the idiosyncrasies of the API and model. Additionally, as a small team without frontend specialization, we toiled for hours over the CSS to get it just right. The prompt engineering was another one of our obstacles, since the LLM often refused to output in an accurate JSON, sometimes hallucinating or omitting important tidbits.
Accomplishments that we're proud of
We are especially proud of the final product, providing many entertaining scenarios to work through. The experience is controlled, with few hallucinations and a stronger sense of memory than other LLM-powered adventures.
What we learned
We learned a lot about CSS, React, and prompt engineering, in addition to how Google's generative AI library for Go works.
What's next for AIdventure
Some cool features that we didn't have time to add were minigames that would affect combat and stable diffusion avatars for all the characters.
Log in or sign up for Devpost to join the conversation.