First
Map Generation
Schema

CouchCampaign: AI-Driven D&D-like Couch Multiplayer 🛋️🎲

Inspiration 💡

We wanted to bring the magic of tabletop RPGs into the digital age, making it accessible to anyone with a smartphone and infusing it with cutting-edge AI technology.

What it does 🌟

CouchCampaign is an AI-driven multiplayer game that combines the depth of Dungeons & Dragons with the convenience of mobile gaming. Players create characters and interact with an AI Dungeon Master that dynamically generates the story, NPCs, and world. The game features AI-generated maps, real-time character stat updates, and emotion analysis that influences NPC interactions and the narrative.

How we built it 🛠️

Frontend: React (mobile-responsive design)
Backend: Python with FastAPI
Game Engine: Unity
AI Dungeon Master: OpenAI's GPT-4 with access to a D&D database
Map Generation: Custom diffusion model + classification system
APIs: Hume (emotion analysis during NPC interactions), Meshy (text-to-3D models)

Challenges we ran into 🚧

Integrating multiple AI services and connecting them with Unity
Getting Unity to understand the maps we created
Debugging because there are three systems that are all dependent on each other

Accomplishments that we're proud of 🏆

Creating an AI Dungeon Master with access to comprehensive D&D knowledge
Implementing a sophisticated map generation system using diffusion models
Integrating real-time emotion analysis to influence NPC interactions
Combining three different stacks all together

What we learned 📚

Advanced AI integration in gaming applications
Diffusion models for image generation
GPT function calling

What's next for CouchCampaign 🚀

Implementing quests, dungeons, and towns to expand gameplay
Enhancing the AI's utilization of the D&D database for more complex scenarios
Expanding multiplayer features for collaborative adventures
Further optimizing performance and user experience on mobile devices