TreasureAR

We created an AR game for treasure hunt with dynamic games and riddles using gen AI

Comment

🧠 Inspiration
We set out to design a game that gets players moving, thinking, and connecting — all at once. Drawing motivation from Pokémon Go, classic scavenger hunts, and multiplayer games, we wanted to blend augmented reality, education, and exploration into a fun, socially engaging platform.

🎮 What it does
TreasureAR is a multiplayer AR treasure hunt that brings the real world to life. Players explore physical locations to uncover hidden clues, solve AI-crafted riddles tied to landmarks, and face off in mini-games like “Steal the Reel,” a computer vision-powered rock-paper-scissors challenge. It promotes movement, curiosity, and collaboration while tracking progress in real time through MongoDB.

🛠️ How we built it

  • Frontend: Web-based AR developed with JavaScript, AR.js, and Three.js
  • Backend: Node.js + MongoDB with Socket.io for real-time multiplayer sync
  • AI: Gemini API used to generate dynamic riddles from live location data
  • Computer Vision: TensorFlow.js and MediaPipe power gesture recognition for mini-games
  • Hosting: Currently runs on a local network, with future deployment planned for the cloud

🧱 Challenges we faced

  • Optimizing real-time AR performance on mobile browsers
  • Managing GPS drift and AR marker instability outdoors
  • Maintaining gesture recognition accuracy under varying lighting
  • Synchronizing multiplayer states smoothly through WebSockets
  • Structuring AI riddles to adapt meaningfully to diverse locations

🏆 Proud accomplishments

  • Developed a fully functional real-time multiplayer AR treasure hunt
  • Created a browser-based gesture-controlled mini-game
  • Successfully integrated AI-generated riddles using the Gemini model
  • Encouraged exploration, learning, and physical activity through interactive play

📚 Key learnings

  • The synergy of combining AR, AI, computer vision, and multiplayer systems
  • Applying computer vision effectively within browser-based environments
  • Building robust and fail-safe multiplayer logic in real time
  • Crafting richer, location-aware AI prompts for educational riddles
  • Designing clear and playful UX for mobile AR experiences outdoors

🚀 Next steps for Treasure AR

  • Migrate to cloud hosting for broad public access
  • Introduce new themed mini-games and treasure hunts
  • Enable educators and event organizers to create custom quests
  • Enhance AR visuals with 3D models, animations, and player avatars
  • Launch seasonal hunts in collaboration with schools, tourism boards, and festivals

Built With

Share this project:

Updates