What it does Shopiverse is an interactive 3D virtual store platform. It allows users to "walk" through a real-world shop captured via Gaussian Splatting, offering a photorealistic 3D environment rather than a video game simulation. Users can navigate the space, look around freely, and interact with products naturally.
The platform now features "Lobo," an AI-powered personal shopping assistant that travels with users, answering questions about products in real-time. For store owners, Shopiverse provides a powerful Visual Graph Editor to design store layouts and a detailed Spatial Analytics Dashboard. This dashboard goes beyond simple clicks, tracking "dwell time" and 3D gaze heatmaps to understand exactly which products catch a customer's eye, combining the fidelity of a physical visit with the data-driven utility of e-commerce.
How we built it We built Shopiverse using React and Vite for the frontend framework. The core 3D experience is powered by Three.js and the @mkkellogg/gaussian-splats-3d library, which renders high-fidelity Gaussian Splat .ply files directly in the browser.
We architected a hybrid backend using FastAPI (Python) to handle complex data persistence for scene management and our custom analytics engine. The Lobo chatbot is powered by Google Gemini 2.0 Flash, analyzing user queries in the context of the current 3D scene to provide helpful, context-aware answers.
To create the Gaussian splats, we used ML-Sharp and GPU processing. We solved the navigation challenge by building a custom Visual Graph Editor from scratch, allowing store owners to intuitively "draw" connections between different 3D scenes (nodes) to create a walkable map. We also utilized Git LFS to manage the massive 3D model datasets efficiently. We also added smart routing, as the arrows on the floor of the store blinks in correspondence to where we want the customer to go next.
Accomplishments that we're proud of We are particularly proud of the "Multi-Splat" composition engine, efficiently loading and aligning multiple heavy 3D scans in the browser.
We are also incredibly proud of the Spatial Analytics Engine we built. Unlike traditional web analytics, ours tracks user movement and gaze within the 3D space, logging events like "virtual dwell time" and navigation decisions to a CSV-based backend. Finally, the seamless integration of Lobo (the AI assistant) feels like a true "virtual clerk," transforming the experience from lonely browsing to interactive shopping.
What's next for Shopiverse With the "virtual clerk" and navigation portals now successfully implemented, the next step for Shopiverse is to "Shop with Friends"—a multiplayer mode where users can see each other's avatars and chat while exploring the store together. We also plan to implement AR Look-and-Point, allowing users to project the 3D products into their own room to verify size and fit before purchasing.
Log in or sign up for Devpost to join the conversation.