Inspiration
Buying a home or even just browsing for properties can be overwhelming and time-consuming. We wanted to simplify the process by creating an engaging, interactive platform that lets you explore listings in a natural, fun way—like flipping through a magazine, but with technology that helps you connect instantly.
What it does
HomeSuite offers a swipe-based property exploration feature, voice interactions for real-time Q&A with listings, and gesture-controlled browsing for hands-free exploration. You can also search by location and radius, then seamlessly chat with agents or property owners through an integrated messaging system.
How we built it
Our front end is powered by React with TypeScript and styled using TailwindCSS, integrated with Shadcn/UI for polished, responsive components. We rely on Supabase for authentication, database management, and real-time subscriptions. Mapbox and Melissa API handle location inputs, address validation, and accurate distance filtering. Finally, voice and gesture functionalities use a combination of our own Video Streaming, Google's Mediapipe to identify gestures, Websockets and AI api's to process real-time voice conversations and gesture commands.
Challenges we ran into
- Developing a method of streaming video feed from our users camera to our backend gesture recognization service
- Ensuring accurate gesture recognition with varying lighting conditions and camera angles
- Managing real-time voice API interactions and synchronizing them with property data
- Maintaining a responsive user interface across multiple screen sizes and devices
- Integrating location-based filtering with dynamic radius updates
Accomplishments that we're proud of
- Implementing intuitive gesture controls that allow users to navigate property listings seamlessly
- Streamlining location-based search and integrating robust address validation
- Creating a smooth experience for voice-driven interaction with each listing's details
- Designing a secure, scalable architecture using Supabase to handle authentication and real-time updates
What we learned
- The importance of robust error handling in real-time applications, especially with voice and gesture recognition
- How to merge multiple APIs (Mapbox, Melissa) to create a cohesive user experience around location data
- Strategies for optimizing database queries and real-time event handling to ensure minimal latency
What's next for HomeSuite
- Advanced AI suggestions: Use machine learning to recommend properties based on user preferences and browsing history
- Extended voice commands: Expand beyond Q&A to allow users to schedule viewings or request more photos
- Virtual tours: Integrate 3D home tour features with VR/AR for immersive browsing
- Collaborative browsing: Allow multiple users (e.g., family, friends) to browse properties together in real time
Built With
- fastapi
- mediapipe
- melissa
- python
- react
- supabase
- typescript
- vite
- websockets
Log in or sign up for Devpost to join the conversation.