Gamify360 | Devpost

Inspiration💡

It all started with a simple realization: people are crazy committed to their video games. We were like, "Man, wouldn't it be cool if we could channel that dedication into something that helps people achieve their real-life goals?" And that's when the lightbulb moment hit. We saw how gamers were pulling off year-long streaks, totally hooked on their virtual adventures. We thought, "What if we could take that stickiness and use it to motivate folks in their day-to-day lives?" And just like that, the idea for Gamify 360 was born. We wanted to break down the boring walls between reality and gaming, you know? So, as you conquer real-life challenges – big or small – you earn actual money through Solana NFTs.

What it does❓

Choose any activity – whether it's practicing yoga, sketching, or even just working out. Our state-of-the-art computer vision technology captures your actions, transforming the mundane into an exhilarating adventure. Leveraging advanced computer vision, generative AI and pose estimation technology, it turns routine activities such as cooking, cleaning, and personal care into competitive games. It’s like you’re in a cooking show or a cleaning race, and Gamify360 is keeping score, dishing out points for how accurate and engaged you are. Every action you perform in the real world earns you coins within the app. These coins then translate into money in the form of NFTs. The prospect of earning real value for activities traditionally seen as mundane or routine presents a compelling incentive, attracting a larger customer base. It's an invitation to transform every ordinary moment into an extraordinary opportunity, making Gamify360 not just a game, but a lifestyle revolution. Furthermore, this approach democratizes the concept of earning through technology, making it accessible to anyone with a smartphone or computer. It breaks down the traditional barriers to entry for generating income or value from digital platforms, which often require specialized skills or knowledge. With Gamify360, the simple act of living one’s daily life becomes a potential source of income, leveraging the universal nature of everyday tasks as the basis for participation. The earning potential would thus attract more and more people.

How we built it 🧱

As the clock struck nine, we made our way to the drawing board, and finalized the entire project down to its core. The project was a web-based application with an easy-to-use UI. Navigating around the homepage led to four different models — each helping in a different field of activity. We knew that integrating a camera based model into a web page might have several tedious nuances to it; however, we figured our big tech brains were enough to handle a couple hours of brutally exhausting debugging. And, so, we went ahead with it anyway with the “We’ll deal with it when it faces us!” attitude.

Early on after the hacking commenced, we decided to split the work into three rough parts: Jahnavi handled everything related to the workings of the OpenCV models and Solana, Farzad handled everything related to the front-end and the webpage, and Manya handled integrating the OpenCV script (Made in Python) into the WebPage.

Solana🕹️

Solana Clicker is a blockchain-based game leveraging the Solana ecosystem. Operating on the Solana blockchain, the game employs smart contracts to handle in-game mechanics such as clicking interactions, money generation, and state management. Each click corresponds to a transaction on the Solana blockchain, updating the game state and involves the transfer of Solana-based tokens. Players interact with the game through Solana-compatible wallets, which store their in-game assets and facilitate blockchain transactions.

Challenges we ran into 😰

Ten hours in, although we weren’t making progress as fast as we would’ve liked, we still hadn’t hit a problem we couldn’t just StackOverflow our way out of. So, everything was a green flag for now. A couple hours of coding later, Jahnavi informed us about what became the bane of all our existences: Lag. You see, Flask is a fairly heavy python based framework; which is why when you implement an already heavy model to a webpage on a localhost, it leads to extreme lag. Moreover, React and Flask both operate on their own server and are designed for different purposes. We were trying to run them simultaneously. At one point, the site completely crashed and even after hours of debugging we couldn’t figure out the error. Even the “Game-ify” button stopped working. Which is why we were left with no choice but to scrap using only Flask and integrate a completely different framework. We tried other python based frameworks like Django and Pyramid; however, while they solved this one issue, they came with their own list of problems. Perplexed, we stared at a blank wall for the next twenty minutes— just thinking. Just when things started to look bleak, Jahnavi’s face cheered up like a beacon of hope peaking through a dusky, starry night. “Have you guys heard of Streamlit?” she asked. Streamlit is an open-source python based framework, and it works wonders when the task has something to do with embedding a script onto a webpage. However, since it's a fairly obscure technology, none of us had any experience working with it, which led all of us to learn an entirely new technology in the span of an hour.

Accomplishments that we're proud of🥇

We all know how computer vision has the ability to detect, in real-time, the actions and interactions of object with each other with astounding accuracy. Computer vision enabled the completion of complex projects such as ai posture corrector, automated basketball referees, manufacturing pipeline oversee and more. What we're most proud of is that we employed groundbreaking Generative AI to detect the skeleton frames and interaction of any object the user enters with 78% accuracy!

You want a guitar coach? Our model can track it. Cooking? Our model can track it. Grocery shopping? Our model can track it. Achieving such a generalization without compromising the accuracy stands as a huge feat in our books!

What we learned 📚

Only hours into development, it became apparent that studies on Computer Vision and Machine Learning models, like pose detection, often overlook the myriad challenges developers face in integrating them into comprehensive applications. When Flask failed to meet our expectations, we quickly pivoted, embracing the challenge to master new technologies such as Streamlit on the spot. The diverse expertise and experiences within our team were crucial in maximizing our productivity and efficiency.

What's next for Gamify360 🔮

The future of Gamify360 holds thrilling prospects, as we aim to turn everyday chores into exciting adventures. We're working on creating different virtual worlds within the app, each tailored to various interests. Whether you love yoga, reading, or staying fit, there will be a special world for you. As you complete tasks in real life, you'll build and customize these worlds, making your daily routines more enjoyable and rewarding.

Enhancing Social Features

We're also planning to make Gamify360 more social. Imagine seeing how your virtual city ranks against others around the world or competing in challenges to win unique rewards. We want to build a community where users can share achievements, offer tips, and even trade items, making every interaction within the app meaningful and fun.

Personalized Experience with AI

One of the most exciting updates is the introduction of AI to personalize your experience. Gamify360 will learn from your activities and preferences to suggest tasks that are just right for you, keeping the game challenging but achievable. It's like having a personal coach that helps you find joy in everyday tasks. In essence, Gamify360 is on a path to revolutionize how we view and engage with our daily routines, turning them into opportunities for fun, growth, and community building. Stay tuned for an adventure where productivity meets play in the most innovative way!