Skip to content

rappleit/Deskercise

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

29 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿƒโ€โ™‚๏ธ Deskercise.AI

Your AI-Powered Desk Wellness Companion

CalHacks AI 2025 React MediaPipe Vapi

Deskercise Demo

๐Ÿ”— View on DevPost | ๐Ÿ“Š Presentation


๐ŸŽฏ The Problem

3AM at hackathons. Endless office hours. Study marathons.

Millions of people spend hours glued to screens, developing "tech neck," stiffness, and fatigue. Traditional solutions? Awkward yoga poses in public spaces or forgetting to stretch entirely.

๐Ÿ’ก Our Solution

Deskercise.AI transforms your workspace into a wellness station with AI-powered stretch coaching that actually works for real environments.

"Hour 28 of our hackathon โ€” the rest of the venue looked like a caffeine-fueled zombie apocalypse. Meanwhile, our team was doing shoulder rolls guided by our own AI coach every Pomodoro break. While others crashed at 3AM, we were still sharp, energized, and coding clean. We didn't just build Deskercise; we lived it, and it literally saved our hackathon."

-- The Deskercise.AI Team, UC Berkeley AI Hackathon 2025


๐Ÿš€ Key Features

๐Ÿ… Smart Break Management

  • Pomodoro timer with intelligent stretch recommendations
  • Automatic session tracking and analytics
  • Calendar integration for meeting break reminders

๐Ÿค– AI Stretch Coach

  • Real-time pose detection using MediaPipe
  • Voice-powered guidance with conversational AI
  • Live form correction and personalized feedback
  • Progress tracking with XP and streaks

๐ŸŽฏ Desk-Friendly Design

  • Exercises designed for office/study environments
  • No awkward poses or equipment needed
  • Webcam-based monitoring with privacy-first approach

๐Ÿ› ๏ธ Tech Stack

Component Technology Purpose
Frontend React + Ant Design User interface
Computer Vision MediaPipe Pose Real-time pose detection
AI Coach Vapi + Gemini Conversational guidance
Multi-Agent Unify Coming Soon...

โšก Quick Start

# Clone and install
git clone https://github.com/yourusername/deskercise.git
cd deskercise
npm install

# Set up environment variables
cp sample.env .env
# Edit .env with your actual API keys (see API Setup section below)

# Start development server
npm start

Requirements:

  • Node.js 14+
  • Modern browser with webcam
  • API keys for Google Calendar, Gemini AI, and Vapi Voice AI

๐Ÿ”‘ API Setup

Deskercise requires several API keys to function properly. Follow these steps to get your keys:

1. Google APIs (Calendar & OAuth)

  1. Go to Google Cloud Console
  2. Create a new project or select existing one
  3. Enable the following APIs:
    • Google Calendar API
    • Google+ API
  4. Create OAuth 2.0 credentials for REACT_APP_GOOGLE_CLIENT_ID
  5. Create API key for REACT_APP_GOOGLE_API_KEY

2. Google Gemini AI

  1. Visit Google AI Studio
  2. Create a new API key
  3. Add it as REACT_APP_GEMINI_API_KEY

3. Vapi Voice AI

  1. Sign up at Vapi.ai
  2. Create a new assistant
  3. Get your API key and assistant ID
  4. Add them as REACT_APP_VAPI_API_KEY and REACT_APP_VAPI_ASSISTANT_ID

Environment Variables

Copy sample.env to .env and replace the placeholder values:

cp sample.env .env

Then edit .env with your actual API keys:

REACT_APP_GOOGLE_CLIENT_ID=your_actual_google_client_id
REACT_APP_GOOGLE_API_KEY=your_actual_google_api_key
REACT_APP_GEMINI_API_KEY=your_actual_gemini_api_key
REACT_APP_VAPI_API_KEY=your_actual_vapi_api_key
REACT_APP_VAPI_ASSISTANT_ID=your_actual_vapi_assistant_id

Note: Never commit your .env file to version control. It's already included in .gitignore.


๐ŸŽฎ How It Works

  1. Set Your Focus Time - Start a Pomodoro session
  2. Get Smart Reminders - AI suggests stretch breaks at optimal times
  3. Follow AI Guidance - Voice coach walks you through exercises
  4. Perfect Your Form - Real-time pose analysis ensures proper technique
  5. Track Progress - Build streaks and improve your wellness metrics

๐Ÿง  AI Architecture

MediaPipe Pose โ†’ Pose Analysis โ†’ Unify Coordinator
     โ†“                              โ†“
Webcam Feed โ†โ†’ Real-time Feedback โ†โ†’ Vapi Voice Coach
                                    โ†“
                              Gemini LLM (Context)

Smart Agents:

  • HoldTrackerAgent: Monitors pose duration and quality
  • FeedbackAgent: Generates contextual improvement suggestions
  • VoiceCoachAgent: Provides natural language guidance
  • XPTrackerAgent: Gamifies progress with streaks and achievements
  • PlannerAgent: Selects optimal exercises based on user history

๐Ÿ‘ฅ Meet The Team

Abhishek Kumar
Full Stack Lead
LinkedIn
Mohamad Mansour
AI/Computer Vision Engineer
LinkedIn
Rachel Lim
Full Stack Developer
LinkedIn
Megan Jacob
Integration Specialist
LinkedIn

๐ŸŒŸ Market Impact

Corporate Wellness

  • Reduce healthcare costs from repetitive strain injuries
  • Boost employee productivity and satisfaction
  • Seamless integration with existing workflows

Educational Institutions

  • Combat "Zoom fatigue" in remote learning
  • Promote healthy study habits
  • Scalable solution for student wellness programs

Individual Users

  • Prevent long-term posture-related health issues
  • Gamified approach increases engagement
  • Privacy-focused design builds trust

๐Ÿš€ Future Roadmap

๐Ÿค– AI Enhancements

  • Multilingual voice coaching with cultural adaptation
  • Predictive wellness analytics to prevent strain before it occurs
  • Eye tracking integration for comprehensive fatigue detection
  • Smart calendar analysis for optimal break scheduling
  • Advanced pose tracking analysis for better tracking.
  • More Real-time AI coach assistance with dynamic workout adjustments

๐Ÿ“ฑ Platform Expansion

  • Mobile companion app
  • Team challenges and corporate dashboards
  • Wearable device integration
  • VR/AR stretch environments

๐Ÿ† Awards & Recognition

๐Ÿฅ‡ CalHacks AI 2025 - Best AI Tool

Built in 36 hours, Deskercise represents the future of workplace wellness through intelligent, accessible, and engaging technology.


๐Ÿ“ž Get Involved

Ready to transform workplace wellness?

  • ๐ŸŒ Demo: DevPost Submission
  • ๐Ÿ“ง Contact: Connect with our team on LinkedIn
  • ๐Ÿค Partnerships: Open to corporate pilots and educational collaborations

Made with โค๏ธ for a healthier digital world

Because your wellbeing shouldn't wait for the weekend

CalHacks AI 2025

About

CalHacks AI Hackathon 2025 Entry

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •