home page
fitness tracking page
nutrition page
Liked restaurants
skin/hair analysis page
wellness community
mood check-in page

What Now: Your wellness companion that actually gets you

Move. Nourish. Connect. One app that knows you.

What is What Now? It’s an all-in-one wellness app, fitness tracking, AI-powered nutrition, skin & hair analysis and a supportive community with a personal agent that remembers you and talks to you like a friend!

The dream

What if your wellness app didn’t feel like a cold tracker? What if it remembered your habits, understood your goals and connected you with people on the same path?

We built What Now so you don’t have to start from zero every time. One place for fitness, food, and community, and a personal agent that keeps it all in mind, like a friend who’s been paying attention.

What it does

Your personal WellBeing Agent!

This isn’t a generic chatbot. The WellBeing Agent is a personal wellness companion that:

Builds a living picture of you: It pulls from everything you do in the app: your nutrition choices, the restaurants you love, your fitness sessions, your profile. No filling out long forms; it learns as you go.
Thinks like human memory: Instead of raw logs, we turn your activity into consolidated insights like short, meaningful summaries (e.g. “You’re someone who loves fresh, veggie-forward meals and tends to pick salad spots in Boulder, and likes the Cetaphil cleanser”). That’s the same way we remember things, not every detail, but what matters. The agent uses that memory so every answer feels personal.
Shows up everywhere: A floating chat sticker follows you across the app. Open it anytime to ask about form, meal ideas, restaurant picks or motivation. It answers in your context: your habits, your goals, your vibe.

So when you ask “What’s a good post-workout meal?” it already knows you’re into salads and healthy options. When you ask “Why do I keep getting dinged on elbow position?” it can tie that to your fitness history. One agent, one memory, one you.

Fitness: move with confidence

Track exercises (bicep curls, lateral raises, and more) with camera-based form feedback.
Get rep counts and form scores so you know you’re doing it right.
Sessions and progress live in your profile and feed into your agent’s memory.

Nutrition & wellness: eat well and plan with confidence

Discover and scan

Discover healthy restaurants: Search by location (e.g. Boulder, CO), filter by category, and see AI health scores (Gemini) so you know which spots fit your goals.
Scan your plate : Upload a photo of your meal and get estimated calories and macros (Gemini Vision). No more guessing.
Save favorites: Heart the places you love and filter by “Liked.”
Insights that stick: Your browsing and likes turn into personalized insights (e.g. “You’re into nourishing food and salad spots in Boulder”). Those insights are stored and used by your agent, part of the same consolidated memory that makes the chat feel human.

Plan and thrive

Nutrition profile: Set your goals, preferences, and dietary needs so meal suggestions and insights are tailored to you.
Pantry meal planner: Add what you have on hand, AI-generated meal ideas (Gemini) help you cook from your pantry and cut down waste.
Authentic dish optimizer: Love traditional or cultural dishes? Get healthier twists (ingredient swaps, portions) so you keep the flavors you love while aligning with your goals.
Recipe library: Save, modify, and duplicate recipes. Tweak them with the app (e.g. more protein, fewer carbs) and keep a personal library that grows with you.
Wellness nutrition insights: We turn your meal logs and profile into goal-fit insights (e.g. consistency, variety, protein alignment) so you see what’s working, with grounding lines like “check your labels” and no medical claims.
Nutrition insight memory : Your meal planning and recipe activity are summarized into short session insights and stored in nutrition insight memory. That memory feeds your WellBeing Agent, so when you ask “What’s a good dinner this week?” it already knows your pantry, your goals, and what you like to cook.

Skin & hair care: understand what works for you

Your profile: Set your skin and hair type, sensitivities, and goals so every suggestion is tailored to you.
AI-powered analysis: Upload a photo of your face or scalp; Gemini Vision gives you observational feedback (e.g. dryness, tone, scalp condition) so you can track changes over time. We never store raw images: your privacy comes first.
Loved products: Save the products that work for you (name, brand, category). The app can match them to ingredient data so recommendations stay consistent with what you already love.
Smarter recommendations: Get product suggestions based on ingredient overlap and your sensitivity list: no recommending something you’re trying to avoid.
Wellness insights: We turn your skin and hair logs (and signals like sleep or nutrition when available) into short, non-medical insights (e.g. patterns around dryness, fatigue, or routine changes) so you see what might be influencing your skin and hair, always with a “check the label / talk to a pro” nudge, never diagnoses.

Community: you’re not doing this alone

Discussion board: Post your wins, ask questions, share tips. Topics: nutrition, fitness, skincare, mental health, motivation, support. Upvote, comment, and connect with others from their posts.
People Like You: See others with similar interests (powered by your Yelp + fitness data). Click someone to view their posts and get inspired.
Community Insight: A short, AI-generated nudge (e.g. “Connect with fellow Boulderites who love nourishing food”) to encourage real connection.
Wellness events: Create or join local events: yoga, group runs, meal prep workshops, mindfulness circles. RSVP and see who’s going.
Mood check-in: Log how you’re feeling (1–5 + optional note). See community mood (e.g. “The community is 4.2/5 today”) and your own week at a glance.

Everything is tied to one account and one wellbeing_app database, so your agent, your nutrition, and your community are all in sync.

How we built it

Frontend: Next.js 14 (App Router), React, TypeScript, Tailwind CSS, Framer Motion.
Backend / APIs: Next.js API routes (Node).
Data: MongoDB Atlas (wellbeing_app) — users, profiles, sessions, favorites, clicks, yelp-insights, nutrition profiles, pantry items, recipes, saved recipes, nutrition insight memory, community posts, events, moods, skin-hair profiles, loved products, recommendations, wellness insights.
APIs: Yelp Fusion (restaurants), Google Gemini (health scores, food scan, Yelp insights, pantry meal ideas, authentic dish optimization, recipe modification, nutrition insight memory, agent profile consolidation, agent chat), elevenlabs API.
Auth: JWT in cookies; one userId across fitness, nutrition, community, and the agent.
Agent memory: Nutrition and Yelp activity are summarized into insight memory; the agent profile API merges that with your profile and turns it into a 3–5 sentence “profile context” (second person, warm) that’s injected into every chat. So the agent doesn’t just have data, it has a humanized picture of you.

Challenges we ran into

Gemini limits and truncation: Long responses sometimes got cut off. We fixed it with tighter prompts, batching, and fallbacks so health scores and Community Insight stay complete.
Making the agent feel personal: We didn’t want a bot that forgets you. So we built a consolidated profile from nutrition insight memory, yelp-insights, and profile data, and used Gemini to turn that into natural “You are someone who…” context. Now every reply is grounded in your story.
Cross-origin auth: Keeping userId consistent across base, nutrition, and community so the agent and all features see the same user. We documented the flow (e.g. passing userId / userName as props) for clean integration.
Auth and session across devices: Login worked in the current session on one laptop but didn’t carry over to a different laptop or after closing the browser (session/cookie behavior). We’re still improving “one login, everywhere” so your session stays consistent across devices and previous sessions.
MongoDB and resilience: We hit connection and IP whitelisting issues; we added in-memory fallbacks so features (and the agent’s data sources) keep working even when the DB is temporarily unreachable.

What we’re proud of

One agent that actually knows you: Not a generic FAQ bot. A companion that uses consolidated, human-like memory (insight summaries + profile) so every answer is personal.
One app, four pillars: Fitness, nutrition, skin & hair care, and community in a single experience, one login, one database.
Real AI, real impact: Health scores, food scan, Yelp insights, Community Insight, skin & hair image analysis, agent profile building, and agent chat all powered by Gemini.
Social impact: Discussion, connections, “People Like You,” events, and mood check-in designed to reduce isolation and encourage real-world connection.
Consistent, human-centered UX: Shared theme and patterns so the whole journey feels like one product.

What’s next

Tighter integration: One deployed app (base + nutrition + community) under one domain and auth.
Richer agent memory: Fold in fitness patterns, community activity, and event interests so the agent’s “picture of you” gets even better.
Smarter event discovery: Surface local wellness events and “People Like You” who are interested.
Notifications: Gentle nudges for mood check-in, event reminders, and new connections.
Safety and moderation: Clear guidelines and tools so community stays supportive and safe.

One agent. One memory. One you.