πŸ’‘ Inspiration

Managing personal finances is often tedious because users must manually fill multiple fields for every expense. We wanted to make expense tracking as simple as chatting with a friend.

With the rise of Large Language Models, we envisioned an application where users simply type messages like:

"Spent β‚Ή250 on groceries yesterday"

and the system automatically understands and records the expense.

That's how SpendBoat was bornβ€”an intelligent finance assistant that combines AI, Machine Learning, and modern web technologies to simplify expense tracking.


✨ What it does

SpendBoat enables users to record expenses using natural language through either a web dashboard or WhatsApp.

Example:

Spent β‚Ή250 on groceries yesterday

The application automatically extracts:

  • πŸ’° Amount
  • 🏷️ Category
  • πŸ“… Date
  • πŸ“ Description

using Groq's LLaMA 3.

To ensure high reliability, if the AI model is unavailable or rate-limited, a TF-IDF + Logistic Regression model predicts the expense category, achieving 99.9% request success.

Additional features include:

  • πŸ€– AI-powered expense parsing
  • πŸ’¬ WhatsApp expense logging
  • πŸ“Š Interactive analytics dashboard
  • πŸ’° Monthly budget tracking
  • πŸ“§ Budget exceeded email alerts
  • πŸ“ˆ Spending insights and visualizations

πŸ› οΈ How we built it

Frontend

  • React.js
  • Tailwind CSS
  • Recharts

Backend

  • Node.js
  • Express.js
  • MongoDB

AI

  • Groq API
  • LLaMA 3

Machine Learning

  • Python Flask Microservice
  • TF-IDF Vectorizer
  • Logistic Regression

Integrations

  • Twilio WhatsApp API
  • Nodemailer

βš™οΈ System Architecture

              User
                β”‚
      Web Dashboard / WhatsApp
                β”‚
                β–Ό
        Node.js + Express API
                β”‚
                β–Ό
       Groq (LLaMA 3 Parsing)
          β”‚             β”‚
      Success        Failure
          β”‚             β–Ό
          β”‚     ML Fallback Service
          β”‚ (TF-IDF + Logistic Regression)
          β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
                    MongoDB
                        β”‚
                        β–Ό
              React Analytics Dashboard

🚧 Challenges we ran into

  • Parsing inconsistent natural language inputs accurately.
  • Prompt engineering to generate structured JSON responses.
  • Handling API failures and rate limits gracefully.
  • Designing an ML fallback system without affecting user experience.
  • Integrating Twilio WhatsApp webhooks with the backend.
  • Building responsive dashboards for analytics.
  • Maintaining fast response times while ensuring reliability.

πŸ† Accomplishments that we're proud of

  • πŸš€ Built a complete AI-powered expense tracking platform.
  • πŸ€– Successfully integrated Groq LLaMA 3 into a production-ready workflow.
  • πŸ”„ Achieved 99.9% request reliability using an intelligent ML fallback model.
  • πŸ’¬ Enabled expense tracking directly from WhatsApp.
  • πŸ“Š Created an interactive analytics dashboard with meaningful financial insights.
  • πŸ—οΈ Designed a scalable architecture separating AI inference and ML services.

πŸ“š What we learned

Throughout the development of SpendBoat, we gained hands-on experience with:

  • Large Language Model integration
  • Prompt engineering
  • AI-powered application development
  • MERN Stack architecture
  • REST API development
  • Machine Learning deployment
  • Flask microservices
  • Twilio webhook integration
  • Data visualization
  • Error handling and fallback strategies
  • Building scalable and resilient systems

πŸš€ What's next for SpendBoat

We plan to expand SpendBoat into a complete AI financial assistant by adding:

  • πŸŽ™οΈ Voice-based expense logging
  • πŸ“Έ Receipt OCR using computer vision
  • πŸ€– Personalized AI spending recommendations
  • πŸ“ˆ Expense forecasting using predictive analytics
  • πŸ’³ Bank account synchronization
  • πŸ‘¨β€πŸ‘©β€πŸ‘§ Shared family expense management
  • 🌍 Multi-language support
  • πŸ“± Android & iOS mobile applications
  • πŸ” OAuth authentication
  • ☁️ Cloud-native deployment with CI/CD
  • πŸ“Š Advanced financial reports and insights

❀️ Our Vision

SpendBoat aims to become an intelligent personal finance assistant that helps users effortlessly track, understand, and improve their financial habits using the power of Artificial Intelligence, Machine Learning, and Conversational Interfaces.


⭐ Built with

Made with ❀️ for Hackathons πŸš€

Share this project:

Updates