Inspiration

One of our groupmates, ahem Jessie ahem, has an addiction to shopping at a fast fashion retailer which won't be named. So the team collectively came together to come up with a solution: BYEBUY. Instead of buying hauls on clothing that are cheap and don't always look good, BYEBUY uses the power of stable diffusion and your lovely selfies to show you exactly how you would look like in those pieces of clothing you've been eyeing! This solution will not only save your wallet, but will help stop the cycle of mass buying fast fashion.

What it does

It takes a picture of you (you can upload or take a photo in-app), it takes a link of the clothing item you want to try on, and combination! BYEBUY will use our AI model to show you how you would look with those clothes on!

How we built it

BYEBUY is a Next.js webapp that:

  1. Takes in a link and uses puppeteer and cheerio to web scrape data
  2. Gets react webcam takes a picture of you
  3. Takes your photo + the web data and uses AI inpainting with a stable diffusion model to show you how the garments would look on you

Challenges we ran into

Straying from our original idea: Our original idea was to use AR to show you in live time how clothing would look on you. However, we soon realized how challenging 3d modelling could be, especially since we wanted to use AI to turn images of clothing into 3d models...maybe another time.

Fetching APIs and passing data around: This was something we were all supposed to be seasoned at, but turns out, an API we used lacked documentation, so it took a lot of trial and error (and caffeine) to figure out the calls and how to pass the endpoint of one API to .

Accomplishments that we're proud of

We are proud we came up with a solution to a problem that affects 95% of Canada's population (totally not a made up stat btw).

Just kidding, we are proud that despite being a group who was put together last minute and didn't know each other before HTV9, we worked together, talked together, laughed together, made matching bead bracelets, and created a project that we (or at least one of the members in the group) would use!

Also proud that we came up with relatively creative solutions to our problems! Like combining web scraping with AI so that users will have (almost) no limitations to the e-commerce sites they want to virtually try clothes on from!

What we learned

  • How to use Blender
  • How to call an API (without docs T-T)
  • How to web scrape
  • Basics of stable diffusion !
  • TailwindCSS

What's next for BYEBUY

  • Incorporating more e-commerce sites

Built With

Share this project:

Updates