Pill Patrol - AI Pharmacy Inventory Checking

Pill Patrol helps medical professionals identify pharmacies with in-stock prescription medication. This saves doctors and nurses time re-issuing prescriptions so they can provide better patient care.

Comment

Inspiration

A good friend of Boris spent 10 hours this last week bouncing between pharmacy after pharmacy while bugging his doctor to send prescriptions to each of them. Absolutely no one was happy. It took almost a week for him to get his medication.

What it does

Pill Patrol takes a location, a prescription medicine, and a strength plus form as an input and then calls local pharmacies to confirm that they have it in stock. This saves doctors, nurses, other medical professionals, and patients a lot of time.

Our mission is to remove the pain (no pun intended) from filling prescriptions. We built Pill Patrol without taking patient data so that we don't have to worry about HIPAA.

How we built it

  • ElevenLabs to build our agent that can talk to and extract critical information from interacting with pharmacies
  • Twilio to carry out the actual phone calls
  • Google Maps to show pharmacies around the desired location
  • Clinical Drugs API from the NIH Library of Medicine
  • PostHog for monitoring usage of the app
  • Clerk for user management and Authentication

Challenges we ran into

  • Lots of small issues with web sockets, Twilio, some vibe code architecture issues, prompt engineering, making the UI better without spending too much time on it, and more.
  • The Eleven Labs system prompt asks the agent to be helpful. This makes a lot of sense for inbound call handling but makes it hard to have an authoritative and demanding presence for outbound calls.
  • Loveable is hard to use with an existing stack. We used the ElevenLabs + Twilio starter and tried integrating the two. Turned into more pain than it is worth it.
  • Microsoft Azure wouldn't let us sign up so we couldn't do Microsoft Social Auth.
  • Auth code looked like it worked until at the last minute I realized it broke core calling.
  • PillPatrol.com costs $3k, we're taking investments ;)

Accomplishments that we're proud of

  • Having the agent successfully update our SQL database with up to date inventory info!
  • Actually closing the Twilio phone call when the conversation is over :)

What we learned

  • Never do authentication at a hackathon. (Again)

What's next for Pill Patrol

  • Get doctors offices to use it and provide feedback
  • Improve the agent’s ability to never veer off the task (this can happen if the pharmacy asks unexpected questions, for example)
  • Make the agent capable of navigating IVRs of any pharmacy, right now it only works with voice based ones
  • Notifications for when a drug is back in stock
  • Billing, etc
Share this project:

Updates