Action Pipe | Devpost

0-theme
1-theme
acct-Comp
apiBox
Haygen Avatar
Chat to Voice

🧠 Inspiration

ActionPipe came from a deeply personal place — the desire to create a companion that combines the intelligence of Iron Man's JARVIS with a human touch. As someone who hasn't found a 💔 romantic partner, I thought, "Why not create my own?"
No, I’m not gay — I just couldn’t add a pretty girl because the free tier API didn’t support custom avatars 😅. So I focused on the brains and personality instead — and that's how the idea of a truly human AI companion was born.

🤖 What it does

It's a platform where you can create and interact with anyone — your favorite celebrity, a historical figure, or your ideal companion. The AI inherits the personality, speaking style, and traits of whoever you choose, making conversations feel authentic and personal. It’s like JARVIS, but instead of just being helpful, it can be anyone you imagine — your favorite actor, a wise thinker, or even your perfect match. The more you interact, the more it adapts, leading to deeper, more meaningful conversations.

🛠️ How I built it

Building ActionPipe felt like bringing a digital friend to life. I started with the brain — an AI that could understand and respond naturally. Using HeyGen’s API, I gave it a face and voice to make interactions feel real. For smooth, real-time conversations, I used WebSockets, and LiveKit for lifelike video streaming. The frontend is built with React, TypeScript, and Tailwind CSS, all designed to keep the experience clean, personal, and human. Every detail — from transitions to layout — was crafted to feel like a real conversation.

🧱 Challenges I ran into

❌ HeyGen SDK didn't work as expected
🔁 Switched to LiveKit for stable video streaming
📄 Unclear HeyGen documentation led to trial-and-error
🧪 Free-tier API limitations made testing difficult
🚫 ScreenPipe integration for OCR and speech failed
🔄 Rethought and adapted approach to several features

🏆 Accomplishments that I'm proud of

🎥 Immersive One-to-One Experience

Zoom-like interface for natural conversations
Minimalist floating controls
Clean, distraction-free environment

🧬 Seamless HeyGen Integration

Integrated HeyGen SDK for lifelike avatars
Real-time avatar rendering and animation
Smooth transitions and polished loading states

🎯 Use Cases

Personal AI companion for daily motivation or emotional support
AI recreation of historical figures for educational purposes
Code review assistant with context-aware feedback (still in progress)
Productivity buddy that reads screen content and offers help (still in progress)

🚀 What's next for ActionPipe

Next, I will focus on making ActionPipe smarter and more integrated. I plan to add OCR through ScreenPipe so the AI can read and interact with on-screen content. On macOS, I will develop a Picture-in-Picture mode and system-level features that allow the avatar to float above other windows and analyze their contents. I will also build smart assistant capabilities like real-time code linting and context-aware responses based on screen content. All of this will help create a more seamless, intuitive experience where the AI feels like a natural part of the desktop.