Architecture Diagram VoiceHire
Job Profile Management
Job Details
Home Page
Automated AI Personalized Post-Interview Emails
Candidate Analy

About the Project

Inspiration

We created this AI-powered HR call agent to make the hiring process faster and more efficient. Phone interviews take a lot of time and can sometimes be biased. By using AI we wanted to automate the initial candidate screening making it consistent and objective while allowing HR teams to focus on more important tasks.

How We Built It

Technology

Speech-to-Text: To convert candidate responses into text.
NLP (Natural Language Processing): To understand and analyze the meaning tone and sentiment of what candidates say.
AI Voice: To generate realistic human-like agent voices.
Backend: We used Python with FastAPI to handle the system's processes.
Frontend: We built a next.js dashboard to display candidate insights.
Database: We used PostgreSQL to store call logs and analysis results.

How It Works

The AI agent makes a call and asks interview questions.
It listens transcribes and analyzes the responses in real-time with very low latency.
The system generates a report with insights on communication skills, confidence and possible concerns.

What We Learned

AI Voice Challenges: Making the AI voice sound natural and engaging was harder than expected.
Deeper Insights: By analyzing tone, pauses and speech patterns we could detect subtle signs of confidence or hesitation.
Avoiding Bias: We had to fine-tune the AI to ensure it evaluates fairly without bias.

Challenges We Faced

Background Noise: Noisy environments made it hard to transcribe accurately. We added noise filtering to fix this.
Slow Processing: Real-time analysis sometimes caused delays. We optimized the system to handle this faster.
Making in Realistic: Trying to make AI as Humanly as Possible and making it such that it can remember the previous conversation history and asking follow-up based on that.
AI Generating New Follow-up Question based on User response.

Future Plans

Multiple Languages: Adding support for more languages to cover global hiring needs.
Emotion Detection: Improving the AI’s ability to detect emotions during the call.
ATS Integration: Connecting the system with applicant tracking systems (ATS) to simplify the hiring process.