AI Engineering Intern — Voice Agents & LLM Evaluation (Python)
TheInterviews.ai runs real-time voice interviews: speech-to-text, an LLM interviewer that adapts follow-up questions, text-to-speech, and a scoring pipeline that has to be consistent and explainable. You will work on that brain, in Python, with the founder. Expect to touch prompts, evaluation harnesses, latency, and cost every week.
- Location: Remote — US
- Type: Internship
- Pay: $20–$30/hr
The AI interview is round one: 30 minutes, whenever suits you. Decision within 5 business days.
What you will do
- Improve the interviewer agent (Python 3.13, FastAPI, LiveKit Agents): question flow, follow-ups, turn-taking, and failure handling.
- Build and run evaluations: golden sets, score-stability checks, dimension drift guards, and regression gates that run in CI before a prompt or model change ships.
- Measure and reduce latency and cost across STT, LLM, and TTS; compare providers and models with data, not vibes.
- Read transcripts and scoring outputs critically, find failure modes, and turn them into tests.
Details
- Internship, approximately 12 weeks, rolling start, as soon as you are ready. 20–40 hours per week, flexible, with a daily Pacific-time overlap window.
- Fully remote within the United States. We have an office in Los Angeles, but there is no hybrid or in-person requirement.
- Students and recent graduates welcome, including F-1 CPT/OPT. Academic credit supported where your program allows.
What we look for
- Strong Python, including async/await and writing testable modules.
- You have built something with an LLM API and can explain what went wrong and how you evaluated it.
- Comfort with basic statistics: you can reason about variance, sample size, and whether a change is real.
- Curiosity about speech and conversation systems; rigor about measurement.
Nice to have
- Experience with STT/TTS APIs, WebRTC or LiveKit, vector search, or fine-tuning.
- pytest, Docker, any cloud deployment.
- Coursework or projects in NLP, ML, or HCI.
How we hire
- Step 1: Take the 30-minute AI interview, or apply with your resume
- Step 2: 20-minute intro call
- Step 3: A practical exercise or interview
- Step 4: Decision within 5 business days
Apply for this role
AI Engineering Intern · two ways in, pick one.
Take the AI interview
30 minutes, whenever suits you. Enter your email, follow the magic link and answer by voice. That is round one.
Start the AI interviewApply with your resume
Send your resume with the form below and we will email you the same interview link.
Go to the form
Apply with your resume
Fields marked * are required.