AI Engineering Intern — Voice Agents & LLM Evaluation (Python)

ABOUT THE ROLE TheInterviews.ai runs real-time voice interviews: speech-to-text, an LLM interviewer that adapts follow-up questions, text-to-speech, and a scoring pipeline that has to be consistent and explainable. You will work on that brain, in Python, with the founder. Expect to touch prompts, evaluation harnesses, latency, and cost every week. WHAT YOU WILL DO - Improve the interviewer agent (Python 3.13, FastAPI, LiveKit Agents): question flow, follow-ups, turn-taking, and failure handling. - Build and run evaluations: golden sets, score-stability checks, dimension drift guards, and regression gates that run in CI before a prompt or model change ships. - Measure and reduce latency and cost across STT, LLM, and TTS; compare providers and models with data, not vibes. - Read transcripts and scoring outputs critically, find failure modes, and turn them into tests. WHAT WE LOOK FOR - Strong Python, including async/await and writing testable modules. - You have built something with an LLM API and can explain what went wrong and how you evaluated it. - Comfort with basic statistics: you can reason about variance, sample size, and whether a change is real. - Curiosity about speech and conversation systems; rigor about measurement. NICE TO HAVE - Experience with STT/TTS APIs, WebRTC or LiveKit, vector search, or fine-tuning. - pytest, Docker, any cloud deployment. - Coursework or projects in NLP, ML, or HCI. HOW TO APPLY (3 steps, ~25 minutes) 1. Click Start on this page and enter your email. 2. Open the magic link we send you and create your account. 3. Take a 20-minute AI interview with TheInterviews.ai — that IS the first screening round. No resume upload needed to start; you can add it in your profile afterwards. What happens next: we review every completed interview within 3 business days. Shortlisted candidates get a 30-minute call with the founder, then an offer. DETAILS - Internship, approximately 12 weeks, starting October/November 2026. 20–40 hours per week; flexible hours with a daily overlap window (Pacific Time). - Remote within the United States. Optional in-person days in San Diego. - Students and recent graduates welcome, including F-1 CPT/OPT. Academic credit supported where your program allows it. - Compensation: stipend and/or academic credit, confirmed at offer. - Strong interns get a return offer or a full-time conversion conversation at the end of the term. ABOUT US Cloudify Technologies LLC builds and operates TheInterviews.ai, a voice-AI hiring platform: candidates practise and take real screening interviews with an AI interviewer; companies screen at scale with consistent, explainable scoring. Small founder-led team, production traffic, real users. You will ship code or work that real candidates and recruiters use the same week.