Machine Learning Engineer
Posted Updated
Description
- This position is needed to build and scale the pipelines that turn raw conversation data into structured, searchable customer memory, and the evaluation systems that keep that memory accurate as the product evolves
- You’ll join the Conversation Memory team, which builds the memory layer behind Twilio’s Conversational AI platform: the systems that extract what matters from millions of conversations, resolve it to the right customer, and retrieve it in milliseconds when an agent needs it. Memory that is wrong, stale, or crossed between customers is worse than no memory at all, so quality measurement is a first-class part of the work
- Build the extraction pipeline that turns raw data into structured memory, tuning the LLM prompts and schemas that decide what an AI agent remembers about a customer and what it forgets
- Own the retrieval path that answers “what do we know about this person?” in milliseconds, working with embeddings, vector search, and ranking
- Contribute to the eval systems that tell us whether memory is actually getting better, turning a fuzzy question of quality into benchmarks and regression gates that run before every change ships
- Diagnose production issues across the ingestion, extraction, and indexing path using logs, metrics, and traces
- Partner with Product and ML teams to translate customer problems into system changes and evaluation criteria
Benefits
- Build and present a Twilio app to earn your Twilio track jacket and receive $30 per month for e-books for continued learning and education
- Work from home opportunities
- Generous annual time off in all countries
- Comprehensive health programs
- Programs to help our employees plan for their retirement needs
- Generous maternity, paternity, and adoption leaves, as well as family medical care leave
- Variety of snacks, drinks, and catered meals in each of our locations
- Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is just starting or hasn’t followed a traditional path, don’t let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!
- Experience building or working with evaluation/quality-measurement systems, such as regression detection or quality metrics, or the desire to learn
- Fluency with AI-assisted dev tools (e.g. agents for code generation, review, debugging), applied with deliberate direction and critical thinking
- A curious approach to service management: ability to investigate how systems actually behave in production, and desire to continuously learn how to operate them with rigor and accountability
- Solid grounding in observability practices: structured logging, metrics, and using them to debug distributed systems in production
- Experience building backend services, and a demonstrated ability to pick up new languages, frameworks, and tools as the problem demands
- Practical experience applying ML, e.g. building, evaluating, or productionizing models
- Experience building LLM-backed products
- Experience with Go and/or Python
- Experience with event-streaming systems (e.g. Kafka)
Skills
Sign in to read and join the discussion.