Senior AI/ML Engineer
Description
About Position:
We're looking for a Senior AI/ML Engineer with 6+ years exp to design, build, and scale LLM-powered agent systems that turn natural language into accurate, production-grade data insights. You'll sit at the intersection of applied AI engineering, backend systems, and analytics building the agents, services, and semantic layers that let stakeholders query complex data (Spark/Athena) through conversational interfaces, and get trustworthy answers back.
- Role: Senior AI/ML Engineer
- Location: All Persistent Locations
- Experience: 6 to 10 Years
- Job Type: Full-Time Employment
What You'll Do:
- Design and extend LLM agents using LangGraph/LangChain tool routing, SQL generation, RAG pipelines, and response synthesis
- Build and maintain FastAPI services with async I/O, authentication, observability (LangFuse), and Redis-based checkpointing
- Curate table and metric metadata and semantic layers so LLMs generate accurate Spark/Athena SQL
- Design and ship conversational interfaces (chatbots) that expose agent capabilities to end users across channels (e.g. Slack)
- Instrument and analyze conversation-level analytics to drive iterative improvements to agent quality
- Partner with stakeholders to encode business logic and metric definitions into the platform
- Integrate data sources (AWS Athena, PySpark/Databricks) and build export pathways to Slack and Google Sheets
- Write tests, improve system reliability, and tune prompts/evals to maintain production quality
- Build Skills and MCP
Expertise You'll Bring:
- Strong PySpark and Python skills (FastAPI, Pydantic, async patterns) with solid API design fundamentals
- Advanced SQL (Spark SQL / Hive / Athena) joins, CTEs, aggregations, partition pruning, and performance tuning
- Data analytics experience: metric design, funnel/cohort analysis, dimensional modeling
- Hands-on experience with BI tools (Tableau or Qlik Sense) — dashboarding, KPI definitions, and translating visualization logic into queryable data models
- Practical experience with LLM/agent systems: tool use, prompt engineering, retrieval, and evaluation; experience with LangGraph, LangChain, OpenAI APIs, or LangFuse
- Experience building or integrating chatbot/conversational interfaces, with an analytical approach to measuring conversation quality and user outcomes
- Experience with cloud data platforms (AWS), Git, and unit/integration testing
- Building AI Skills and agent workflows
- MCP server development and integrations
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
Skills
- Accessibility
- AI
- Analytics
- API
- Api Design
- Athena
- Authentication
- AWS
- Cloud
- Data Analytics
- Databricks
- Dimensional Modeling
- FastAPI
- Git
- Hive
- Integration Testing
- LangChain
- Langfuse
- LangGraph
- LLM
- Machine Learning
- MCP
- Observability
- OpenAI
- Prompt Engineering
- Pydantic
- PySpark
- Python
- Qlik
- RAG
- Redis
- Slack
- Spark
- SQL
- Tableau