AI Architect – GenAI & ML
Description
Key Responsibilities :
• Own end-to-end delivery of multiple AI and GenAI projects from requirement understanding to production deployment
• Lead solution architecture and design decisions across GenAI and ML use cases, ensuring scalability, security, and performance
• Engage with business and client stakeholders to translate requirements into practical AI solutions • Remain hands-on with implementation, including building APIs, integrating AI services, and troubleshooting production issues
• Manage multiple AI initiatives in parallel, ensuring timelines, quality, and stakeholder alignment
• Troubleshoot and optimize production AI systems including performance, latency, and model quality issues
• Drive architectural trade-offs across cost, latency, accuracy, and infrastructure constraints including cloud and on-premise options
• Design and implement RAG pipelines using Azure AI Search with vector, semantic, and hybrid retrieval strategies
• Build LLM powered applications using Azure OpenAI with strong prompt engineering and structured output techniques
• Develop AI driven solutions for summarization, classification, document intelligence, Q&A, and automation use cases
• Implement human in the loop workflows and red teaming approaches to continuously improve model outputs
• Own AI evaluation frameworks including benchmarking, testing, and performance validation using tools such as RAGAS, BLEU, and precision and recall metrics
• Implement observability and tracing using tools such as Langfuse, LangSmith, or Azure AI Foundry evaluations
• Design and enforce guardrails including content filtering, prompt injection protection, bias mitigation, and compliance controls
• Deploy solutions on Azure with CI/CD pipelines, logging, monitoring via Application Insights, and full audit trails
• Design hybrid architectures considering data residency, on-premise GPU constraints, and regulatory requirements
• Develop and evaluate traditional ML models for classification, clustering, prediction, and other use cases
• Mentor junior engineers and ensure overall solution quality across the team
Requirements:
• 8 or more years of experience in AI/ML engineering and solution architecture
• 3 or more years of hands-on experience in GenAI and LLM based applications in production
• Proven experience leading multiple AI projects in enterprise environments with direct stakeholder engagement
• Strong understanding of RAG architectures, embeddings, vector databases, and LLM orchestration frameworks
• Experience with agentic AI frameworks such as LangGraph, AutoGen, Semantic Kernel Agents, or CrewAI for building multi-step reasoning and orchestration pipelines
• Hands-on experience with LLM observability and tracing tools such as Langfuse, LangSmith, or Azure AI Foundry
• Experience with AI evaluation frameworks including RAGAS and standard ML metrics such as BLEU, precision, recall, and F1
• Experience designing guardrail systems using tools such as Guardrails AI, NeMo Guardrails, or Azure content safety
• NLP experience including classification, named entity recognition, embeddings, and fine tuning with LoRA or PEFT
• Strong understanding of responsible AI, bias mitigation, red teaming, and auditability requirements
• Strong Python skills including FastAPI, Pandas, and NumPy with experience building and deploying production APIs
• Hands-on experience with the Azure AI stack including Azure OpenAI, AI Search, AI Foundry, Document Intelligence, AI Language, AI Vision, AI Speech, Cosmos DB, and Application Insights
• Experience with HuggingFace Transformers for open source model development and evaluation
• Experience working in regulated environments such as banking, fintech, or government is preferred
• Experience designing solutions under data residency, compliance, and hybrid cloud and on premise constraints
• Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, or a related field; Master’s degree preferred
Skills
- Agentic AI
- AI
- API
- AutoGen
- Automation
- Azure
- Azure Application Insights
- CI/CD
- Cloud
- Cosmos Db
- CrewAI
- Data Science
- Embeddings
- FastAPI
- Fine Tuning
- Fintech
- Generative AI
- GPU
- Hugging Face
- Langfuse
- LangGraph
- LangSmith
- LLM
- Machine Learning
- NLP
- NumPy
- Observability
- OpenAI
- pandas
- PEFT
- Prompt Engineering
- Python
- RAG
- Semantic Kernel
- Transformers
- Vector Databases
Sign in to read and join the discussion.