Sr AI Engineer/Architect
Description
Job Title : Sr AI Engineer/Architect
Job Location: Atlanta, GA
The role
You will be the senior hands-on AI builder in the US, turning client conversations into working agents within days and production systems within weeks. You sit between presales and delivery: you design the architecture, build the proof of concept, demo it to client executives, and then lead the offshore engineering team that takes it to production.
This is a builder-architect role, not a slideware role. Expect to write code most weeks, stand in front of CIOs and AI committees most months, and own the technical quality of what Elixir ships to US clients.
Key responsibilities
Agentic AI solution design and build
- Design and build multi-agent systems using LLMs (Claude, GPT, Gemini, Llama, Mistral), tool use, MCP and agent orchestration frameworks.
- Build retrieval pipelines — RAG, GraphRAG and agentic RAG — with chunking strategies, embeddings, hybrid search, re-ranking and knowledge graphs.
- Build conversational and voice AI assistants — chat and real-time voice — integrated with ITSM, ERP, HR and knowledge systems.
- Build hardened, reusable agents for common enterprise needs — e.g. IDoc remediation, role and access recommendation, supply chain and inventory agents.
SAP and enterprise integration
- Integrate agents with SAP ECC and S/4HANA (BAPIs, IDocs, OData, SAP BTP, Joule) and other enterprise systems (Oracle, JDE, ServiceNow, Salesforce, SharePoint).
- Architect AI-assisted data pipelines on Snowflake or Databricks — mapping, cleansing, reconciliation and audit — for large-scale data migration.
Presales, POCs and client leadership
- Turn a client pain point into a working demo fast — often a zero-dollar POC tied to outcome-based pricing.
- Present architectures and live demos to client CIOs, CISOs, auditors and AI steering committees.
- Support RFP responses with solution architecture, effort estimates and technical risk assessment.
Governance, security and production readiness
- Apply responsible AI practices: guardrails, evaluation, observability, prompt and model versioning, and audit trails.
- Design for regulated environments — SOX, HIPAA, segregation-of-duties controls, and FedRAMP / IL5 where required.
- Own LLMOps: evaluation harnesses, cost and latency tuning, monitoring and model upgrades.
Required qualifications
- Contribute to the AI Center of Excellence: reference architectures, reusable accelerators, client demo sandbox.
- 10+ years in software, data or ML engineering, including experience building production AI/ML systems and hands-on with LLMs and generative AI.
- Shipped at least one agentic or LLM-powered application to production for an enterprise client — not only a prototype.
- Strong Python; working knowledge of TypeScript/Node for agent front ends and APIs.
- Hands-on with LLM APIs (Anthropic Claude, OpenAI, Azure OpenAI, Bedrock or Vertex), function/tool calling, MCP, RAG, GraphRAG, vector databases (pgvector, Pinecone, Weaviate or similar) and graph databases (Neo4j or similar).
- Experience with at least one agent framework — LangGraph, CrewAI, AutoGen, Claude Agent SDK, Semantic Kernel or equivalent.
- Cloud-native delivery on AWS, Azure or GCP: containers, CI/CD, serverless, secrets and identity management.
- Data engineering fundamentals: SQL, ETL/ELT, and a modern data platform such as Snowflake or Databricks.
- Comfortable presenting to C-level and technical audiences, and writing clear architecture documents.
Preferred qualifications
- Advanced retrieval — GraphRAG (e.g. Microsoft GraphRAG, LlamaIndex property graphs), knowledge-graph construction, entity extraction and ontology design.
- Fine-tuning and serving open-weight models — LoRA / PEFT, vLLM, Ollama, quantization.
- LLMOps and evaluation — LangSmith, Arize, Weights & Biases, Ragas, guardrail frameworks, red-teaming.
- SAP integration experience — S/4HANA, ECC, BTP, IDocs/BAPIs, GRC/security roles, or SAP Joule and Business AI.
- Regulated delivery: SOX, HIPAA, life sciences GxP, or FedRAMP / IL5 environments.
- Domain depth in manufacturing, automotive, healthcare, financial services, or energy.
- AI-driven quality engineering and test automation.
- Experience leading distributed onshore/offshore teams in a consulting or services firm.
Skills
- Agentic AI
- AI
- Anthropic
- API
- AutoGen
- Automation
- AWS
- Azure
- CI/CD
- Claude
- Cloud
- Cloud Native
- CrewAI
- Data Engineering
- Data Pipelines
- Databricks
- Elixir
- ELT
- Embeddings
- ERP
- ETL
- Fedramp
- Fine Tuning
- GCP
- Generative AI
- Hipaa
- IAM
- ITSM
- LangGraph
- LangSmith
- LlamaIndex
- LLM
- LLMOps
- Machine Learning
- MCP
- Mistral
- Neo4j
- Observability
- OData
- Ollama
- OpenAI
- Oracle
- PEFT
- pgvector
- Pinecone
- Pre-sales
- Proof of Concept
- Python
- Quantization
- RAG
- RFx (RFQ/RFP/RFI)
- Risk Assessment
- Salesforce
- SAP
- SAP BTP
- SAP S/4HANA
- Semantic Kernel
- Serverless
- ServiceNow
- SharePoint
- Snowflake
- Solution Design
- SQL
- Test Automation
- TypeScript
- Vector Databases
- vLLM
- Weaviate
Sign in to read and join the discussion.