SAP Generative AI Solutions Architect
Description
Job Title: SAP Generative AI Solutions Architect – Manager / Senior Manager
Location: Pan India
Work Type: Hybrid
Experience: 12–20 Years
Notice Period: 30–90 Days
About ARA's Client – Leading Global Professional Services Firm
ARA's Client is a global leader in professional services, providing a broad range of services and solutions in strategy, consulting, digital, technology, and operations. They operate in over 120 countries with approximately 500,000 employees, delivering innovative solutions to clients across various industries. In India, ARA's Client has a significant presence with multiple offices in Tier 1 and Tier 2 cities, including Bangalore, Mumbai, and Delhi, and they have been operating in the region for over two decades. The organization is committed to driving growth and transformation through technology and innovation, making them a preferred employer for top talent in the industry.
Role Summary
ARA's Client is seeking a forward-thinking professional with an AI-first mindset to design, build, and operationalize enterprise-grade SAP Generative AI and Agentic AI solutions, leveraging expertise in SAP Business Technology Platform (BTP), SAP AI Core, and SAP Generative AI Hub.
The ideal candidate will have strong expertise in Large Language Models (LLMs), Foundation Models, Knowledge Graphs, LangChain, LangGraph, Vector Engines, Retrieval-Augmented Generation (RAG), and GraphRAG architectures.
The role involves integrating Generative AI capabilities into SAP-centric business applications and processes, ensuring scalability, security, compliance, and measurable business impact.
Key Responsibilities
- Lead AI-driven solution design and delivery using Generative AI and Agentic AI to solve complex business problems, automate processes, and integrate intelligent insights into enterprise operations.
- Serve as a Subject Matter Expert (SME) for SAP BTP and Generative AI solutions.
- Build technical architecture designs aligned with SAP and enterprise standards.
- Architect and implement Generative AI pipelines on SAP BTP, leveraging SAP AI Core, Generative AI Hub, and SAP HANA Cloud (Vector Engine and Knowledge Graph Engine).
- Design and manage Retrieval-Augmented Generation (RAG) and GraphRAG workflows to improve grounding, accuracy, and interpretability of LLM outputs.
- Integrate Large Language Models (LLMs) and Foundation Models with enterprise data sources through grounding modules, vector similarity search, and semantic search.
- Develop LangChain / LangGraph-based orchestration pipelines for prompt templating, retrieval, generation, and post-processing.
- Collaborate with development teams using the SAP Cloud Application Programming (CAP) model to embed AI capabilities into cloud-native applications.
- Work with multi-tenant SaaS architectures, ensuring secure tenant isolation and hyperscaler-agnostic deployments.
- Employ chunking, embedding generation, and vector store management to enable efficient information retrieval and contextualization.
- Optimize orchestration pipelines through prompt templating, query rewriting, and fusion techniques such as Reciprocal Rank Fusion (RRF) to enhance retrieval precision.
- Lead the end-to-end lifecycle of Generative AI projects, from model integration and fine-tuning in AI Core to deployment, monitoring, and continuous improvement.
- Develop Python-based applications, APIs, and ETL pipelines to support AI-driven solutions.
- Implement Agentic AI frameworks and multi-agent development using LangGraph, CrewAI, or equivalent frameworks.
- Translate business requirements and SAP business processes into AI-powered solution architectures and intelligent workflows.
- Drive the transformation of SAP business processes through Generative AI and Agentic AI innovations.
- Mentor and upskill team members through knowledge-sharing sessions and best-practice frameworks.
- Ensure solution scalability, performance, and responsible AI principles throughout the development lifecycle.
- Track and report project progress, ensuring alignment with strategic business objectives.
Must-Have Qualifications
- Minimum 12 years of experience in relevant technology and solution architecture fields.
- Deep understanding of SAP Business Technology Platform (BTP) services, especially SAP AI Core and Generative AI Hub.
- Hands-on experience in building SAP BTP Generative AI applications.
- Strong expertise in Large Language Models (LLMs), Foundation Models, and LLM orchestration frameworks such as LangChain, LangGraph, or Semantic Kernel.
- Hands-on experience in designing Retrieval-Augmented Generation (RAG) pipelines involving embeddings, chunking, and vector similarity search.
- Proficiency in Knowledge Graph design, GraphRAG, and ontology modelling using SAP HANA Cloud or graph databases.
- Strong understanding of SAP HANA Cloud Vector Engine, Knowledge Graph Engine, vector stores, vector search, and semantic search APIs.
- Strong grasp of data grounding, semantic enrichment, and enterprise contextualization.
- Experience in Python application development, including building APIs and ETL pipelines.
- Experience integrating LLMs such as OpenAI, Azure OpenAI, Anthropic, or equivalent platforms.
- Hands-on experience with Agentic AI frameworks such as LangGraph, CrewAI, or equivalent.
- Experience with prompt engineering, prompt templating, schema-based output parsing, and AI evaluation frameworks.
- Understanding of data masking, content filtering, and AI governance and compliance frameworks.
- Working knowledge of SAP Cloud Application Programming (CAP) model and SAP Extension Suite.
- Experience in SAP BTP GenAI application development and identification and implementation of BTP Business AI services.
Nice to Have
- SAP certifications, particularly SAP BTP Solution Architect, SAP GenAI Developer, or AI-related certifications.
- SAP Certified Associate – Positioning SAP Business AI Solutions as part of SAP Business Suite.
- Experience with SAP Business Process Management (BPM) tools such as SAP Signavio.
- Experience transforming SAP business processes using AI and integrating Agentic AI innovations into SAP environments.
- Experience with Agentic AI development using A2A protocols and MCP servers.
- Working knowledge of RDF, SPARQL, OWL, or equivalent graph technologies.
- Familiarity with Docker, Kubernetes, and CI/CD automation using GitHub Actions, Jenkins, or SAP Continuous Integration and Delivery.
- Knowledge of observability tools such as Prometheus and Grafana, including tracing AI requests through pipelines.
- Experience deploying AI workloads using Terraform, BTP CLI, or Kyma Runtime automation.
- Familiarity with multi-tenant SaaS architecture, hyperscaler-agnostic deployments, and MLOps pipelines for AI solutions.
- Experience with large-scale SAP application deployment, infrastructure, data, integrations, and related systems.
Behavioral Competencies
- Strong ownership mindset with the ability to lead end-to-end AI solution delivery.
- Strong strategic thinking and problem-solving abilities.
- Excellent stakeholder communication and client-facing articulation.
- Strong leadership and team management capabilities.
- Ability to conduct technical discussions, customer presentations, and effective solution demonstrations.
- Excellent analytical, communication, and presentation skills.
- Ability to translate complex GenAI architectures into business outcomes, demonstrating ROI, adoption, scalability, and business value.
- Adaptability to changing environments and emerging AI technologies.
- Proactive approach towards innovation, continuous improvement, and knowledge sharing.
Why Join Us
- ARA's Client fosters a culture of innovation and collaboration.
- They provide opportunities for continuous learning and professional growth.
- The organization is at the forefront of technological advancements in AI and SAP Business AI.
- Employees contribute to impactful enterprise AI projects that drive business transformation.
- Opportunity to work on enterprise-grade Generative AI and Agentic AI solutions within the SAP ecosystem.
Skills
- Agentic AI
- AI
- Anthropic
- API
- Automation
- Azure
- CI/CD
- CLI
- Cloud
- Cloud Native
- CrewAI
- Docker
- Embeddings
- ETL
- Fine Tuning
- Generative AI
- GitHub
- GitHub Actions
- Grafana
- Jenkins
- Kubernetes
- LangChain
- LangGraph
- LLM
- MCP
- MLOps
- Observability
- OpenAI
- Prometheus
- Prompt Engineering
- Python
- RAG
- SaaS
- SAP
- SAP BTP
- Sap Hana
- Semantic Kernel
- Semantic Search
- Solution Design
- Terraform
- Vector Search
Sign in to read and join the discussion.