Cloud Solution Architect – Enterprise AI Infrastructure & FinOps
Posted Updated
Description
<p class="MsoNormal" style="margin-bottom:0cm;">We are looking for a Cloud
Solution Architect whose <b>primary responsibility is to design, build, manage,
and optimize the enterprise cloud infrastructure</b> that runs our AI
ecosystem. </p><p></p><p class="MsoNormal"><b> </b></p><p><b></b></p><b></b><p class="MsoNormal"><b>Job Description: </b></p><p><b></b></p><b></b><p class="MsoNormal" style="margin-bottom:0cm;"><b>Role:</b> Cloud Solution
Architect – Enterprise AI Infrastructure & FinOps<br />
<b>Experience:</b> 12–18 years total, with at least 6 years in cloud
architecture and at least 3 years architecting production AI/ML or GenAI
platforms<br />
<b>Domain:</b> Enterprise AI Platform (Pharma / Life Sciences, GxP-aware)<br />
<b>Education: </b>B.E./B.Tech in Computer Science, Information Technology,
Information Security, Electronics & Communication, or related Engineering
disciplines.</p><p></p><p class="MsoNormal" style="margin-bottom:0cm;"><b>Location: </b>Ahmedabad/Mumbai</p><p></p><p class="MsoNormal" style="margin-bottom:0cm;"></p><p> </p><p class="MsoNormal" style="margin-bottom:0cm;"><b>Role Summary</b></p><p><b></b></p><b></b><p class="MsoNormal" style="margin-bottom:0cm;">The individual hired as Cloud
Solution Architect will be responsible for cloud foundation end to end: landing
zones, networking, compute, storage, identity, security, Kubernetes platforms,
GPU capacity, infrastructure-as-code, monitoring, resilience, and day-to-day
infrastructure operations. </p><p></p><p class="MsoNormal" style="margin-bottom:0cm;"></p><p> </p><p class="MsoNormal" style="margin-bottom:0cm;">The role will ensure that AI and
GenAI workloads operate securely, reliably, and at scale while driving cloud
governance, operational excellence, and FinOps practices to maintain
transparency, control, and optimization of cloud and AI spending.</p><p></p><p class="MsoNormal" style="margin-bottom:0cm;"></p><p> </p><p class="MsoNormal" style="margin-bottom:0cm;">This is a hands-on infrastructure
leadership role. Application and AI engineering teams build agents and
workflows; you make sure the platform they run on is secure, stable, scalable,
compliant, and cost-efficient.</p><p></p><p class="MsoNormal" style="margin-bottom:0cm;"><b> </b></p><p class="MsoNormal" style="margin-bottom:0cm;"><b>Key Responsibilities</b></p><p><b></b></p><b></b><p class="MsoNormal" style="margin-bottom:0cm;"><b>1. Cloud Infrastructure
Architecture</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Own the enterprise cloud infrastructure
architecture on <b>Azure, AWS, and/or GCP</b>, including multi-cloud and
hybrid designs.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Design and maintain <b>enterprise landing zones</b>:
management group and account/subscription structure, policies, guardrails,
naming and tagging standards, and environment separation (dev, test,
validation, production).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Architect <b>network infrastructure</b>:
hub-and-spoke or Virtual WAN topologies, VNets/VPCs, subnets, private
endpoints, DNS, load balancers, application gateways, WAF,
ExpressRoute/Direct Connect, site-to-site VPN, and hybrid connectivity to
data centers and manufacturing sites.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Design compute platforms across VMs, VM scale sets,
containers, <b>Kubernetes (AKS, EKS, GKE)</b>, serverless (Functions,
Lambda, Cloud Run), and managed PaaS services.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Architect storage and database infrastructure:
object storage, file shares, managed disks, backup vaults, and managed
databases (SQL, PostgreSQL, Cosmos DB, DynamoDB, Redis).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Design for <b>high availability, multi-region
resilience, disaster recovery, and business continuity</b> with defined
RTO and RPO targets.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Maintain architecture documentation, reference
designs, and architecture decision records (ADRs).<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>2. Cloud Infrastructure
Management and Operations</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Own the <b>day-to-day health, stability, and
performance</b> of cloud infrastructure supporting AI and enterprise
workloads.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Lead infrastructure provisioning, configuration,
patching, upgrades, and lifecycle management for VMs, Kubernetes clusters,
networking, and platform services.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Manage <b>Kubernetes platform operations</b>:
cluster upgrades, node pools (CPU and GPU), ingress, service mesh,
autoscaling, namespaces, and multi-tenancy for AI teams.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Define and track infrastructure <b>SLOs, SLAs, and
capacity plans</b>, and lead major incident response, root cause analysis,
and problem management.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Implement <b>backup, restore, and DR testing</b> on
a regular schedule and maintain runbooks.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Establish ITIL-aligned processes for incident,
change, problem, and service request management in collaboration with IT
operations and managed service providers.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Manage cloud vendors and managed service partners,
including SLA and performance governance.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Drive operational automation to reduce manual
effort and human error.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>3. Infrastructure-as-Code,
Automation and Platform Engineering</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Define and enforce <b>infrastructure-as-code
standards</b> using Terraform, Bicep/ARM, Pulumi, or CloudFormation.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Build reusable IaC modules, templates, and
"golden paths" so teams can self-serve compliant infrastructure
quickly.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Implement <b>CI/CD and GitOps</b> for
infrastructure (GitHub Actions, Azure DevOps, GitLab, Argo CD, Flux).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Apply <b>policy-as-code</b> (Azure Policy, AWS
SCPs/Config, OPA/Gatekeeper) to prevent misconfiguration and enforce
security and cost guardrails.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Automate environment provisioning, scaling,
patching, compliance checks, and cleanup.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Build an internal developer platform experience for
AI, data, and application teams.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>4. AI Infrastructure Enablement</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Design and operate the infrastructure foundation
for AI workloads, covering agent runtimes, workflow engines, data
pipelines, model serving, and vector and search services.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Provision and manage <b>GPU and accelerator
capacity</b> (NVIDIA A100/H100/L40S, Inferentia/Trainium, TPUs) for
inference, fine-tuning, and batch processing, including quota management
and capacity reservations.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Host and secure <b>LLM access infrastructure</b>:
Azure OpenAI, AWS Bedrock, Vertex AI, and self-hosted open-source models
(vLLM, TGI, Triton, KServe, Ray).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Deploy and operate a centralized <b>AI/LLM gateway</b>
for secure model access, routing, rate limiting, caching, logging, and
cost attribution.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Provide infrastructure for agent frameworks and
orchestration tools (e.g., LangGraph, Semantic Kernel, Azure AI Foundry,
Bedrock Agents, Temporal, Airflow, Logic Apps, Step Functions), including
MCP servers and secure tool connectors.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Support data platforms used by pipelines, such as
Databricks, Snowflake, Microsoft Fabric, Synapse, Kafka/Event Hub, and
vector stores (Azure AI Search, OpenSearch, pgvector, Pinecone, Qdrant).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Ensure network isolation, private connectivity, and
secure integration between AI services and enterprise systems (SAP, LIMS,
MES, QMS, document repositories, and on-premises data).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Partner with AI engineering teams on LLMOps/MLOps
infrastructure: model registries, experiment tracking, CI/CD for AI
assets, and environment promotion.<p></p></li>
<li class="MsoNormal">Architect
the <b>agent runtime platform</b>: hosting, lifecycle management, state
and memory, tool execution, session handling, and scaling.<p></p></li>
<li class="MsoNormal">Define
standards for agent frameworks and patterns (e.g., LangGraph, Semantic
Kernel, AutoGen, CrewAI, OpenAI Agents SDK, AWS Bedrock Agents, Azure AI
Foundry Agent Service).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Design <b>multi-agent orchestration</b> patterns:
supervisor/worker, hierarchical, planner-executor, and agent-to-agent
(A2A) collaboration.<p></p></li>
<li class="MsoNormal">Design
the orchestration layer for AI-enabled business workflows combining
agents, deterministic logic, APIs, and human tasks.<p></p></li>
<li class="MsoNormal">Standardize
on durable orchestration and workflow engines (e.g., Temporal, Azure
Durable Functions, Logic Apps, AWS Step Functions, Airflow, Prefect, n8n,
Power Automate) based on use case.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Define event-driven architectures using Kafka,
Event Hub, EventBridge, or Pub/Sub for real-time, asynchronous triggers.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>5. Cloud FinOps and AI Cost
Management</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Establish and run the <b>cloud FinOps practice</b>
based on FinOps Foundation principles (Inform, Optimize, Operate) and the
FOCUS billing standard.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Implement mandatory <b>tagging and cost allocation</b>
so every resource and AI workload maps to an owner, cost center,
application, agent, workflow, or pipeline.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Deliver <b>showback and chargeback</b> reporting to
business units and product teams.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Track cloud spend across compute, storage,
networking, data egress, PaaS services, GPUs, and <b>LLM token consumption</b>.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Define <b>unit economics</b> such as cost per agent
interaction, cost per workflow run, cost per pipeline execution, and cost
per environment.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Drive infrastructure cost optimization through: <p></p><ul style="margin-top:0cm;" type="circle">
<li class="MsoNormal" style="margin-bottom:0cm;">Rightsizing VMs, clusters, and databases<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Reserved instances, savings plans, and committed
use discounts<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Spot and preemptible capacity for non-critical and
batch workloads<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Autoscaling, scale-to-zero, and scheduled shutdown
of non-production environments<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Storage tiering, lifecycle policies, and orphaned
resource cleanup<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">GPU utilization improvement and workload
consolidation<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">LLM cost controls such as model routing, caching,
batch APIs, and provisioned throughput decisions<p></p></li>
</ul></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Set <b>budgets, quotas, and anomaly alerts</b> per
subscription, team, and AI workload.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Produce forecasts and executive dashboards linking
cloud and AI spend to business value.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Support Finance and Procurement on enterprise
agreements, commitments, and vendor negotiations.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>6. Cloud Security and
Compliance</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Design and enforce cloud security architecture
based on <b>zero-trust principles</b>.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Own identity and access architecture (Entra ID, AWS
IAM, GCP IAM), RBAC, privileged access management, managed identities, and
workload identity for agents and services.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Implement secrets and key management (Key Vault,
KMS, HashiCorp Vault), encryption at rest and in transit, and certificate
lifecycle management.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>7. Monitoring, Observability
and Reliability</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Architect enterprise monitoring and observability
for infrastructure and AI workloads using Azure Monitor, CloudWatch,
Google Cloud Operations, Datadog, Dynatrace, Prometheus/Grafana, and
OpenTelemetry.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Monitor infrastructure health, performance,
capacity, GPU utilization, network latency, and cost in unified
dashboards.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Integrate AI-level telemetry (token usage, latency,
failures) from tools such as Langfuse or LangSmith with infrastructure
observability.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Apply <b>SRE practices</b>: error budgets,
proactive alerting, chaos testing, and post-incident reviews.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>8. Technical Leadership and
Governance</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Act as the <b>design authority for cloud
infrastructure</b>, reviewing and approving infrastructure designs from
project and product teams.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Define cloud standards, policies, and best
practices, and drive consistent adoption across teams.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Lead and mentor cloud engineers, DevOps/platform
engineers, and operations staff.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>Required Skills and Experience</b></p><p><b></b></p><b></b><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">12+ years in IT infrastructure, with at least 7
years of hands-on <b>cloud infrastructure architecture and operations</b>
on Azure, AWS, or GCP (multi-cloud preferred).<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Deep expertise in cloud networking, identity,
compute, storage, and security services.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Strong hands-on experience with <b>Kubernetes</b>
(AKS/EKS/GKE) and containers in production, including GPU node pools.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Advanced <b>infrastructure-as-code</b> skills
(Terraform preferred) and CI/CD/GitOps practices.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Proven experience managing production cloud
environments at enterprise scale, including incidents, DR, patching, and
change management.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Demonstrated experience implementing <b>cloud
FinOps</b>: tagging, allocation, optimization, and reporting.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Practical experience supporting AI/ML or GenAI
workloads: LLM services, model serving, GPU infrastructure, vector
databases, and data platforms.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Strong understanding of cloud security, zero trust,
and compliance frameworks.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Scripting skills in <b>Python, PowerShell, or Bash</b>.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Experience in regulated industries; pharma or life
sciences GxP experience is a strong advantage.<p></p></li>
</ul><p class="MsoNormal" style="margin-bottom:0cm;"><b>Preferred Qualifications</b></p><p><b></b></p><b></b><p>
</p><ul style="margin-top:0cm;" type="disc">
<li class="MsoNormal" style="margin-bottom:0cm;">Bachelor's or Master's degree in Computer Science,
Information Technology, Engineering, or a related field.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Certifications such as <b>Azure Solutions Architect
Expert, AWS Solutions Architect Professional, Google Professional Cloud
Architect</b>, CKA/CKAD, HashiCorp Terraform Associate, <b>FinOps
Certified Practitioner/Engineer</b>, Azure AI Engineer, AWS ML Specialty,
or ITIL.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Experience with hybrid infrastructure connecting
cloud to on-premises data centers and manufacturing/OT environments.<p></p></li>
<li class="MsoNormal" style="margin-bottom:0cm;">Exposure to AI governance and Responsible AI
frameworks.<p></p></li>
</ul>
Skills
- AI
- Airflow
- AKS
- API
- Argo CD
- AutoGen
- Automation
- AWS
- AWS Bedrock
- Azure
- Azure DevOps
- Azure Logic Apps
- Azure Monitor
- Bash
- Bicep
- CI/CD
- Cloud
- Cloud Run
- Cloud Security
- CloudFormation
- CloudWatch
- Cosmos Db
- CrewAI
- Data Pipelines
- Databricks
- Datadog
- DevOps
- DNS
- DynamoDB
- Dynatrace
- EKS
- Entra ID
- Event Driven Architecture
- Eventbridge
- Fine Tuning
- FinOps
- Flux
- GCP
- Generative AI
- GitHub
- GitHub Actions
- GitLab
- GitOps
- GKE
- GPU
- Grafana
- IAM
- Infrastructure as Code
- ITIL
- Kafka
- Kubernetes
- Lambda
- Langfuse
- LangGraph
- LangSmith
- LIMS
- LLM
- LLMOps
- Machine Learning
- MCP
- Microsoft Fabric
- MLOps
- n8n
- Networking
- Observability
- OpenAI
- OpenSearch
- OpenTelemetry
- pgvector
- Pinecone
- PostgreSQL
- Power Automate
- PowerShell
- Prefect
- Prometheus
- Pulumi
- Python
- Qdrant
- RBAC
- Redis
- Root Cause Analysis
- SAP
- Semantic Kernel
- Serverless
- Snowflake
- SQL
- SRE
- AWS Step Functions
- Terraform
- Triton
- Vault
- Vector Databases
- Vertex AI
- vLLM
- VPN
- WAF
- WAN
- Zero Trust
