Senior DataOps Architect

Position Details:

- Design and implement scalable data platform solutions across on-premises and GCP hybrid environments, ensuring seamless integration and optimal performance

- Architect DataOps pipelines and infrastructure automation using Infrastructure as Code (Terraform, Ansible) for multi-environment deployments

- Lead the design and maintenance of large-scale data systems spanning on-prem data centers and cloud platforms (GCP primary, Azure secondary)

- Develop and enforce DataOps best practices including CI/CD for data pipelines, data quality frameworks, and automated testing strategies

- Define cloud migration strategies from on-premises to GCP, including hybrid architecture patterns and data residency considerations

- Build and optimize data infrastructure using Kubernetes, containerization, and orchestration tools for both on-prem and cloud environments

- Create and maintain comprehensive technical and architectural documentation for data platforms and DataOps workflows

- Drive technological innovation by evaluating and introducing modern DataOps tools, platforms, and methodologies aligned with business objectives

- Mentor engineering teams on DataOps principles, cloud-native architectures, and infrastructure automation practices

- Collaborate with data engineering, platform engineering, and security teams to establish governance, compliance, and operational excellence

- Monitor industry trends in DataOps, cloud technologies, and data infrastructure to proactively recommend improvements

Requirements

Mandatory Qualifications:

- Bachelor’s degree in computer science, Data Engineering, or related field

- 10+ years of experience in infrastructure/DevOps/DataOps

- Proven track record architecting and managing on-premises data infrastructure and hybrid cloud environments

- Deep expertise with GCP services (BigQuery, Dataflow, Composer, GKE, Cloud Storage, IAM) for data platforms (5+ years)

- Hands-on experience with on-premises infrastructure including bare metal, virtualization (VMware, KVM), storage systems, and networking (5+ years)

- Expert-level proficiency with Kubernetes, Helm, and service mesh technologies (Istio, Linkerd) in production environments (5+ years)

- Experience with data pipeline orchestration tools (Apache Airflow, Prefect, Dagster)

- Knowledge of monitoring and observability stacks (Prometheus, Grafana, ELK, Datadog)

- Experience with GitOps workflows and CI/CD platforms (GitLab CI, GitHub Actions, Jenkins)

- Background in data security, compliance frameworks, and disaster recovery planning

- Excellent communication skills with ability to translate technical concepts to non-technical stakeholders

- Strong experience with Infrastructure as Code tools: Terraform, Ansible, CloudFormation

- Proficiency with Azure cloud services and hybrid connectivity (ExpressRoute, VPN) is a plus