Data Platform Lead / Cloud Systems Architect
Posted Updated
Description
Odyssey is seeking a Data Platform Lead / Cloud Systems Architect to own enterprise analytics on AWS. You will architect multi-region Databricks deployments, enforce secure networking, and govern GenAI infrastructure, including MLflow and vector search.
You’ll drive cost discipline, vendor governance, and data mesh contracts to enable scalable, compliant analytics The role emphasizes reproducibility with Terraform and Databricks Asset Bundles, RBAC in Unity Catalog, and a bias-free approach to
Architect and maintain a multi-region Databricks on AWS environment with secure networking. Design infrastructure for Generative AI, including MLflow governance and Databricks Vector Search. Enforce reproducibility by managing all resources via Terraform and DAB with no manual changes. Audit legacy choices with a clean slate approach and challenge the status quo. Lead FinOps reviews to differentiate necessary investments from sunk costs. Own vendor relationships (Databricks, AWS, Fivetran, Sigma) and unblock roadblocks. Drive Data Mesh by defining contracts, SLOs, and publication standards. Design privacy frameworks for GDPR/CCPA/SOC2; RTBF and PII masking workflows. Administer Sigma environment and promote assets Dev → Prod with proper tagging. Enforce RBAC across Unity Catalog and AWS IAM for least privilege. Manage high-volume data replication with Fivetran and AWS DMS; monitor schema drift. Code review pipelines for best practices (Z-ordering, schema evolution). Collaborate with analytics, data science, and business teams on scalable data solutions. Introduce emerging technologies to improve scalability and productivity. 8+ years in Data Engineering/Architecture with 3+ years in production using Databricks on AWS. Deep familiarity with GDPR, CCPA, HIPAA and PII protection in distributed data environments. Expert ELT/BI tools experience with Fivetran, AWS DMS and Sigma Computing. RBAC models in Unity Catalog and AWS IAM Identity Center. Proficient with AWS networking (Transit Gateway, VPC Endpoints, Private Subnets) and security. CI/CD experience via GitHub Actions and Databricks Asset Bundles. Vendor management, contracts, escalation and roadmap alignment. Decision-making with cost awareness and sunk-cost bias awareness. Databricks Certified Data Engineer Pro or AWS Solutions Architect Pro preferred. Knowledge of Generative AI concepts and ML techniques in data pipelines. Agile/scrum experience; Jira/Confluence.Skills
- Agile
- AI
- Analytics
- AWS
- Ccpa
- CI/CD
- Cloud
- Confluence
- Data Engineering
- Data Mesh
- Data Pipelines
- Data Science
- Databricks
- ELT
- FinOps
- Fivetran
- Gdpr
- Generative AI
- GitHub
- GitHub Actions
- Hipaa
- IAM
- Jira
- Machine Learning
- MLflow
- Networking
- RBAC
- Scrum
- SOC 2
- Terraform
- Unity
- Unity Catalog
- Vector Search
- Vendor Management
- VPC
Sign in to read and join the discussion.