Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

GyanSys Brasil

Data Platform Lead / Cloud Systems Architect

Posted Updated

Description

Odyssey is seeking a Data Platform Lead / Cloud Systems Architect to own enterprise analytics on AWS. You will architect multi-region Databricks deployments, enforce secure networking, and govern GenAI infrastructure, including MLflow and vector search.

You’ll drive cost discipline, vendor governance, and data mesh contracts to enable scalable, compliant analytics The role emphasizes reproducibility with Terraform and Databricks Asset Bundles, RBAC in Unity Catalog, and a bias-free approach to

Architect and maintain a multi-region Databricks on AWS environment with secure networking. Design infrastructure for Generative AI, including MLflow governance and Databricks Vector Search. Enforce reproducibility by managing all resources via Terraform and DAB with no manual changes. Audit legacy choices with a clean slate approach and challenge the status quo. Lead FinOps reviews to differentiate necessary investments from sunk costs. Own vendor relationships (Databricks, AWS, Fivetran, Sigma) and unblock roadblocks. Drive Data Mesh by defining contracts, SLOs, and publication standards. Design privacy frameworks for GDPR/CCPA/SOC2; RTBF and PII masking workflows. Administer Sigma environment and promote assets Dev → Prod with proper tagging. Enforce RBAC across Unity Catalog and AWS IAM for least privilege. Manage high-volume data replication with Fivetran and AWS DMS; monitor schema drift. Code review pipelines for best practices (Z-ordering, schema evolution). Collaborate with analytics, data science, and business teams on scalable data solutions. Introduce emerging technologies to improve scalability and productivity. 8+ years in Data Engineering/Architecture with 3+ years in production using Databricks on AWS. Deep familiarity with GDPR, CCPA, HIPAA and PII protection in distributed data environments. Expert ELT/BI tools experience with Fivetran, AWS DMS and Sigma Computing. RBAC models in Unity Catalog and AWS IAM Identity Center. Proficient with AWS networking (Transit Gateway, VPC Endpoints, Private Subnets) and security. CI/CD experience via GitHub Actions and Databricks Asset Bundles. Vendor management, contracts, escalation and roadmap alignment. Decision-making with cost awareness and sunk-cost bias awareness. Databricks Certified Data Engineer Pro or AWS Solutions Architect Pro preferred. Knowledge of Generative AI concepts and ML techniques in data pipelines. Agile/scrum experience; Jira/Confluence.

Skills

What Lead Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →