Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

DataArt

Data Engineer (AWS Snowflake)

Posted Updated

Description

We are looking for a Senior Data Engineer to implement and validate change data capture from AWS Aurora PostgreSQL into Snowflake. You will help build metadata-driven integration frameworks, support schema adoption in the Medallion architecture, and contribute to performance, reliability, and governance across the data flow.


Responsibilities:

  • Configure and operate Snowflake OpenFlow from Aurora PostgreSQL to Snowflake.
  • Tune and troubleshoot Aurora PostgreSQL for logical replication.
  • Provision infrastructure using Terraform and AWS IAM with least privilege access controls.
  • Run structured proof-of-concept tests for large tables, high-volume CDC concurrency, and outage recovery scenarios.
  • Document outcomes of proof of concept testing and validation activities.
  • Monitor replication health using Snowflake native observability and Amazon CloudWatch.
  • Define success criteria with stakeholders for replication and ingestion validation.
  • Support Snowflake-side setup for managed ingestion, including warehouse grants, schedules, and reconciliation checks.
  • Apply security and governance practices appropriate to a regulated financial and member services context.
  • Perform schema DBT and Snowflake native pipeline renewal while preserving business and data continuity.
  • Execute performance and cost improvements.
  • Follow agreed teardown procedures to remove replication and access artifacts.


Requirements:

  • Technology stack: Snowflake OpenFlow, AWS Aurora PostgreSQL, Snowflake, Terraform, AWS IAM, DBT, SQL, Amazon CloudWatch, GitHub, Apache NiFi, Airflow, Python, Amazon EKS, Kubernetes.
  • Hands-on experience with Snowflake, OpenFlow, or Apache NiFi.
  • Strong experience with PostgreSQL or Aurora, including logical replication, WAL slots, and access control.
  • Experience with Terraform on AWS, including networking security groups, IAM, and role pass-through for managed services.
  • Experience with DBT for data transformations.
  • Proficiency in SQL for transformations validation and reconciliation.
  • Working knowledge of Snowflake, including warehouse roles and loading patterns.
  • Understanding of CDC and ELT fundamentals.
  • Experience with data quality validation and reconciliation practices.
  • Strong communication skills for Agile cross-team collaboration in distributed teams.
  • Experience with GitHub.


Nice to have:

  • Experience with PostgreSQL sources and Snowflake targets using OpenFlow NiFi or similar services.
  • Experience with Python or similar languages for checks automation and reporting.
  • Experience with Snowflake OpenFlow or similar managed CDC offerings.
  • Experience with Airflow or equivalent tools for production orchestration.
  • Experience in financial services or similar regulated domains.
  • Experience with cloud cost estimation for replication at scale.
  • Experience with Amazon EKS or Kubernetes for monitoring and issue resolution in the OpenFlow or NiFi environment.
  • Experience with Cursor or Claude.
  • Experience with specification-driven development.

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →