Remote Data Engineer — Scalable Pipelines & Lakehouse
Summary
Data Engineer who builds and operates scalable batch and streaming data pipelines (ETL/ELT) in Python and SQL, using tools like Databricks, Airflow, or Dagster. Works with Delta/Parquet/Iceberg lakehouse assets, implements orchestration, monitoring, and data quality checks, and prepares datasets for ML teams.
PROGRAMMING.COM is seeking a Data Engineer to build and operate robust data pipelines using Databricks, Airflow, or Dagster. You will develop efficient ETL/ELT workflows in Python and SQL for batch and streaming workloads, and collaborate with ML teams to prepare high‑quality datasets for training and production use.
You will model and maintain Delta/Parquet/Iceberg data assets, implement orchestration and monitoring, and ensure data quality with validation and audit logging.