Data Platform Engineer
Summary
Builds and maintains data pipelines to ingest, transform, and model industrial telemetry/data into trusted datasets, using tools like Dagster, DBT, and CDC. Focuses on ensuring data quality, observability, and workflow orchestration for a product company.
- Build data ingestion pipelines
- Define versioned data and event contracts
- Develop streaming telemetry pipelines
- Ensure data quality freshness completeness correctness
- Implement Change Data Capture
- Integrate machine PLC historian and industrial protocol data
- Maintain lineage observability and offline feature datasets
- Manage ordering deletes retries replay idempotence backpressure
- Model data into trusted datasets
- Orchestrate workflows with Dagster
- Set up data CI CD and backfills
- Transform data with DBT
Perks/Benefits:
- 401k
- Dental insurance
- Equity
- Flexible vacation policy
- Life insurance
- Medical insurance
- Relocation support
- Vision insurance