Data Engineer: Build Real-Time Data Pipelines & Quality
Summary
Builds real-time data pipelines and ensures data quality in a data lake/warehouse using Kafka, Spark, and Snowflake, while collaborating with engineering teams to optimize performance and resolve issues.
Pattern is seeking a Data Engineer to build real-time, automated data streams and ensure data quality across the data lake and data warehouse. You will collaborate with technology teams and partners to specify data requirements and optimize performance using SQL and Python.
Reporting to the Head of Engineering APAC, you will implement data auditing, triage issues, and drive data architecture initiatives with tools like Kafka, Spark, Hadoop, Airflow, and Snowflake.