Data Engineer II
Summary
Data Engineer owning and scaling data pipelines and data products for an experimentation platform — improving reliability, monitoring, and data quality while serving stakeholders. Core stack: Java or Python, cloud-based pipelines, and tools like Kafka, Flink, Airflow, and Spark.
Summary: We are looking for a Data Engineer to enhance our experimentation platform by improving data reliability, scalability, and operations. The role will involve collaboration with other engineers to maintain and optimize data products.
Main Responsibilities:
* Take ownership of multiple data pipelines and products, and provide innovative solutions to reduce operational workload.
* Rapidly develop scalable, flexible, and high-performance data pipelines.
* Contribute to developing capabilities like monitoring, debugging, and alerting for data products.
* Prioritize and resolve issues with data pipelines based on customer impact.
* Ensure end-to-end ownership of data quality in complex datasets.
* Experiment with new tools and technologies for performance and data quality improvements.
* Provide tools for the analytics community to discover and assess data quality.
* Serve as the main point of contact for stakeholders on data engineering issues.
Key Requirements:
* Minimum of 5 years of hands-on experience in data engineering or software engineering for data pipelines.
* Bachelor’s degree in Computer Science, Engineering, Mathematics, or equivalent experience.
* Solid experience in at least one programming language, preferably Java or Python.
* Experience building production data pipelines in the cloud.
* Hands-on experience with schema design and data modeling.
* Knowledge of tools like Flink, Kafka, Airflow, Spark, etc.
Nice to Have:
* Experience with teams across different timezones.
* Familiarity with experimentation, statistics, and A/B testing.
Other Details:
This position offers the opportunity for remote work, allowing for flexibility and collaboration with teams across various locations. The role may also involve engaging in experimentation practices to enhance data-driven decision-making.
Skills
Sign in to read and join the discussion.