Senior Data Engineer: Lead AI-Driven Pipelines (Hybrid)
Posted Updated
Description
Artefact seeks a Senior Data Engineer to design, build, and manage scalable data pipelines and lead a team of data engineers. You will work with SQL, Python, and cloud-native tools such as Databricks, Snowflake, and Airflow to deliver robust data solutions.
Hybrid working arrangement with regular in-office collaboration. Strong emphasis on governance, security, and data architecture including data mesh, lakes, and warehouses.
Design, build, and maintain scalable data pipelines using SQL and Python, with Databricks, Snowflake, or similar tools. Lead the integration of complex data systems across platforms to ensure data consistency. Implement CI/CD for data pipelines to improve efficiency and data quality. Collaborate with data architects, analysts, and stakeholders to translate requirements into technical solutions. Oversee and mentor a team of data engineers. Develop and enforce data governance, security, and compliance practices. Optimize data retrieval and develop dashboards and reports for business teams. Continuously evaluate new technologies to enhance the data engineering function. 3+ years of data engineering experience with SQL, Python, and big data tech. Experience building scalable data workflows using cloud-native orchestration and distributed processing. Terraform or IaC tooling experience. Strong CI/CD and DevOps/DevSecOps practices. Proven leadership of data engineering teams. Hybrid work arrangement Office days in the weekSkills
Sign in to read and join the discussion.