Senior Data Engineer: Pipelines, Spark & Azure DevOps
Posted Updated
Description
techcarrot FZ in Dubai seeks a data-focused engineer to lead robust data pipelines and analytics initiatives. You will collaborate with multiple engineering teams to integrate prototypes into core intelligence products, and translate complex data insights for stakeholders.
The role requires 5–7 years of practical experience, a Bachelor’s degree in a related field, and strong skills in Spark, Python, SQL, and data modeling. Expect a dynamic, on-site Dubai environment and cross-functional teamwork.
Collect progress updates from Squad regularly. Consolidate updates into weekly status reports for review. Participate in design and feature definition activities early. Implement robust data pipelines using the Databricks stack. Create reusable and scalable data pipelines. Collaborate with multiple engineering teams to integrate prototypes into core intelligence products. Communicate complex data insights to non-technical stakeholders. Develop and manage L3-level project plans with detailed tasks, milestones and dependencies. Experience with relational and non-relational databases. Strong data analysis skills for structured and unstructured datasets. Proficiency in Spark, Python, Scala, SQL or equivalent languages. Experience building dashboards in JIRA. Project Management experience is a plus. Azure DevOps to deploy data pipelines via CI/CD.Skills
Sign in to read and join the discussion.