Senior Azure Data Engineer: PySpark & Databricks Pipelines
Summary
Systems Limited is looking for a Senior Data Engineer to build and optimize scalable ETL pipelines using Python, PySpark, Databricks, and Azure. The role involves collaborating with cross-functional teams to deploy secure, high-performance cloud data platforms.
Systems Limited is seeking an experienced Data Engineer to design, develop, and optimize scalable data pipelines using Python, PySpark, Databricks, and Azure. You will build ETL workflows, ensure code quality, performance, and maintainability across large datasets.
You will collaborate with data architects, scientists, BI teams, and stakeholders, follow best practices, implement tests and CI/CD, and help deploy cloud-based data platforms that meet security and scalability requirements.