Data Engineer
Posted 78
views
Summary
Data Engineer building scalable data pipelines and cloud-native data solutions on Azure: designing ETL/ELT workflows in Python/SQL (PySpark), implementing governance with Unity Catalog, and supporting CI/CD and DevOps practices, with banking/financial services experience preferred.
- Design, develop, and maintain scalable data pipelines and cloud-native data solutions on Azure.
- Build and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.
- Implement data governance, security, and lineage using Unity Catalog.
- Collaborate with business stakeholders, analysts, and engineering teams to deliver data products.
- Support CI/CD implementation, code deployment, and DevOps best practices.
- Ensure data quality, performance optimization, and adherence to engineering standards.
Required Experience
- Experience in Data Engineering with Azure technologies.
- Experience delivering end-to-end data solutions in enterprise environments.
- Exposure to Data Products and modern data platform implementations.
Technical Skills
- Programming: Advanced Python (PySpark, Pandas, NumPy) and SQL.
- Data Architecture: Cloud-native solution design, data governance, and large-scale data processing.
Soft Skills
- Strong communication and presentation skills across technical and business audiences.
- Ability to work effectively with cross-functional and distributed teams.
- Excellent analytical, problem-solving, and decision-making capabilities.
- Self-motivated, adaptable, and capable of working independently with minimal supervision.
Preferred Qualifications
- Experience in Banking and Financial Services.
- Knowledge of data governance and enterprise data management frameworks.
- Understanding of Agile delivery methodologies and DataOps practices.
Skills
Sign in to read and join the discussion.