Data Engineer
Posted Updated 31
views
Summary
Data Engineer in the defence domain: builds and maintains data pipelines, ETL processes, and data products using Python, PySpark, Microsoft Fabric, Delta/Iceberg tables, S3, and Airflow, with Lakehouse/Medallion architecture, data quality, automated testing, and CI/CD.
Job Title: Data Engineer - Defence Domain
Job Description:
We are looking for an experienced Data Engineer to join a cross-functional team developing modern data solutions in the Defence domain.
Key Responsibilities:
- Build and maintain data pipelines, ETL processes, and data products.
- Work with Python, PySpark, Microsoft Fabric, and cloud platforms.
- Implement data models and Lakehouse/Medallion architecture.
- Work with Delta tables, Apache Iceberg, S3, and Apache Airflow.
- Ensure data quality, automated testing, and CI/CD.
Ideal Candidate:
- 5+ years of experience in Data Engineering, Data Science, or ML Engineering.
- Strong Python and PySpark skills.
- Experience with Microsoft Fabric, ETL, and cloud platforms (Azure/AWS/GCP).
- Knowledge of data quality, workflow orchestration, and modern data architecture.
- Exposure to AI/ML engineering is an advantage.