Data Engineer
Summary
Data Engineer at a defense radar company, building and maintaining scalable ETL/ELT data pipelines and infrastructure for the AI department. Day-to-day work centers on Databricks (Spark, SQL), Apache Airflow, Python, and Azure in a production environment.
DRS RADA is a leading defense high-tech company specializing in radar systems development. We are seeking an experienced Data Engineer to join our data engineering team. In this role, you will play a crucial part in designing, developing, and maintaining scalable data pipelines and infrastructure to support our AI department. This is an opportunity to work with cutting-edge technologies in a fast-paced production environment, driving impactful, data-driven solutions for the business.
Key Responsibilities:
- Design, develop, and optimize ETL/ELT pipelines for large-scale data processing.
- Work with a modern data stack, including Databricks (Spark, SQL), Apache Airflow, and Azure services.
- Troubleshoot and optimize queries and jobs for performance improvements.
- Implement best practices for data governance, security, and monitoring.
- Stay updated with industry trends and emerging technologies in data engineering.
If you're passionate about building scalable data solutions and thrive in a fast-paced environment, we’d love to hear from you!
Requirements
- 4 years of experience in data engineering or related fields.
- Proficiency in Python for data processing and automation (mandatory).
- Deep understanding of Apache Spark and Databricks for big data processing (mandatory).
- Experience with Git (mandatory).
- Expertise in Apache Airflow for workflow orchestration.
- Familiarity with cloud-based environments, particularly Azure.
- Advanced proficiency in SQL and query optimization.
- Familiarity with data modeling, ETL/ELT principles, and performance tuning.
- Knowledge of CI/CD and containerization (Docker).
- An enthusiastic, fast-learning, team-oriented, and motivated individual who loves working with data.