Data engineer
Summary
Designs and builds scalable data pipelines, cloud infrastructure, and analytics platforms using Python, SQL, Spark, Kafka, and Airflow.
REQUIREMENTS
- At least 4 years of relevant experience in data systems architecture, data systems integration, and data pipeline setup at production scale
- Good understanding of cloud computing principles including infrastructure as code, containerization, microservices architecture, cloud security frameworks, identity and access management, network architecture, and distributed systems
- Proven ability to translate business requirements into technical solutions
- Excellent communication skills for presenting complex concepts to diverse audiences
- Experience with cloud security frameworks, compliance requirements, and risk management
- Experience in data domains (e.g. DataOps, Data Lakehouse) and AI/ML Domains (e.g. MLOps, LLMOps)
- Strong Knowledge and Hands-on experience with SQL, Python and Apache Spark
- Hands-on experience with Apache Kafka, Airflow, or similar technologies