Senior Data Engineer
Responsibilities:
- Design and maintain scalable data pipelines with Spark Structured Streaming.
- Implement Lakehouse architecture with Apache Iceberg.
- Develop ETL processes for data transformation.
- Ensure data integrity, quality, and governance.
- Collaborate with stakeholders and IT teams for seamless solution integration.
- Optimize data processing workflows and performance.
Requirements:
- 5+ years in data engineering.
- Expertise in Apache Spark and Spark Structured Streaming.
- Hands-on experience with Apache Iceberg or similar data lakes.
- Proficiency in Scala, Java, or Python.
- Knowledge of big data technologies (Hadoop, Hive, Presto).
- Experience with cloud platforms (AWS, Azure, GCP) and SQL.
- Strong problem-solving, communication, and collaboration skills.
Location: Ra'anana
Start Date: Immediate