Senior Data Engineer – Python / Spark / AWS & GCP
Summary
Build and maintain scalable data pipelines using Python, Spark, and cloud services (AWS/GCP) to process and transform large datasets efficiently.
Nasze wymagania:
- 10+ years of experience in Data Engineering, Software Engineering, Distributed Systems, or a related field.
- Strong programming skills in Python, Java, or Scala.
- Strong knowledge of SQL and experience with SQL and NoSQL databases such as BigQuery, Teradata, MySQL, PostgreSQL, or Cassandra.
- Experience with Big Data technologies, including Hadoop, Hive, and Apache Spark.
- Hands-on experience with Airflow or another orchestration tool.
- Strong understanding of ETL, data lineage, data