Senior Data Engineer - Up To €85.000 A Year
Summary
Senior Data Engineer leading the migration of legacy Cloudera (CDH/HDP) environments to Snowflake or Databricks and building cloud-native data platforms. Day to day: designing Spark/PySpark pipelines, re-platforming Hive/Impala workloads, building CDC/API ingestion, and developing Python data services on AWS or GCP.
We're hiring aSenior Data Engineerto lead the delivery of modern, cloud-native data platforms supporting advanced analytics and machine learning.This is a hands-on senior rolefocused onmigrating legacy Cloudera environments to Snowflake or Databricksand building scalable data platforms from scratch.
Key Responsibilities:
- Design scalable data pipelines usingSpark / PySpark
- LeadCloudera (CDH/HDP) to Snowflake or Databricks migrations
- Re-platformHive / Impala workload and migrateHDFS datasets
- Build cloud-native ingestion pipelines ( CDC, API, Reverse ETL )
- Develop production-gradePythondata services
Essential Experience:
ProvenCloudera to Snowflake or Databricks migrationexperience StrongPythonandSpark / PySparkskills Experience modernisinglegacy ETL pipelines Strong knowledge ofdistributed systems Experience withAWS or GCPLisbon (Hybrid) Up to €85,000