Senior Python & PySpark Data Engineer
Summary
Senior data engineer working on ETL development and large-scale data processing. Day to day involves building data pipelines with Python, PySpark, Databricks and Apache Spark, using Oracle/SQL, Unix/Linux shell scripting, and AutoSys scheduling. Based in Cracow, Poland.
We are looking for an experienced Senior Python & PySpark Data Engineer to join our team and work on data engineering, ETL development and large-scale data processing initiatives.
The ideal candidate will have strong hands-on experience in Python, PySpark, Databricks and Apache Spark, along with a solid understanding of enterprise data platforms and ETL processes.
Key Skills & Experience Required:
- 10+ years of overall IT experience.
- Strong hands-on development experience with Python and PySpark.
- Extensive experience with Databricks and Apache Spark.
- Good experience in designing and developing ETL processes and data pipelines.
- Strong knowledge of Oracle databases and SQL.
- Experience with Unix/Linux environments and Shell scripting.
- Hands-on experience with AutoSys scheduling.
- Previous development experience with Java or C#.
- Strong analytical, troubleshooting and problem-solving skills.
Skills
Sign in to read and join the discussion.