Senior Data Engineer (Python / Apache Spark / Azure)
Summary
Builds and optimizes data pipelines using Python, Apache Spark, and Azure tools to process and transform large datasets efficiently.
Nasze wymagania
- 5+ years of hands-on experience in software development
- Extensive experience working with Apache Spark, including platforms such as Databricks and/or Azure Synapse/Fabric
- Proficient in Python, with strong skills in data manipulation using Pandas/Polars and similar
- Solid understanding of columnar data storage formats, particularly Parquet, with practical experience using Delta Tables
- Proven expertise in data processing, analysis, and transformation workflows
- Strong analytical and