Data Engineer
Workplace: remote
Workload: Full-time
Type of Contract: B2B
Key Responsibilities
-
Development of a data platform based on Databricks and Apache Spark, including ensuring performance and tuning computing environments.
-
Design, implementation, and optimization of scalable ETL/ELT data pipelines.
-
Automation and orchestration of complex enterprise data processing and flow processes.
-
Implementation of solutions in accordance with internal CI/CD standards, version control, and Infrastructure as Code practices.
-
Collaboration with architecture and security teams to ensure compliance with security regulations and data governance.
Required Skills and Experience
-
At least 4 years of experience in data engineering, supported by projects carried out in complex corporate environments.
-
Expert knowledge of the Databricks platform and Apache Spark, including practical experience with query optimization and cloud cost management.
-
Proficiency in designing data integration processes (ETL/ELT) from distributed and complex source systems.
-
Advanced knowledge of SQL and relational and non-relational databases, enabling efficient tuning of complex data operations.
-
Practical understanding of enterprise realities, including issues related to data security, auditability, and modern access control systems (e.g., Unity Catalog).
What do we offer?
- Benefits package (private health insurance, sports card, group insurance).
- Free English lessons with a dedicated teacher.
- Access to an extensive training library covering both soft and technical skills.
- Sports activities.
- Team-building events, contests, and challenges.
Who we are – in a nutshell:
Industry: We operate in the IT sector.
Clients: We support international companies in regulated industries (banking, finance, insurance, pharmaceuticals).
Services: We provide comprehensive quality control and implement modern HR platforms for employee management.
How do we work? See what our employees say Piotr i Julia