data engineer in AI-first data infrastructure

Описание

Vention is a global engineering partner to tech leaders and fast-growing startups, combining product development expertise with an AI-first approach. It helps startups and enterprises turn data into smart decisions and better user experiences by building scalable data pipelines and infrastructure.

Задачи

• Build, optimize, and maintain scalable ETL/ELT pipelines using cloud platforms
• Integrate and manage diverse data sources, ensuring data quality, reliability, and accessibility for analytics and ML use cases
• Design and maintain cloud-native data architectures, including Data Lake, Data Warehouse, and Data Lakehouse
• Develop data processing solutions using Spark and PySpark in distributed environments
• Collaborate with cross-functional teams to translate business requirements into efficient, scalable data solutions
• Support analytics use cases by enabling data consumption for reporting, dashboards, and visualization tools
• Stay up to date with modern data platform technologies and best practices, contributing to continuous improvement of the data ecosystem

Требования

• 4+ Years of experience in Data Engineering, delivering end-to-end data solutions
• Strong hands-on experience with Python and SQL
• Solid expertise with Apache Spark and PySpark for distributed data processing
• Hands-on experience with AWS, including Glue, S3, Athena, and QuickSight, or Azure, including Data Factory, Databricks, and ADLS
• Good understanding of modern data architectures, including Data Lake, Delta Lake, and Data Warehouse
• Experience working in an Agile environment, such as Scrum or Kanban
• English B2+, comfortable communicating with English-speaking customers

Условия

• Salary from 10000 PLN gross
• EDU corporate community with tech communities, interest clubs, events, an R&D lab, a knowledge base, and a dedicated AI track
• Licenses for AI tools, including GitHub Copilot and Cursor
• Private medical care with LuxMed
• Kafeteria MyBenefit credits for stores, restaurants, and cafés
• Access to a Multisport membership
• Glasses reimbursement program
• Referral bonuses