Lead Data Engineer (AWSSnowflake)

Lead Data Engineer (AWS+Snowflake)

Miejsce pracy: Warszawa

Technologies we use

Expected

• SQL
• Python
• AWS
• Lambda
• Airflow
• Redshift

Optional

• Swagger
• OpenAPI
• Node.js
• Next.js

Operating system

• macOS

About the project

Hi there! If you're seeking a high-impact role within an ambitious and fast-growing software house, you might have just found your perfect match!

We are seeking a highly skilled and experienced Lead Data Engineer to join our team. You will be working with one of the biggest consumer insights providers in the U.S.

In this role, you will be responsible for designing, implementing, and maintaining robust data structures and controls for privacy features and services, enabling secure multi-party collaboration. You will ensure compliance with data governance standards, implement strong data security measures, and leverage your expertise in SQL and Python to manage large data volumes. This position requires a deep understanding of various data technologies, cloud environments, data clean rooms, and AI concepts.

Working hours: Availability between 5:00 PM and 9:30 PM CET is essential during onboarding; afterwards, standard hours end around 5/6/7 PM CET (depending on the day).

This is how we organize our work

This is how we work

• at the client's site
• you focus on a single project at a time
• you can change the project
• you focus on product development
• agile

Team members

• backend developer
• frontend developer
• fullstack developer
• technical leader
• data scientist

Your responsibilities

• Working with a wide range of AWS services to integrate and deploy cloud components
• Building data pipelines for processing financial data delivered directly to Redshift
• Designing and maintaining scalable data pipelines
• Assessing downstream impacts on processing flows
• Performing root cause analysis and implementing preventive measures
• Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
• Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
• Set technical priorities for the team and provide support in resolving complex incidents
• Collaborate with the client's technical leads to streamline processes and optimize overall work efficiency
• Report work progress, milestones, and updates directly to the client-side manager

Our requirements

• Ability to work partially within the U.S. time zone (during onboarding: calls up to 9:30 PM CET 3x a week; later: up to 6/7:00 PM CET.)
• Team Lead experience (or leadership potential and readiness) to lead the team and serve as the primary client contact
• 6 + years of experience as a Data Engineer/Data Scientist
• Proficiency in SQL, Python, AWS (Lambda, Airflow, Redshift)
• Solid knowledge of the Snowflake ecosystem (knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures)

Optional

• Working experience of AI concepts such as Generative AI chatbots, Cortex Analyst, agent training, various LLMs, and prompt engineering
• Working knowledge of Databricks
• Expertise in building and maintaining APIs; Swagger/OpenAPI spec, Node, and Next.js

What we offer

• Private medical care
• Multisport card
• Friendly, informal atmosphere, and direct contact with everyone in the company
• Modern technologies

This is how we work on a project

• Continuous Deployment
• Continuous Integration
• DevOps

Benefits

• sharing the costs of sports activities
• private medical care
• remote work opportunities
• flexible working time
• extra social benefits
• baby layette
• school layette
• employee referral program
• charity initiatives
• Gift vouchers for kids (birthdays, Christmas, Child's Day)

Recruitment stages

• HR call (max 15 min.)
• Technical interview with the Acaisoft team (max 45 min.)
• Call with our Client (+/- 60 min.)

ACAISOFT POLAND Sp. z o.o.

Acaisoft is a Polish company partnering with industry leaders across healthcare, telecom, fintech, and insurance. We specialize in delivering cloud-native, data-driven, and scalable solutions for enterprises operating in fast-moving environments. We currently serve around 30 active customers worldwide, mostly based in the U.S. We specialize mainly in:

* Data Engineering & AI

* Cloud-Native Solutions, including Cost Optimization

* Platform Engineering

Since technology is constantly being developed at such a fast pace, we always strive to be one step ahead of the market and keep up with the latest solutions.