Lead Data Engineer (AWS+Snowflake)

Summary

The Lead Data Engineer will design and maintain robust data structures and secure data pipelines using AWS and Snowflake for a major U.S. consumer insights provider. The role involves leading a team, ensuring data governance and security, and leveraging Python and SQL to manage large-scale data environments.

Hi there! If you’re seeking a high-impact role within an ambitious and fast-growing software house, you might have just found your perfect match!

We are seeking a highly skilled and experienced Lead Data Engineer to join our team. You will be working with one of the biggest consumer insights providers in the U.S.

In this role, you will be responsible for designing, implementing, and maintaining robust data structures and controls for privacy features and services, enabling secure multi-party collaboration. You will ensure compliance with data governance standards, implement strong data security measures, and leverage your expertise in SQL and Python to manage large data volumes. This position requires a deep understanding of various data technologies, cloud environments, data clean rooms, and AI concepts.


Working hours: Availability between 5:00 PM and 9:30 PM CET is essential during onboarding; afterwards, standard hours end around 5/6/7 PM CET (depending on the day).
      • Ability to work partially within the U.S. time zone (during onboarding: calls up to 9:30 PM CET 3x a week; later: up to 6/7:00 PM CET.)
      • Team Lead experience (or leadership potential and readiness) to lead the team and serve as the primary client contact
    • 6 + years of experience as a Data Engineer/Data Scientist
    • Proficiency in SQL, Python, AWS (Lambda, Airflow, Redshift)
    • Solid knowledge of the Snowflake ecosystem (knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures)

    Nice to have:
    • Working experience of AI concepts such as Generative AI chatbots, Cortex Analyst, agent training, various LLMs, and prompt engineering
    • Working knowledge of Databricks
    • Expertise in building and maintaining APIs; Swagger/OpenAPI spec, Node, and Next.js

    See also

    Data Engineering jobs by country — openings, pay and top skills →

    Tailor your CV for this role?

    We couldn't check your fit for this role — add a CV to your profile to see it next time.

    A new version of freehire is available