(Senior) Lead Data Engineer

Skills and Expertise

When it comes to working with diverse data sources, proficiency in tools like Airbyte and Fivetran is a must. An expert in large-scale data processing, particularly with Spark or Dask, is highly desired. Strong programming skills in Python, Scala, C#, or Java, along with experience in cloud SDKs and APIs, are key requirements for this role.

In addition to these technical skills, AI/ML expertise plays a crucial role in optimizing pipelines. Familiarity with frameworks such as TensorFlow, PyTorch, and AutoML, as well as programming languages like Python and R, is essential for enhancing pipeline efficiency and effectiveness.