Data engineer
Summary
Abra's professional services team is hiring a Data Engineer to ingest and analyze large data volumes and design large-scale data pipelines across cloud and on-premises environments for AI projects, in close collaboration with data scientists. Core stack: Python, Spark, orchestration tools like Airflow/Kubeflow, and Docker/Kubernetes.
abra professional services is seeking a talented Data Engineer!
We are looking for a Data Engineer to join our team and work on cutting-edge AI projects.
In this role, you will be responsible for ingesting large volumes of new data, as well as deeply understanding and analyzing it in close collaboration with our Data Scientists. You will design and develop critical, diverse, and large-scale data pipelines across both Cloud and On-Premises environments.
Requirements
- Education: B.Sc. in Computer Science, Engineering, Mathematics, or Statistics – Must.
- Experience: 3+ years of hands-on experience as a Data Engineer – Must.
- Programming: 3+ years of experience with Python and Object-Oriented Programming (OOP) – Must.
- Big Data: Proven practical experience with Spark for large-scale data processing – Must.
- Deep understanding of designing, developing, and optimizing complex high-volume data systems.
- Familiarity with data formats and optimization/partitioning techniques (Parquet, Avro, HDF5, Delta Lake).
- Solid conceptual and practical understanding of Docker, Linux, CI/CD tools, and Kubernetes.
- Experience with data pipeline orchestration tools such as Airflow or Kubeflow.
- Understanding of core Machine Learning concepts and workflows.
