Data Engineer
Summary
Quantori is hiring a Data Engineer for a Life Science project to build end-to-end data pipelines and cloud data solutions. Day to day: organizing and analyzing structured and unstructured data and designing pipelines on Azure using Databricks, Spark, Airflow, Python, SQL, and Scala. Fully remote; the team works in Central European Time.
Descripción del trabajo
Las cualificaciones, habilidades y toda la experiencia relevante necesaria para este puesto se pueden encontrar en la descripción completa a continuación.
At Quantori we are seeking a Data Engineer for an ongoing Life Science project to be engaged in building data pipelines and leveraging cloud technologies.
The team works in the Central European Time.
Responsibilities:
- Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
- Building data systems and pipelines
- Preparing data for prescriptive and predictive modeling
- Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native Azure, Databricks, Spark, Scala, sbt, Airflow, Python, SQL, etc.
- Leveraging Azure Cloud services for building data pipelines and ensuring effective monitoring
What we expect:
- 3+ years of relevant experience in the Data Engineering field
- Expertise in Spark
- Expertise in Databricks
- Experience in working with Azure Cloud
- Strong SQL skills
- Experience with building Data lakes, Data warehouses, and ETL solutions
- Understanding of data structures, data modeling, and software architecture
- Analytic and problem solving skills
Nice to have:
- Expertise with Snowflake and xqbhyrx related technologies (e.g. dbt)
- Ability to write robust code with Scala
- Proficiency with public clouds (AWS, GCP, Azure)
We offer:
- Competitive compensation
- Fully remote work
- Flexible working hours
- Continuous education, mentoring, and professional development programs
- A team with an excellent tech expertise