Data Engineer
Summary
Data Engineer for a Life Science project building data pipelines and leveraging cloud technologies, working with Azure, Databricks, Spark, Scala, sbt, Airflow, Python, and SQL.
At Quantori we are seeking a Data Engineer for an ongoing Life Science project to be engaged in building data pipelines and leveraging cloud technologies.
Sea uno de los primeros solicitantes, lea la descripción completa del puesto a continuación y luego envíe su candidatura para que sea considerada.
The team works in the Central European Time.
Responsibilities:
Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
Building data systems and pipelines
Preparing data for prescriptive and predictive modeling
Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native Azure, Databricks, Spark, Scala, sbt, Airflow, Python, SQL, etc.
Leveraging Azure Cloud services for building data pipelines and ensuring effective monitoring
What we expect:
3+ years of relevant experience in the Data Engineering field
Expertise in Spark
Expertise in Databricks
Experience in working with Azure Cloud
Strong SQL skills
Experience with building Data lakes, Data warehouses, and ETL solutions
Understanding of data structures, data modeling, and software architecture
Analytic and problem solving skills
Nice to have:
Expertise with Snowflake and related technologies (e.g. dbt) xqbhyrx
Ability to write robust code with Scala
Proficiency with public clouds (AWS, GCP, Azure)
We offer:
Competitive compensation
Fully remote work
Flexible working hours
Continuous education, mentoring, and professional development programs
A team with an excellent tech expertise
Hay opciones de teletrabajo/trabajo desde casa disponibles para este puesto.
Sea uno de los primeros solicitantes, lea la descripción completa del puesto a continuación y luego envíe su candidatura para que sea considerada.
The team works in the Central European Time.
Responsibilities:
Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
Building data systems and pipelines
Preparing data for prescriptive and predictive modeling
Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native Azure, Databricks, Spark, Scala, sbt, Airflow, Python, SQL, etc.
Leveraging Azure Cloud services for building data pipelines and ensuring effective monitoring
What we expect:
3+ years of relevant experience in the Data Engineering field
Expertise in Spark
Expertise in Databricks
Experience in working with Azure Cloud
Strong SQL skills
Experience with building Data lakes, Data warehouses, and ETL solutions
Understanding of data structures, data modeling, and software architecture
Analytic and problem solving skills
Nice to have:
Expertise with Snowflake and related technologies (e.g. dbt) xqbhyrx
Ability to write robust code with Scala
Proficiency with public clouds (AWS, GCP, Azure)
We offer:
Competitive compensation
Fully remote work
Flexible working hours
Continuous education, mentoring, and professional development programs
A team with an excellent tech expertise
Hay opciones de teletrabajo/trabajo desde casa disponibles para este puesto.