Data Engineer
Summary
Build and optimize data pipelines and search systems using Python, Spark, and Azure/Databricks to power AI-driven discovery workflows for a global team.
- Ideally 5+ years of relevant experience as data engineer in Big Data.
- strong experience in executing complex data analysis and running complex SQL queries.
- knowledge of programming languages (Python / Scala, Spark, SQL) and Big Data technologies (Azure Cloud, Databricks, PowerBi or equivalent) is advantageous.
- Good understanding and experience with Agile methodologies and delivery.
- strong communication skills with the ability to build partnerships with stakeholders.
- strong analytical, data management and problem-solving skills.
- flexible and resilient team player with strong interpersonal skills taking initiative to drive things forward.
- keen interest in understanding business context for the data.
- excellent written and verbal communication skills and ability to work as part of a global team.
- fluent in English
- Ideally 5+ years of experience as a Data Engineer, including exposure to large scale or Big Data environments
- strong experience with SQL and database systems (relational and NoSQL), including query optimization and schema design
- hands on experience with search platforms or information retrieval technologies (indexing, ranking, text search, semantic search, metadata modeling, vector search, relevance tuning, etc.)
- knowledge of Graph Databases (e.g., Neo4j, Cosmos DB Gremlin API) and their application to knowledge graphs or entity relationship search
- strong programming skills in Python, Scala, Spark, and experience with Big Data tools such as Azure Cloud, Databricks, and PowerBI (or equivalents)
- experience designing or maintaining search APIs, indexing pipelines, or metadata driven search components
- good understanding of Agile methodologies and experience delivering incrementally within an Agile team
- strong communication and stakeholder management skills, with the ability to translate search related needs into technical solutions
- solid analytical, problem solving, and data management abilities
- proactive team player with flexibility, resilience, and the initiative to drive improvements across search and data discovery workflows
- strong interest in understanding business context to create meaningful and effective data search experiences
- fluent in English with excellent written and verbal communication skills, and the ability to work as part of a global team