Data Analytics Engineer (AI Projects)
Summary
Build and optimize Azure-based data pipelines and AI retrieval systems using Python, Databricks, and Azure Search to power AI/ML applications and RAG workflows.
Overview
We are looking for a highly skilled Data Analytics Engineer to join our upcoming AI-driven projects. The role involves building robust data pipelines, optimizing AI-driven retrieval processes, and leveraging Azure cloud services to enable cutting-edge analytics and AI solutions. The ideal candidate will bring expertise in Python, Databricks, and Azure, with proven experience as a Data Engineer.
Responsibilities
- Design, build, and maintain data pipelines to ensure efficient ingestion and processing of data into Azure Search Index.
- Guarantee data quality, consistency, and integrity throughout the ingestion process.
- Tune parameters within indexes to optimize Retrieval-Augmented Generation (RAG) and rank-based evaluation.
- Enhance accuracy, efficiency, and performance of AI and machine learning models.
- Leverage Azure Document Intelligence Services to extract relevant data from various structured and unstructured document formats.
- Enable deeper insights and improved decision-making through enriched data processing.
- Collaborate with the OpenAI API to integrate advanced AI features into business solutions.
- Support the development and deployment of scalable AI/ML applications on Azure.
- Work in a multicultural, multilingual team environment with tight deadlines.
- Operate autonomously while ensuring alignment of solutions through team discussions.
- Identify and propose innovative solutions when faced with technical challenges.
- Data Analytics & Insights – ability to design, build, and optimize data flows in cloud environments.
- Strong hands-on expertise with Python and Databricks for large-scale data manipulation and analysis.
- Proven track record as a Data Engineer, including data architecture design and implementation.
- Deep knowledge of Azure cloud services – data storage, compute, and AI/ML integrations.
- Experience with Azure Search, ADF, and Document Intelligence Services.
- CI/CD and DevOps awareness in data engineering projects.
- Strong communication skills to work effectively in international teams.
Preferred / Nice-to-Have Skills
- Experience working with AI and ML pipelines, including RAG optimization.
- Familiarity with API integration (OpenAI or similar).
- Exposure to multilingual datasets and cross-border data solutions.
Qualifications
- Bachelor’s/Master’s degree in Computer Science, Data Engineering, or related field.
- 10+ years of experience in data engineering and analytics roles.
- Proven ability to deliver enterprise-scale cloud-based data solutions.
Additional Details
- Seniority level: Mid-Senior level
- Employment type: Contract
- Job function: Information Technology
- Industries: IT Services and IT Consulting
Referrals increase your chances of interviewing at Gazelle Global. Get notified about new Data Engineer jobs in Amsterdam, North Holland, Netherlands.