Data Engineer
Summary
Builds scalable data pipelines and enterprise AI solutions: developing AI agents (Azure Agent Foundry, OpenAI, LangChain, N8N), RAG systems with vector databases, and ETL/ELT workflows, mostly on Azure Databricks, while maintaining APIs, data quality, and MLOps/CI-CD processes.
Job Description:
Inception42, a G42 company, is the region’s leading innovator of AI-powered domain-specific as well as industry-agnostic products, built on a rich heritage of research and development. Within the G42 ecosystem, Inception42 functions as the core intelligence layer – transforming data and compute infrastructure into real-world, applied AI solutions. Beyond its commercial endeavors, Inception42 is committed to creating positive societal impact. For more information, please visit www.inception42.ai
Overview:
Abu Dhabi
Inception42, a G42 company, is the region’s leading innovator of AI-powered domain-specific as well as industry-agnostic products, built on a rich heritage of research and development. Within the G42 ecosystem, Inception42 functions as the core intelligence layer – transforming data and compute infrastructure into real-world, applied AI solutions. Beyond its commercial endeavors, Inception42 is committed to creating positive societal impact. For more information, please visit www.inceptionai.ai
Overview
We are looking for a Data Engineer who can build scalable data pipelines while also developing intelligent AI solutions using Azure Agent Foundry, OpenAI services, LangChain, Databricks, and modern cloud architectures. The ideal candidate has strong data engineering foundations combined with hands‑on experience designing and deploying enterprise‑grade AI systems.
Responsibilities:
What You’ll Own
- Develop and deploy AI agents using Azure Agent Foundry, OpenAI, LangChain, and N8N.
- BuildRAG pipelines, embeddings, vector database integrations, and knowledge graph solutions.
- Design and maintain scalabledata pipelines,ETL/ELTworkflows, and data architectures.
- Build and maintainAPIs and data services supporting AI and analytics workloads.Optimize ML workflows on AzureDatabricksand integrate with Azure Fabric.
- Ensure data quality, reliability, governance, and compliance across all systems.
- Collaborate with data scientists, ML engineers, and product teams to deliver intelligent features.
- SupportMLOpsandDevOpsprocesses including CI/CD, model lifecycle management, and containerized deployments.
Qualifications:
What We’re Looking For
- Bachelor’s in Computer Science, Engineering, Data Science, or related field.
- 3+ years experience in Data Engineering, AI Engineering, or ML Engineering roles.
- Experience delivering scalable AI/data solutions in cloud environments (Azure preferred).
- Strong proficiency in Python, SQL, PySpark, and ML/AI frameworks.
- Experience with Azure Agent Foundry, OpenAI APIs, LLMOps, RAG systems, and vector databases.
- Hands‑on experience with Azure Databricks, Azure cloud services, and data platforms.Knowledge of big data tools (Spark, Hadoop, Flink) and modern data storage (SQL, NoSQL).
- Experience with REST/GraphQL APIs, Kafka/RabbitMQ, Docker/Kubernetes.
- Solid understanding of data modeling, ETL, and data quality best practices.Strong problem-solving, communication, and cross-functional collaboration skills.
Why Inception42
Inception42 is building AI systems designed for practical deployment at scale — across industries, infrastructure, and national‑level initiatives.
What We Look For
If you are a performance‑driven, inquisitive mind with the agility to adapt to ambiguity, you will fit right in. You should be eager to explore opportunities to build meaningful collaborations with stakeholders and aspire to create unique customer‑centric solutions. Bias for action and a passion to conquer new frontiers in the AI space is at the heart of the Inception42 community.
What Working At Inception42Offers
- Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground‑breaking, industry‑first innovations.
- Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high‑tech projects.
- Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.