Data & AI Engineer
Summary
Build scalable data pipelines and production AI/ML solutions in Portugal using Python, Spark, SQL and Databricks, with a strong Generative AI focus — LLMs, RAG architectures, vector databases and prompt engineering — collaborating with data scientists and business stakeholders.
About the Role
We are looking for a highly skilled Data & AI Engineer to join an innovative team focused on building next-generation AI and Data solutions. The ideal candidate combines strong software engineering skills with hands-on experience in Machine Learning, Generative AI, and modern Data Platforms.
You will design, develop, and deploy scalable data pipelines and AI solutions while working closely with Data Scientists, AI Engineers, and business stakeholders.
Key Responsibilities
- Design and develop scalable data pipelines using Python, Spark, and SQL.
- Build and maintain AI/ML models for production environments.
- Develop and optimize Generative AI and LLM-based solutions.
- Implement RAG architectures, vector databases, and prompt engineering best practices.
- Work with Databricks to build and manage modern data platforms.
- Process and transform large-scale datasets using Spark.
- Deploy AI and ML workloads in cloud environments.
- Collaborate with multidisciplinary teams to deliver innovative data-driven products.
- Monitor, maintain, and improve performance of AI applications.
Mandatory Requirements
Strong experience with Python (3+ years)
Experience with Machine Learning and AI projects
Experience working with Large Language Models (LLMs) and Generative AI
Strong knowledge of SQL
Experience with Databricks
Strong experience with Apache Spark / PySpark
Understanding of data engineering concepts and ETL/ELT processes
Experience with Git and software engineering best practices
Fluent English (minimum B2 level)
Nice to Have
- Knowledge of LangChain, LlamaIndex, Semantic Kernel or similar frameworks
- Experience with MLOps tools and CI/CD pipelines
- Docker and Kubernetes knowledge
- Azure, AWS or GCP certifications
We've got you covered!