Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

QiBit

New

Data engineer in customer lake

Posted 44 views

Summary

Data engineer building and optimizing batch/streaming ingestion pipelines and PySpark transformations on Azure Databricks for a customer data lake, with governance via Unity Catalog. Permanent role at QiBit (Gi Group), hybrid with 3 office days per week in Lisbon, starting at €50,000 gross per year.

Описание:

QiBit Portugal (Gi Group Holding) supports the recruitment of specialized talent in IT and Digital for transformation projects at leading clients. We are looking for a Data Engineer to join a team focused on building and evolving a data platform on Azure Databricks, with a direct impact on the quality, governance, and scalability of pipelines.

Задачи:

  • Develop and optimize data ingestion pipelines (batch and/or streaming, depending on the context), focusing on reliability and performance
  • Implement data transformations and processing in PySpark on Azure Databricks
  • Contribute to implementing and maintaining governance and permissions through Unity Catalog
  • Support the operationalization of applications and components in the Databricks Apps ecosystem, aligning deliverables with business needs
  • Work closely with technical stakeholders (Data, Cloud, and Analytics) to translate requirements into scalable solutions
  • Ensure good practices for the quality, observability, and documentation of pipelines and datasets in a Customer Lake context

Требования:

  • Experience as a Data Engineer in cloud data environments
  • Hands‑on experience with Azure Databricks and development in PySpark
  • Experience in Data Ingestion (ETL/ELT) and building reusable pipelines
  • Knowledge of governance, catalogs, and access control, ideally with Unity Catalog
  • Strong collaboration and communication skills in a multidisciplinary team context
  • Будет плюсом: Experience with Databricks Apps; Exposure to AI/serving components in the Databricks ecosystem, including Unity AI Gateway; Experience designing/organizing a data lake / customer lake and applying good practices for data modeling and quality

Условия:

  • A project focused on modern data engineering and good governance practices in Databricks
  • Prospects for continuity and technical growth in a results-oriented team
  • Development and learning opportunities in a cloud and data platform context
  • Permanent contract, hybrid working arrangement with 3 days per week in the office in Lisbon
  • Transparent salary conditions Under Directive (EU) 2023/970, the starting base salary for this role is €50,000 gross per year

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →