T Hub - Data Engineer (Microsoft Fabric)
Summary
Data engineer on MagentaTeam's T Hub, building and maintaining scalable Microsoft Fabric pipelines (Lakehouse, Delta Lake, Notebooks, Medallion Architecture) to ingest and transform global IoT SIM data from Oracle, SAP, CSV, CDC, API, and CMP sources, with data quality checks, monitoring, and CI/CD.
- Build and maintain scalable data pipelines in Microsoft Fabric, including Lakehouse, Pipelines, Notebooks, Delta Lake, and Medallion Architecture, to process global IoT SIM data efficiently and reliably.
- Develop robust ingestion and transformation workflows for Oracle, SAP, CSV, CDC, APIs, and CMP sources, structuring data through Medallion Architecture (Bronze/Silver/Gold) and reusable data models.
- Implement data quality checks, validation rules, monitoring, and automated error handling to ensure trusted datasets for reporting, analytics, and operational use cases.
- Collaborate with architects, product owners, analysts, development, QA, and DevOps teams to industrialize data products, establish CI/CD practices, and support operational run models.
WHAT SKILLS WILL BE APPRECIATED?
Must have:
- Strong hands‑on experience with Microsoft Fabric or comparable Azure data engineering platforms, including Lakehouse patterns, Delta Lake, data pipelines, and notebook‑based transformations.
- Advanced Python, SQL, and PySpark skills for large‑scale data ingestion, transformation, migration, and optimization of IoT SIM, lifecycle, usage, and network telemetry data.
- Experience with Medallion Architecture (Bronze/Silver/Gold), data modeling for analytical workloads, partitioning, performance tuning, and preparation of reliable datasets for downstream consumption.
- Practical experience with data quality frameworks, orchestration, monitoring, Git‑based development, CI/CD, and production‑grade data operations.
Nice‑to‑have
- Hands‑on experience with real‑time or near‑real‑time streaming concepts, such as Apache Kafka, Fabric Eventstream, Event Hubs, or similar technologies.
- Background in Data Governance, Microsoft Purview, CMP integrations, telecommunications data models, secure data engineering patterns, or legacy SAP/Oracle modernization.
- Experience with Power BI semantic models, Direct Lake, self‑service analytics enablement, or controlled access concepts such as Entra ID, OAuth2, Azure Key Vault, Private Endpoints, and Data Gateways.
- Certifications: DP-600, DP-203, or AZ-305.
OUR OFFER FOR YOU
In this role, you will design, implement, and maintain ingestion, transformation, and data quality workflows for SIM lifecycle, usage, network, and partner connectivity data from multiple source systems and regions. You will modernize and transition data pipelines from legacy systems such as Oracle and SAP into Microsoft Fabric, integrate external Connectivity Management Platforms (CMPs), and provide reliable, analytics‑ready datasets for internal teams and partner‑facing use cases. The role is focused on practical data pipeline engineering, automation, monitoring, and operational reliability.
No dress code - you can just be yourself here
Medical, sport and life insurance packages at preferential terms
Access to our products and services at preferential terms
Employment contract-based cooperation
Know Talent - receive training or financial bonus for recommending new employees
WHAT WILL YOUR RECRUITMENT PROCESS BE LIKE?
A fair approach to all people who want to join T Hub means that:
- The recruitment process is transparent;
- Our recruitment decision is based solely on an assessment of your skills (your race, skin color, sexual orientation, gender identity, origin, disability, political view, appearance, or religion will not have any influence on the outcome of the process):
- Regardless of the outcome of the process, you will get detailed feedback.
Let’s meet to better understand each other's expectations.
Our screening meeting will last about 20-30 minutes. We will ask you about our areas of interest and will be happy to field any questions you may have.
Hiring Manager will receive a recommendation for your application.
There's nothing for you to do at this stage — we'll take care of everything. During this time we process all the information we've gathered during the screening process and dig deeper into your CV.
Technical meetings with the Hiring Manager and/or team members.
We will invite you to one or two project meetings to confirm that we have a ‘perfect match'. The meetings may last between 30 minutes and 90 minutes, during which time we will talk to you about mutual expectations and the vision for our collaboration. You will also most likely meet your future supervisor and your teammate during this time.
At this stage, we will have decided that you are the person we want to develop our projects with. We will then come back to you with an offer of collaboration, hoping for your 'yes'. If for some reason, we are unable to offer you a position in our team, you will certainly receive feedback from us explaining our decision.