Data Engineer - Python, Spark & ETL Pipelines
Summary
Designs and builds scalable ETL/ELT pipelines and data models using Python, Spark, and Kafka to support data architecture and governance in a federated environment.
WLG seeks a highly skilled Data Engineer to drive evolution of data architecture and platforms. You will design models, ontologies, and scalable ETL/ELT pipelines using Python, Spark and Kafka, ensuring semantic interoperability and robust governance.
You will work on federated data sharing contexts, applying data quality frameworks, metadata management, and platform integration to enable secure information access across complex environments.