Enterprise Data Product - Data Engineer
Summary
Build and maintain a global datalake and high-performance data pipelines using Python, Spark, Databricks, Azure Data Factory, and SQL to ensure reliable, high-quality data processing and analytics.
MUNKAVÉGZÉS HELYE
7622 Pécs, Bajcsy-Zsilinszky utca 33.
TEVÉKENYSÉGI TERÜLET
IT
MUNKAVÉGZÉS KEZDETE
Megegyezés szerint
FOGLALKOZTATÁS MÉRTÉKE
Teljes munkaidő
megállapodás szerint
.profile_item { list-style-type: none !important; } .profile_heading { font-weight: bold; } .profile_content { padding-bottom: 0.5rem; } .profile_section:has(.profile_item:empty) { display: none; }
My responsibilities:
Maintain, develop, and optimize the global datalake environment, ensuring high data quality, reliability, and overall performance
Design and implement high-performance data processing pipelines and workflows utilizing Python, Spark , and Databricks
Manage scalable and efficient data integration and processing solutions using Azure Data Factory, Databricks, and Event Hub
Establish robust data management processes and execute advanced data querying and quality control with SQL and big data technologies
Automate operational tasks and support infrastructure maintenance by leveraging shell scripting and foundational UNIX knowledge
Support data modeling initiatives for coherent structure design and document all technical processes to ensure operational continuity
The knowledge I own:
Strong bac