Data Engineer L3
Summary
Designs and builds data storage solutions, pipelines, and transformations using Databricks, Azure, SQL, and Python to support analytics and reporting.
- Designs and builds data storage solutions including database objects and data structures, data ingestion pipelines
- Develops data transformation, cleansing, and preparation processes.
- Perform job optimization/automation via code enhancement, configuration, or implementation of new tools/technology
- Perform unit testing and system integration testing.
- Maintain and monitor platform stability and performance of EDP. Execute updates, patches, and other activities required to maintain and enhance operations.
- Ensures compliance with governance standards of the platform, security policies, and SDLC processes.
- Collaborate with cross-functional teams to identify data needs and opportunities for improvement
- Develop and maintain documentation related to data engineering and analytics processes and procedures
- Perform Proof of Concept on new integration and analytic patterns and solutions
- Contribute to best practices and standards for the data engineering team Must-Have Skills & Experience
- Experience on Data projects is a MUST (at least 1 end to end project)
- Experience in using Databricks and Azure (certifications preferred)
- Experience in SQL, Python (Pyspark)
- Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques
- Preferably local resource that can report to BDO office Nice-To-Have Skills & Experience