Data Engineer Databricks
Posted Updated
- Provides assessment and estimation of effort needed based on the provided Business request form.
- Develops and delivers automated data pipelines (Extract, Transform, Load-ETL) jobs in the Data Lake within expected timelines.
- Coordinates with various support groups to accomplish assigned automated data pipes for development
- Prepares deployment package for endorsement to Release Testing Team which includes Solutions Design Document and Operations Guide.
- Provides support during the stabilization phase of pipes endorsed to production until declared BAUeview and approves builds based on the set framework, standards, and best practices.
- Documents source code.
- Other job-related activities that may be assigned from time to time.
- Skilled in Python (atleast 4/5 rating), SQL (atleast 3/5 rating)
- Working or has experience working on modern data cloud platforms ( Databricks/Snowflake)
- With exposure to cloud services (preferably Azure or AWS)
- Must have strong SQL & PL/SQL skills with the ability to solve highly complex challenges
- Must have good communication and interpersonal skills for interacting and collaborating with developers, analysts, and business staff throughout the organization.
- Must have the ability to communicate clearly in writing to document data requirements and translate them into technical solutions.
- Must be adept to work in a fast-paced environment with tight SLAs.