Databricks Architect
Posted Updated
Description
Job Summary:
- Overall 10 + Years of experience and 3+ years of experience Developing, deploying data solutions using AWS/Azure Data Bricks in PySpark
- Responsible for developing, capturing, and sharing solution architecture patterns, and best-practices knowledge that can be applied across domains.
- Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.
- Work with global Data Standards, structures, and processes to maintain global guidelines
- Experience with AWS Ecosystem and AWS S3
- Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.
- Hands-on expert with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions
- Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc
- Demonstrated strength in data management, orchestration, access control, etc.
- A proven expert in writing optimized SQL to deal with large data volumes
- Desirable to have knowledge on SAP ECC
Key Responsibilities:
- Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.
- Work with global Data Standards, structures, and processes to maintain global guidelines
- Experience with AWS Ecosystem and AWS S3
- Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.
- Hands-on expert with real-time data processing and analytics, data ingestion (batched and
- streamed), and data storage solutions
- Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc
- Demonstrated strength in data management, orchestration, access control, etc.
Required Skills:
- Databricks
Preferred Qualifications:
- the required qualification is primarily a combination of Databricks data engineering, SQL, Python, Azure data services, and foundational architecture skills
Skills
Sign in to read and join the discussion.