Job Title: Data Engineer â Databricks & Data Integrations
Posted Updated
Description
Required Skills & Qualifications
Technical Skills
- Strong hands-on experience with Databricks and Apache Spark.
- Proficiency in Python and SQL.
- Proven experience in data mapping, transformation, and data modeling.
- Experience integrating data from APIs, databases, and cloud storage.
- Solid understanding of ETL/ELT concepts and data warehousing principles.
Key Responsibilities
Data Source Identification & Quality Assessment
Data Mapping & Integration
- Define and maintain comprehensive data mapping between source systems and Databricks tables.
- Design and implement scalable ETL/ELT pipelines using Databricks and Apache Spark.
Databricks & Data Modeling
- Develop and optimize Databricks workloads using Spark and Delta Lake.
- Design efficient data models optimized for performance, analytics, and API consumption.
Skills
Sign in to read and join the discussion.