Senior Data Engineer: Lakehouse Architect & Pipelines
Posted Updated 9
views
Description
JOBSTER PRIVATE LTD. seeks a seasoned Data Engineer to design and deliver maintainable batch and streaming data pipelines on AWS and Databricks.
You will build bronze-to-gold data models, enforce data quality and governance, and optimise performance and cost across large-scale datasets. You will lead data integration from databases, files and APIs, implement CD/CI and IaC, and craft reliable monitoring, dashboards and runbooks to ensure data freshness and downstream reliability for business
Lead the design and implementation of maintainable batch and streaming pipelines in AWS and Databricks. Design Bronze, Silver and Gold data layers using Delta Lake patterns. Implement reliable ingestion from databases, files, APIs and event streams. Establish schema enforcement, data contracts and automated validation. Degree in Computer Science, Software Engineering, Data Engineering, Information Systems or a related technical discipline.Skills
Sign in to read and join the discussion.