Data Engineer
Posted 51
views
Summary
Data Engineer at Datamatics (Bengaluru/Mumbai) who designs, builds and maintains scalable data pipelines and transformations on Databricks, Delta Lake and PySpark, using SQL/Spark SQL to support both batch and operational data processing with solid software engineering practices.
- Design, develop and maintain scalable, reliable data pipelines using Databricks, Delta Lake and PySpark.
- Build efficient and optimised data transformation processes using SQL and Spark SQL.
- Develop robust data solutions that support both batch and operational data processing requirements.
- Apply software engineering best practices to data engineering delivery, including reusable code, testing and automation.