Senior Data Engineer
Summary
Designs, builds, and maintains scalable data pipelines and models on Databricks, integrating diverse sources and ensuring data quality, governance, and security for analytics and reporting.
- Build and maintain data models and ETL ELT processes
- Develop and deploy end to end data pipelines on Databricks
- Develop and maintain APIs and data services for analytics and reporting
- Ensure data governance and compliance adherence
- Ensure data quality integrity and security across data lifecycle
- Implement data ingestion, transformation, and processing workflows
- Integrate data from multiple data sources and systems
- Integrate data including APIs relational and non relational databases and IoT data
- Monitor troubleshoot and optimize pipeline performance in cloud
- Write clean modular well documented data engineering code