Senior Data Engineer
Summary
Designs and builds scalable data pipelines, ETL/ELT workflows, and APIs on Databricks using Python, Scala, SQL, and PySpark to ensure reliable, high-quality data delivery.
- Build data models and ETL/ELT processes
- Develop APIs and data services
- Develop end to end data pipelines on Databricks
- Ensure data quality, integrity, and security
- Implement data governance, security, and compliance
- Implement data ingestion, transformation, and processing workflows
- Integrate data sources and systems
- Monitor troubleshoot and optimize pipeline performance
- Write modular and well documented code in Python Scala SQL and PySpark