Databricks Engineer
- Build ELT workflows
- Design data pipelines with Databricks
- Develop ETL workflows
- Develop PySpark applications
- Document technical solutions
- Ensure data quality security governance compliance
- Implement CI/CD pipelines
- Implement Delta Lake transformations
- Implement medallion architecture
- Integrate data from multiple sources
- Monitor troubleshoot optimize production pipelines
- Optimize Spark jobs performance
- Process batch data
- Process streaming data
- Write Spark SQL queries