Data Engineer (Data Bricks)
Summary
Senior Data Engineer builds and maintains scalable ETL/ELT pipelines on Azure Data Factory and Databricks, optimizing for cost, speed, and data quality.
Role Summary
We are seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using cloud technologies and ETL tools.
Key Responsibilities
- Architect and implement high-performance ETL/ELT pipelines on Azure data Factory.
- Optimize data workflows for cost, speed, and scalability.
- Ensure data quality, lineage, and security across systems.
- Establish CI/CD, monitoring, and documentation standards for data engineering.
Required Qualifications
- 5+ years in data engineering, with 2+ years in a senior role.
- Deep experience with cloud data services (e.g., Redshift, BigQuery, Snowflake, Synapse, Databricks must have).
- Proficiency with ETL tools (e.g., dbt, Airflow, Glue, Talend, Fivetran).any one.
- Strong SQL and Python/Scala.
- Proven application of best practices: code reviews, version control (Git), data testing, partitioning, and incremental loads.
- Experience with streaming (Kafka, Kinesis).