Senior Data Engineer
Posted Updated
Description
NorthBay Solutions LLC is seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms and cloud-based analytics solutions on Microsoft Azure.
The role requires 6–10 years of data engineering experience, strong Azure Data Services expertise, and hands-on development of ETL/ELT pipelines. Onsite in Abu Dhabi, UAE, with a focus on enterprise data platforms and AI/ML readiness.
Design, develop, and maintain scalable data platforms and pipelines on Azure. Build batch and real-time data ingestion for various data sources. Create data lake, data warehouse, and lakehouse solutions for analytics. Develop and optimize ETL/ELT pipelines using cloud-native practices. Implement data transformation, cleansing, and quality checks. Collaborate with stakeholders and analytics teams to translate requirements. Optimize storage, processing, and query performance across platforms. Enforce data security, governance, and metadata management. Bachelor's degree in computer science, information technology, or related field. 6–10 years of professional data engineering experience. Strong hands-on experience with Microsoft Azure Data Services. Experience with Azure Data Factory, Synapse, ADLS Gen2, and Azure SQL Database. Designing, developing, and maintaining large-scale ETL/ELT pipelines. Proficiency in SQL and query performance tuning. Hands-on PySpark and distributed processing. Strong Python programming; Scala/Java a plus. Knowledge of data warehousing, lakehouse architectures, and data governance.Skills
Sign in to read and join the discussion.