Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

NorthBay Solutions LLC

Lead Data Engineer (AWS Data Platform)

Posted Updated

Description

NorthBay Solutions in Pakistan is seeking a Lead Data Engineer to design, develop, and optimize large-scale data platforms and ETL/ELT pipelines using PySpark, AWS Glue, EMR, and Redshift.

You will work with UAE-based stakeholders, align with UAE working hours, and collaborate across distributed teams while ensuring data quality, governance, and performance. Requires 5–8+ years of experience, a Bachelor's degree, strong SQL, and data warehousing knowledge.

Design, develop, and maintain scalable data pipelines using PySpark, AWS Glue, and Amazon EMR. Build and optimize data ingestion, transformation, and processing frameworks for structured and semi-structured data. Develop and maintain enterprise data warehouse solutions using Amazon Redshift. Write complex SQL queries, stored procedures, and data transformations to support analytics and reporting requirements. Implement ETL/ELT processes to move data efficiently across multiple systems and platforms. Perform performance tuning and optimization of Spark jobs, ETL pipelines, SQL queries, and Redshift workloads. Ensure data quality, integrity, security, and governance across data platforms. Troubleshoot production issues and perform root cause analysis for data-related incidents. Collaborate with business stakeholders, analysts, architects, and engineering teams to understand data requirements. Participate in code reviews, technical design discussions, and best‑practice implementation. Monitor data pipelines and proactively identify opportunities for performance improvements and automation. Create and maintain technical documentation, data models, and operational procedures. 5 to 8+ years of experience in Data Engineering and Data Warehousing. Strong hands-on experience with PySpark. Extensive experience with AWS Glue. Experience building and managing workloads on Amazon EMR. Strong expertise in Amazon Redshift. Excellent SQL development and query optimization skills. Strong understanding of Data Warehousing concepts, dimensional modeling, and ETL/ELT processes. Experience in performance tuning of Spark jobs, SQL queries, ETL pipelines, and data warehouse workloads. Experience handling large-scale datasets and distributed data processing. Strong debugging, troubleshooting, and analytical skills.

Skills

What Lead Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →