Principal Data Engineer - Scalable Pipelines & Data Lakes
Posted Updated
Description
Pakistan Single Window (PSW) is seeking a Principal Data Engineer to design, build, and maintain scalable data pipelines that feed PSW services. You will work across data ingestion, transformation, and storage, enabling analytics and machine learning on large data sets.
You will collaborate with data scientists and engineers to define data requirements, ensure data quality, and optimize performance across data lakes, warehouses, and databases in a cloud environment.
Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources. Implement real-time data streaming and batch processing solutions to support diverse business needs. Build and optimize data storage solutions, including data lakes, data warehouses, and databases. Ensure data systems and pipelines are scalable, secure, and performant. Clean, transform, and prepare raw data into usable formats for analytics and machine learning. Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions. Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary. Troubleshoot and resolve data-related issues, ensuring minimal downtime. 7 to 8 years of experience as a Data Engineer or in a similar role. Hands-on experience with big data tools, cloud platforms, and data integration. Expertise in SQL and working with relational and NoSQL databases. Proficiency in Python, Java, or Scala. Familiarity with data processing frameworks.Skills
Sign in to read and join the discussion.