Data Engineer
Posted Updated
Description
Sago is seeking a Data Engineer to design, build, and maintain reliable data pipelines and analytics datasets. The role emphasizes SQL, Python/PySpark, and cloud data platforms to ensure data quality, performance, and production stability.
Responsibilities include ETL/ELT development, ingestion from databases and APIs, and delivering analytics-ready datasets for BI tools like Power BI and Superset. Strong problem solving and collaboration with BI teams are essential.
Design, develop, and maintain scalable ETL/ELT pipelines for batch and scheduled data processing. Build and optimize data transformations using SQL, Python, and PySpark. Ingest and integrate data from databases, APIs, files, SharePoint, and cloud storage. Create and maintain analytics-ready datasets for Power BI, Superset, and other reporting tools. Implement data-quality checks, monitoring, logs, and failure alerts. Troubleshoot pipeline failures, schema changes, and performance bottlenecks. Optimize large-scale data processing for runtime, memory, and cost. Automate recurring workflows with orchestration tools like Apache Airflow. Maintain data mappings, business rules, and runbooks. Collaborate with BI analysts and stakeholders to deliver dependable data solutions. 2–5 years of professional experience in data engineering, ETL development, or a similar role. Strong SQL skills, including joins, CTEs, window functions, data validation, and query optimization. Hands-on experience with Python and/or PySpark for data processing and automation. Practical experience building and supporting ETL/ELT pipelines in production. Experience with large datasets, incremental loads, upserts, and partitioned data. 5 Days working Remote Job Medical InsuranceSkills
Sign in to read and join the discussion.