Junior ETL Developer / Data Engineer
Posted 12
views
Summary
Junior data engineer who designs, builds, and maintains Python-based ETL/ELT pipelines: extracting data from third-party REST APIs (handling auth, pagination, rate limits, JSON), transforming it, and loading it into data warehouses. Core stack is Python, SQL, and relational databases; 0-1 year experience expected.
Role Overview: Design, build, and maintain scalable ETL/ELT pipelines, with a strong focus on Python-based REST API data ingestion, transformation, and loading into data warehouses.
Key Responsibilities
- API Ingestion: Develop Python-based REST ETL scripts to extract data from third-party APIs, handling authentication, pagination, rate limits, and JSON parsing.
- Pipeline Development: Build and optimize robust data pipelines (Extract, Transform, Load).
- Data Manipulation: Write and tune SQL queries and Python scripts for data cleaning and transformation.
- Data Quality: Ensure data integrity and pipeline reliability with basic monitoring and error handling.
- Collaboration: Work with data analysts and teams to deliver required data assets.
Core Requirements
- Experience: 0–1 year in data engineering, Python development, or ETL/data workflows.
- Python & APIs: Strong Python skills, including working with REST APIs, the requests library, and JSON data structures.
- SQL & Databases: Fundamental to intermediate SQL skills and relational database experience.
- ETL & Tools: Familiarity with modern data tools, scripting, and basic data pipelining concepts.