Data Engineer: ETL Pipelines, Delta Lake, Python/SQL
Posted Updated
Success IT Consultancy & Services Pte Ltd Data Engineer: ETL Pipelines, Delta Lake, Python/SQL
Description
IT Consultancy & Services Pte Ltd is seeking a Data Engineer to design and maintain ETL pipelines for centralized data storage. You will integrate data from various sources, develop transformation routines, and apply data processing techniques to manage complex datasets.
Responsibilities include contributing to coding frameworks and implementing data governance aligned with company standards. 2+ years of experience in data pipelines and relevant tech stack are expected.
Develop and maintain ETL pipelines for centralized data storage systems. Integrate data from databases, APIs, log files, streaming platforms, and external providers. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex or inconsistent datasets. Contribute to frameworks and best practices for code development and deployment. Implement data governance in alignment with company standards. Degree in computer science, data analytics, statistics, or relevant field. At least 2 years of experience in building and optimising data pipelines, architectures, and data sets. Experience in Delta Lake, Python, SQL.Skills
Sign in to read and join the discussion.