Data Engineer (ASAP)
Summary
A Data Engineer who designs, builds, and maintains scalable data pipelines and ETL/ELT processes, integrating data from databases, APIs, and files into warehouses, data lakes, and lakehouses. Core tech includes SQL, Python (or Java/Scala), and at least one major cloud platform (AWS, Azure, or GCP), with a focus on data quality, performance, and governance.
About the role
This is a Data Engineering role focused on designing, developing, and maintaining scalable data pipelines and ETL/ELT processes. You will work with data from multiple structured and unstructured sources, develop and optimize data models, data warehouses, data lakes, and lakehouse solutions, and ensure data solutions comply with established security, privacy, governance, and compliance standards.
Key responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Extract, transform, validate, and load data from multiple structured and unstructured sources
- Develop and optimize data models, data warehouses, data lakes, and/or lakehouse solutions
- Write efficient SQL queries and develop data processing solutions using Python or other programming languages
- Integrate data from databases, APIs, applications, files, and other enterprise data sources
- Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and scalabilityi>
- Implement data quality checks, validation, reconciliation, and monitoring processes
- Ensure data solutions comply with established security, privacy, governance, and compliance standards
- Collaborate with Data Analysts, Data Scientists, Software Engineers, Architects, and business stakeholders to understand requirements and deliver data solutions
- Maintain technical documentation covering data flows, pipelines, data models, and processes
About you
- Bachelor's degree in Computer Science, Information Technology, Engineering, Data Analytics, or a related field
- 3+ years of experience in Data Engineering, Data Warehousing, ETL, or related roles
- Strong proficiency in SQL
- Hands-on experience with Python, Java, Scala, or similar programming languages
- Strong experience in developing ETL/ELT pipelines and data integration solutions
- Experience with data modeling and data warehouse concepts
- Experience working with at least one major cloud platform such as AWS, Azure, or GCP
- Familiarity with databases such as SQL Server, PostgreSQL, Oracle, MySQL, or similar technologies
- Strong analytical, troubleshooting, and problem-solving skills
- Good communication and collaboration skills