Data Engineer
Posted Updated
Description
Careerbox is seeking a Data Engineer to design, expand and optimize our data and data pipeline architecture, enabling reliable data delivery for cross-functional teams including software developers, data analysts and data scientists. You will also collaborate with data warehouse managers and business units to map data between source systems and data marts, ensuring consistency across regions.
The role focuses on ETL development using SQL and Azure big data technologies, securing data delivery
Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Build the infrastructure required for optimal extraction, transformation, and loading of data from diverse sources using SQL and Azure big data technologies. Collaborate with stakeholders to assist with data-related technical issues and support data infrastructure needs. Create data tools for analytics and data science teams. Map data between source systems, data warehouses, and data marts. Design and execute reporting systems for processes. Research and implement technologies to ensure the data warehouse operates optimally. 3 years of experience writing queries, extracting data, data scrubbing, and managing large volumes of records. Experience with Relational and/or NoSQL databases is essential. Experience with ETL processes is essential. A qualification in Data Informatics or at least 3 years of relevant experience in large data environments. Experience managing a team of analysts and demonstrable technical expertise in writing complex database queries.Skills
Sign in to read and join the discussion.