Data Engineer
Posted Updated
Description
Urbano DX is seeking a Data Engineer to design and implement scalable data solutions in a Cyber Data Analytics context. You will build complex pipelines, ensure data quality, and collaborate with product owners to translate requirements into technical tasks.
The role emphasizes secure, reliable data processing and end-to-end analytics delivery. You will work with Snowflake, Python, Power BI, and AWS services, contributing to high-impact analytics for decision-making within an agile team
Design and build scalable data solutions, including data processing pipelines, migrations, and complex data modeling. Perform data analysis to assure data quality in terms of accuracy, consistency and completeness and to identify gaps and anomalies. Collaborate with product owners and business partners to translate high-level requirements into actionable technical tasks. Analyze and manipulate datasets to ensure rigorous data integrity, accessibility, and security throughout the entire lifecycle. Integrate automated testing and continuous validation into the sprint cycle to ensure production reliability. Develop end-to-end solutions using distributed platform design patterns and modern analytics technologies. Support and enhance production systems, focusing on high performance, speed, and overall system reliability. Identify new development opportunities within a scalable public Cloud environment to enhance organizational capability. Bachelor's or Master's degree in computer science, engineering, or a related technical field. 2-5 years of relevant work experience in data engineering and data analysis. Strong SQL skills and knowledge of multiple RDBMS, specifically Snowflake (including SnowSQL), Postgres, SQL Server and Oracle. Proven data analysis skills to ensure data quality such as accuracy, consistency and completeness and to identify gaps and anomalies. Proven experience building data pipelines using Python, with NiFi and dbt knowledge being a significant advantage. Experience in building Power BI Reports that transform data into aesthetically appealing visuals. Hands-on knowledge of AWS infrastructure, including S3, EC2, RDS, EKS, Batch, and CloudFormation. Good understanding of data modeling principles, specifically 3NF and Star Schema models. Experience with CI/CD workflows using Jenkins and GitHub for automated deployment. Familiarity with workload scheduling and orchestration tools like Control-M. Ability to work independently in an Agile environment (Scrum and Kanban) brings technical stories to completion. Excellent communication and presentation skills.Skills
Sign in to read and join the discussion.