Data Engineer
Posted Updated
Description
Dencom Consultancy & Manpower Services is seeking a Senior Data Engineer to design, build, and maintain scalable Azure-based data pipelines and products. You will collaborate with data scientists, analysts, and architects to deliver robust data solutions for analytics initiatives and data architecture.
You will optimize pipelines for performance, ensure data quality, and document processes while contributing to CI/CD deployment practices and staying aligned with industry trends.
Design, develop, and maintain ETL processes and data pipelines using Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric. Organize and manage data pipeline outputs using Azure Data Lake Storage Gen2 and Azure Blob Storage. Collaborate with data scientists, analysts, and architects to understand requirements and deliver robust data solutions. Optimize pipelines for performance, scalability, and reliability. Ensure data quality and integrity through validation and monitoring. Document data processes, configurations, and best practices. Manage CI/CD deployment processes for data solutions and troubleshoot pipeline issues. Stay updated on industry trends and emerging data technologies. Bachelors degree in Computer Science, Engineering, or related field (or equivalent experience). 7+ years of experience as a Data Engineer or in similar data/ETL roles. Strong expertise in Microsoft Azure services (Data Factory, Synapse, Databricks, Blob Storage, Data Lake Gen2). Proficient in SQL and working with modern RDBMS (SQL Server, PostgreSQL). Solid understanding of software engineering principles applied to data engineering (CI/CD, version control, testing). Experience with big data technologies (Spark). Excellent problem-solving, communication, and collaboration skills.Skills
Sign in to read and join the discussion.