Senior / Data Engineer
Description
Job Description
-
Data Understanding:
- Gain a thorough understanding of multiple source systems and how data elements map to business operations and processes.
-
Data Integration:
- Assume responsibility for data integration of structured and unstructured data volumes into a reporting and BI data platform.
- Design, plan, and implement data pipelines based on industry best practices.
- Design, implement, and improve ETL processes.
-
Data Management:
- Apply appropriate policies, security, and privacy rules to data.
- Achieve and maintain data quality metrics through continuous improvement.
-
Dataset Creation:
- Create, design, and maintain reusable datasets for analysis by business analysts.
- Build effective SQL queries and stored procedures to answer questions from stakeholders.
-
Issue Resolution:
- Identify and resolve data, mapping, and visualization issues across IT and business teams.
-
Source Code Management:
- Maintain a source code repository of scripts (SQL, Python, APIs integration scripts, RPA reports).
-
Automation:
- Automate data flows and create and maintain reports and dashboards.
-
Product Evaluation:
- Participate in the evaluation of off-the-shelf products and recommend the most suitable data integration tools.
-
User Collaboration:
- Work directly with end users to understand data requirements and testing needs.
- Interpret business needs from requests and rapidly implement effective technical solutions.
-
Vendor Coordination:
- Work closely with vendors where external products are deployed.
Job Requirements
-
Education:
- Degree in Computer Science, Software Engineering, or equivalent.
-
Database Skills:
- Strong RDBMS design, SQL programming, and ETL experience required.
- Proficiency in Microsoft SQL Server, SQL Server Integration Services (SSIS, SSRS), and Excel is a must.
- Experience with other database sources and BI products is an advantage.
-
Data Management:
- Experience in data retrieval and cleansing using scripting languages, REST and SOAP APIs, and RPA products (e.g., UiPath, Power Automate).
-
Microsoft Power Platform:
- Proficient in Microsoft Power Platform suite (Power Apps, Power Automate, Power BI, Power Virtual Agent).
- Competent in process and workflow design and implementation, including designing operating models.
-
Data Visualization:
- Experience in developing data visualizations, reports, and dashboards using Power BI or similar tools.
-
Programming Skills:
- Experience in programming and developing business applications using modern platforms like Microsoft .NET or any open-source systems is an advantage.
-
Communication and Skills:
- Excellent oral and written communication skills.
- Strong planning and project management abilities.
- Effective networking and influencing skills.