Senior Data Engineer

Senior Data Engineer

Experience Level: 8 to 16 Years • Work location: Doha, Qatar

Required Skills

• Bachelor’s degree in Computer Science or similar field or equivalent work experience.
• 8+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.
• Expert with data warehousing concepts, strategies, and tools.
• Strong SQL background.
• Strong knowledge of relational databases like SQL Server, PostgreSQL, MySQL.
• Strong experience in GCP & Google BigQuery, Cloud SQL, Composer (Airflow), Dataflow, Dataproc, Cloud Function and GCS.
• Good to have knowledge on SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS).
• Knowledge of AWS and Azure Cloud is a plus.
• Experience in Informatica Power exchange for Mainframe, Salesforce, and other new-age data sources.
• Experience in integration using APIs, XML, JSONs etc.
• In-depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework, data-warehousing and Data Lakes.
• Good understanding of SDLC, Agile and Scrum processes.
• Strong problem-solving, multi-tasking, and organizational skills.
• Highly proficient in working with large volumes of business data and strong understanding of database design and implementation.
• Good written and verbal communication skills.
• Demonstrated experience of leading a team spread across multiple locations.

Role & Responsibilities

• Work with business users and other stakeholders to understand business processes.
• Ability to design and implement Dimensional and Fact tables.
• Identify and implement data transformation/cleansing requirements.
• Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse.
• Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions.
• Design, develop and maintain ETL workflows and mappings using the appropriate data load technique.
• Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.
• Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.
• Analyze and resolve problems and provide technical assistance as necessary.
• Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.
• Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
• Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.
• Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.
• Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.
• Train business end-users, IT analysts, and developers.