Senior Data Engineer
Summary
Builds and optimizes data pipelines and warehouses using AWS services, Teradata, and PySpark for a telecom-focused enterprise platform.
Overview
Skills- AWS Cloud, Amazon Redshift, Teradata, DBT, Telecom Industry
Experience Level- 6+years to 10 years
Responsibilities
Required Skills & Experience:-
- 8 to 10 year’s experience as a Data Engineer
- Advanced SQL skills
- Hands on experience working with Teradata and Siebel CRM data sets
- Experience delivering data pipelines in a large scale enterprise data platform environment
- Strong hands on AWS experience with common data services such as : Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR
- Strong programming capability in Python and strong data transformation experience using PySpark (preferred) and/or Spark.
- Advanced SQL skills (query optimisation, complex joins, window functions, performance tuning)
- Experience with workflow orchestration tools such as Airflow
- Solid understanding of data warehousing concepts (dimensional modelling, partitioning, incremental loads, CDC concepts).
- Experience implementing monitoring, logging, alerting, and operational support processes.
- Strong communication skills and ability to work with stakeholders to translate requirements into data deliverables
- Telco Industry Experience is highly desirable