Senior Engineer Data
Data Engineer
Role Summary
Key Responsibilities
Required Qualifications
- Design, build, and manage scalable data processing pipelines on theGoogle Cloud Platform.
- Drive engineering excellence, data quality, and continuous improvement.
- Lead end-to-end design, development, and deployment of scalable data pipelines and integration solutions.
- Manage multiple delivery workstreams.
- Translate complex business and technical requirements into robust data engineering solutions.
- Develop and optimize ETL/ELT processes using modern cloud, data warehousing, and data processing platforms.
- Collaborate with technical and business teams to translate complex requirements into robust data solutions.
- Diagnose and resolve complex production issues through root-cause analysis and system optimization.
- Drive technology and process improvements by evaluating emerging tools and engineering best practices.
- Ensure adherence to enterprise architecture, security, compliance, and performance standards.
- Maintain high-quality technical documentation, user guides, and solution specifications.
Experience:
- Experience in Data modelling, Data engineering, Data integration.
- Experience leading engineering initiatives.
- Proven experience with cloud tools such asGCP Dataflow, GCP Composer (Airflow), GCP cloud storage.
- Strong expertise in cloud platforms:GCP
Hands-on experience with data warehousing and processing technologies including:
Nice to Have
- BigQuery, Lakehouse (Iceberg)
- Spark
- Python, SQL
- Experience with data streaming tools:Kafka, Cloud Data Flow, Spark Streaming.
- Strong experience in data quality and observability platforms to automate quality coverage using iceDQ, Monte Carlo, or similar tools.
- Strong proficiency with high-level programming and query languages.
- Experience collaborating with distributed teams across time zone.
- Experience withPower BI/ThoughtSpot,AI in data engineering,Stonebranch,CI/CD,DatabricksandDevOpspractices.
- Familiarity with enterprise databases such asDB2, SQL Server, Oracle, PostgreSQL.
- Google Cloud Data Engineer certification is preferred.
- Experience in Retail domain (Customer, Stores, eCommerce, Marketing, Supply chain, Merchandising)