Data Engineer
Description
Role & responsibilities
- Design, develop, maintain, and optimize ETL/ELT pipelines using Informatica PowerCenter, IICS, and IDMC.
- Develop and optimize SQL and PL/SQL queries, stored procedures, and data processing workflows using Oracle and Microsoft SQL Server.
- Build and maintain data warehouse solutions using Snowflake.
- Develop cloud-based data solutions using AWS services, including EC2, S3, IAM, Lambda, and EFS.
- Develop Python-based data processing solutions using Pandas, DataFrames, and NumPy.
- Manage source code and version control using GitHub repositories.
- Leverage AI-assisted development technologies, including LLMs, RAG, embeddings, AI agents, and prompt engineering.
- Ensure data quality, performance, reliability, and maintainability across data pipelines.
- Collaborate with cross-functional teams to deliver effective data engineering solutions.
Required Technical Skills
- ETL/ELT: Informatica PowerCenter , IICS , IDMC.
- Databases: SQL , PL/SQL , Oracle ,Microsoft SQL Server.
- Cloud Data Warehouse: Snowflake.
- AWS: EC2, S3, IAM, Lambda, EFS.
- Programming: Python, Pandas, DataFrames, NumPy.
- Version Control: GitHub.
- AI-Assisted Development: LLMs, RAG, embeddings, agents, prompt engineering.