Data Engineer
Posted Updated
Description
Job Description:
- Design, build, and maintain batch and real-time data pipelines that ingest, process, and deliver enterprise data.
- Develop ETL/ELT processes to extract, transform, and load large datasets into data warehouses and data lakes.
- Review solution requirements and architecture to select appropriate data technologies and integration approaches.
- Ensure processed data is clean, accurate, reliable, and ready for reporting, analytics, and downstream use cases.
- Implement data quality checks, validation rules, lineage, and monitoring across data pipelines.
- Write and optimize complex SQL queries and tune data platform performance.
- Apply data security, access control, masking, and governance practices in line with the Bank's policies.
- Collaborate with data analysts, data scientists, solution architects, and business stakeholders to deliver data requirements.
- Support production data operations, troubleshooting, incident resolution, and root-cause analysis.
- Prepare data mapping documents, data dictionaries, technical documentation, and other required SDLC artifacts.
Requirements
Qualifications:
- 3–5 years of professional experience in data engineering or a related field.
- Bachelor’s degree in computer science, Engineering, Mathematics, Statistics, or a related field.
- Experience with data modeling, ETL/ELT design, and data warehousing concepts.
- Strong SQL skills and experience with relational and NoSQL databases (e.g., Oracle, PostgreSQL, MySQL, MongoDB).
- Experience with big data and streaming technologies such as Apache Spark, Hadoop, Kafka, or Flink.
- Proficiency in Python, Scala, or Java, plus shell scripting.
- Experience with cloud data platforms such as AWS Redshift, Azure Synapse, Google BigQuery, Snowflake, or Databricks.
- Familiarity with workflow orchestration tools such as Apache Airflow, and version control with Git.
- Exposure to BI tools such as Power BI or Tableau is an advantage.
- Strong problem-solving, debugging, communication, and collaboration skills.
Skills
- Airflow
- Analytics
- AWS
- Azure
- Azure Synapse
- Bash
- Big Data
- BigQuery
- Cloud
- Data Engineering
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- ELT
- ETL
- Flink
- Git
- Hadoop
- Java
- Kafka
- MongoDB
- MySQL
- NoSQL
- Oracle
- PostgreSQL
- Power BI
- Python
- Redshift
- Root Cause Analysis
- Scala
- SDLC
- Snowflake
- Spark
- SQL
- Statistics
- Tableau
- Version Control
- Workflow Orchestration
Sign in to read and join the discussion.