Data Engineer - AWS
Description
Job Summary
We are looking for a Data Engineering Developer who will be responsible for designing, building, and maintaining scalable data pipelines and data platforms. The ideal candidate should have hands-on experience with large datasets, ETL processes, cloud platforms, and modern data engineering tools.
Key Responsibilities
- Design, develop, and optimize ETL data pipelines
- Build and maintain data warehouses and data lakes
- Work with structured and unstructured data
- Ensure data quality, reliability, and performance
- Collaborate with data scientists, analysts, and product teams
- Optimize SQL queries and data models
- Implement data security and governance best practices
- Monitor and troubleshoot data pipeline failures
- Automate data processing workflows
Required Skills & Qualifications
Technical Skills
- Strong experience in AWS, SQL and data modeling, Data Bricks
- Proficiency in Python / Py Spark, Snowflake
- Hands-on experience with ETL tools (Airflow, Informatica, Talend, SSIS, etc.)
- Experience with Data Warehouses: Snowflake, Redshift, Big Query, Azure Synapse
- Knowledge of Big Data tools: Hadoop, Spark
- Experience with Cloud platforms (AWS)
- Familiarity with REST APIs & data ingestion frameworks
- Understanding of CI/CD pipelines for data workflows
Databases
- Relational: MySQL, PostgreSQL, SQL Server, Oracle
- NoSQL: MongoDB, Cassandra, DynamoDB (Good to have)
Good to Have
- Experience with Kafka / streaming platforms
- Knowledge of dbt
- Experience with real-time data processing
- Exposure to machine learning data pipelines
- Working knowledge of data governance & data privacy
Skills
- Airflow
- API
- AWS
- Azure
- Azure Synapse
- Big Data
- Cassandra
- CI/CD
- Cloud
- Data Engineering
- Data Governance
- Data Ingestion
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- dbt
- DynamoDB
- ETL
- Hadoop
- Kafka
- Machine Learning
- MongoDB
- MySQL
- NoSQL
- Oracle
- PostgreSQL
- Python
- Redshift
- REST
- Snowflake
- Spark
- SQL
- SQL Server
- SSIS
- Talend