Data Engineer
- Role Overview:
- Hands-on experience with Azure Services: Databricks, Data Factory and DevOps
- Proficient in Python, Apache Spark, and PySpark
- Write advance and complex SQL queries with solid experience in database management
- Develop and maintain data models, data warehouses, and data marts in Snowflake
- Automation, build re-usable transformations, performance tuning
- Streamline ETL complexity- logics and transformations
- Collaborate with data scientists, analysts, and stakeholders to gather requirements and define data models that effectively support business requirements
- Demonstrate decision-making, analytical and problem-solving abilities
- Strong verbal and written communication skills to manage client discussions
- Familiar with working on Agile methodologies - daily scrum, sprint planning, backlog refinement
- Role Overview:
- Hands-on experience with Azure Services: Databricks, Data Factory and DevOps
- Proficient in Python, Apache Spark, and PySpark
- Write advance and complex SQL queries with solid experience in database management
- Develop and maintain data models, data warehouses, and data marts in Snowflake
- Automation, build re-usable transformations, performance tuning
- Streamline ETL complexity- logics and transformations
- Collaborate with data scientists, analysts, and stakeholders to gather requirements and define data models that effectively support business requirements
- Demonstrate decision-making, analytical and problem-solving abilities
- Strong verbal and written communication skills to manage client discussions
- Familiar with working on Agile methodologies - daily scrum, sprint planning, backlog refinement
Skillsets:
- 5-8 years of relevant DE experience
- Azure Databricks– ability to create data transformation logics
- Strong programming skills in Python and experience with SQL.
- Should be able to write complex SQL, Transact SQL, Stored Procedures
- ETL tool – Azure data factory, Data Bricks
- Experience with Data Modelling
- Excellent communication skills and stakeholder management
- Ability to work independently in IC role
- Good to have
- Knowledge on Snowflake platform
- Knowledge on PowerBI
- Familiarity with CI/CD practices and version control (e.g., Git)
- Familiarity with Azure DevOps