Data Engineer
Posted Updated
Description
- Detailed reviewing and analyzing structured, semi-structured and
unstructured data sources for quality, completeness and business value.
- Design, architect, implement and test rapid prototypes that demonstrate value
of the data and present them to diverse audiences.
- Participate in early state design and feature definition activities.
- Responsible
for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible
for creating reusable and scalable data pipelines
- You
are a Team-Player, collaborating with team members across multiple engineering
teams to support the integration of proven prototypes into core intelligence
products.
Requirements
- Advanced
working knowledge and experience with relational and non-relational databases
- Experience
building and optimizing Azure Data data pipelines, architectures and data sets
- Strong
analytic skills related to working with unstructured datasets
- Strong
experience in Azure Data factory, Databricks, Eventhub, Python, PySpark , Azure
Synapse and SQL, Azure DevOps
- Azure
DevOps experience to deploy the ADF pipelines.
- Create
end to end Azure databricks
- Minimum
4-6 years of experience
- Bachelor’s
degree
- Knowledge/Experience
with Azure cloud stack.
- Azure
Data Platform & Databricks exp should be more than 4 years