Data Engineer
Posted Updated
Description
<p></p><p class="MsoNormal"></p><p> </p>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">About the Role</span></b></p><p><b></b></p><b></b>
<p class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">We are looking for a motivated and detail-oriented
Data Engineer with 3–4 years of experience in data engineering and analytics
solutions. The ideal candidate should have hands-on experience with Microsoft
Fabric, strong PySpark skills, and a foundational understanding of Databricks.
The candidate should be eager to learn, adaptable to new technologies, and
passionate about building scalable data solutions.</span></p><p></p>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Key Responsibilities</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Design,
develop, and maintain data pipelines using Microsoft Fabric. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Build
and optimize ETL/ELT processes for ingesting, transforming, and loading
data from multiple sources. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Develop
and maintain data transformation workflows using PySpark. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Work
with Lakehouse, Data Warehouse, and Data Factory components within
Microsoft Fabric. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Collaborate
with business stakeholders, analysts, and data teams to understand data
requirements. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Ensure
data quality, consistency, and reliability across data platforms. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Monitor
and troubleshoot data pipeline performance and resolve issues proactively.
</span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Support
data modeling and reporting requirements for analytics and business
intelligence initiatives. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Participate
in code reviews, testing, and deployment activities. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Stay
updated with emerging technologies and best practices in data engineering.
</span><p></p></li>
</ul>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Required Skills</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">3–4
years of experience in Data Engineering or related roles. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Hands-on
experience with Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse,
Notebooks, etc.). </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Strong
proficiency in PySpark for data processing and transformation. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Good
understanding of ETL/ELT concepts and data pipeline development. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Experience
working with SQL and relational databases. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Basic
understanding of Databricks and Spark ecosystem. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Familiarity
with data lakes and modern cloud-based data architectures. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Knowledge
of data quality, performance tuning, and optimization techniques. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Experience
with version control tools such as Git. </span><p></p></li>
</ul>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Preferred Skills</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Exposure
to Azure Data Services. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Understanding
of Delta Lake concepts. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Experience
with Power BI integration and reporting. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Knowledge
of CI/CD practices for data engineering projects. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Familiarity
with Agile/Scrum methodologies. </span><p></p></li>
</ul>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Educational Qualifications</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Bachelor's
degree in Computer Science, Information Technology, Engineering, or a
related field. </span><p></p></li>
</ul>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Desired Candidate Profile</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Strong
analytical and problem-solving skills. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Eagerness
to learn and work on new technologies. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Good
communication and stakeholder management skills. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Self-motivated,
proactive, and a strong team player. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Ability
to work in a fast-paced and collaborative environment. </span><p></p></li>
</ul>
<p class="MsoNormal"><b><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Nice to Have</span></b></p><p><b></b></p><b></b>
<ul style="margin-top:0in;" type="disc">
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Microsoft
Fabric certifications. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Exposure
to cloud platforms such as Microsoft Azure. </span><p></p></li>
<li class="MsoNormal"><span lang="en-in" style="font-size:11pt;font-family:Calibri, sans-serif;" xml:lang="en-in">Basic
experience with Databricks notebooks and workflows.</span><p></p></li>
</ul>
<p class="MsoNormal"></p><p> </p>
Skills
- Agile
- Analytics
- Azure
- Azure Data Factory
- Business Intelligence
- CI/CD
- Cloud
- Data Engineering
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- Databricks
- Delta Lake
- ELT
- ETL
- Git
- Lakehouse
- Microsoft Fabric
- Power BI
- PySpark
- RDBMS
- Scrum
- Spark
- SQL
- Stakeholder Management
- Version Control
- XML
