Senior Data Engineer (Databricks)
Posted
Description
SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.
Responsibilities:
- Design, construct, and support enterprise-grade data pipelines using Databricks, PySpark, and SQL.
- Build and govern robust dimensional data models, ETL/ELT workflows, and high-performance reporting datasets.
- Profile, tune, and optimize pipeline performance, resource utilization, and overall data quality across the platform.
- Partner with risk analysts, business stakeholders, and software developers to translate business logic into scalable data solutions.
- Contribute to cloud data architecture, CI/CD automation, pipeline monitoring, and data governance standards.
- Mentor junior and mid-level data engineers while championing clean engineering standards and automated testing.
Skills:
- Strong hands‑on engineering experience with Databricks and PySpark.
- Advanced SQL and deep expertise in enterprise data warehousing and modeling.
- Working experience with cloud data ecosystems, specifically Azure Data Lake (ADLS) and Azure Data Factory (ADF) or equivalent cloud tooling.
- Proven track record implementing ETL/ELT pipelines and executing performance tuning on large-scale datasets.
- Experience collaborating within Agile/Scrum cross‑functional delivery teams.
- Background in Financial Services, Risk Management, Regulatory reporting, or ESG technology.
- Proficiency with general‑purpose Python scripting, cloud DevOps/CI/CD practices, and cloud‑native patterns.
- Experience building or integrating datasets for Power BI reporting and visualization.
Follow us on Linkedin: https://www.linkedin.com/company/snisourcing/posts/?feedView=all
PLDA2693
Skills
Sign in to read and join the discussion.