Senior Data Software Engineer

We're on the lookout for a Senior Data Software Engineer to come aboard our team. This position is a great match for someone who takes pleasure in architecting durable data solutions that power important business choices. You'll collaborate closely with a group that prioritizes clean, thoroughly tested code and disciplined engineering approaches. For anyone energized by tackling large-scale data problems, this role provides ample opportunity for both growth and meaningful contribution

Responsibilities

• Architect and construct scalable data pipelines that enable dependable data flow across multiple platforms
• Build and sustain data ingestion workflows pulling from a range of different source systems
• Produce clean, high-performing, thoroughly tested code grounded in solid software engineering principles
• Partner with teams across different functions to understand data needs and shape them into working technical solutions
• Keep watch over data pipeline performance, stepping in ahead of time to resolve issues and preserve system dependability
• Join in on code review sessions to help maintain quality benchmarks and spread knowledge throughout the team
• Diagnose and fix data quality problems, safeguarding accuracy and consistency across all datasets
• Help drive continuous enhancement of data architecture practices and engineering standards
• Create documentation covering technical workflows and solutions to aid knowledge sharing and new team member onboarding
• Operate within an agile framework, taking part in sprint planning sessions and other recurring team activities

Requirements

• At least 3 years of relevant hands-on professional background
• Solid practical expertise with PySpark and Spark SQL for constructing and processing large-scale data workflows
• Background building and overseeing Lakeflow pipelines and Jobs to support data orchestration
• Skilled in using Auto Loader along with JDBC/CDC ingestion approaches, working with sources like DB2 and SQL Server
• Strong background with Delta Lake and Unity Catalog for handling data storage and governance needs
• Experience maintaining data quality standards and performing source reconciliation to ensure dependable, accurate datasets
• Background writing unit tests through pytest to confirm code correctness and reliability
• Familiarity with Git and Asset Bundles for managing version control and deployment workflows
• Upper-intermediate English language skills or higher (B2)

Nice to have

• Background working on DataStage migration initiatives
• Experience extracting data from Dynamics 365/Dataverse
• Holding a Databricks certification

Benefits

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn