Lead Data Quality Engineer
Posted Updated
We are looking for a Lead Data Quality Engineer to drive the data quality testing strategy across our products, collaborating with cross-functional teams to ensure data reliability, governance, and performance meet the highest standards.
Responsibilities
- Work with product, engineering and customer teams to understand requirements and implement a quality testing strategy, defining and setting up data quality metrics
- Design and implement a quality verification strategy for data products and ensure that all areas of the business perform according to the defined standards
- Define priorities, risks and attributes in the data quality testing strategy, as well as choose proper data tools
- Control and tune the data governance processes, including data preparation, generation, data obfuscation, data integration, data slicing and data quality control
- Prepare data quality environments and applications in compliance with the standards
- Design, monitor and maintain QA reports, KPIs and quality trends
- Collaborate with all teams involved in data solution development to ensure efficient task execution for achieving results
- Adhere to and promote quality standards
Requirements
- 5+ years of hands-on engineering experience and practice in Data Management, Data Quality verification/Data Governance and Data Integration
- Understanding of data pipelines, data lakes and ETL testing
- Experience in CI/CD principles and best practices in data processing
- Knowledge of SQL
- Proficiency in Python or other scripting languages
- Experience with one of the major cloud providers: AWS, Azure or GCP
- Experience in building up a test automation framework and maintaining QA environments
- Experience in data analysis and requirements validation
- Concrete experience in Data project Test Strategy creation, Test Planning, Test Case design and test result reporting
- Skills in infrastructure troubleshooting, support in performance tuning and optimization, and bottleneck problem analysis
- Experience in leading a team and in direct customer communications
- Analytical approach to problem solving, excellent interpersonal and communication skills, and English proficiency
Nice to have
- Familiarity with a few data processing technologies, e.g., Spark, Hadoop, Kafka, Elasticsearch, Python libraries (Pandas/NumPy/etc.)
- Understanding of various ETL Tools (e.g., Databricks)
- Knowledge of Linux and Bash scripting basics
Benefits
We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Five trust days per year (sick leave without a medical certificate)
- Benefits package (sports activities, a variety of stores and services)