Intermediate Data Quality Engineer
Posted
Description
We are seeking a Data Quality Engineer with 3-6 years of experience to join our team. The ideal candidate will be responsible for ensuring the accuracy, completeness, and consistency of our data assets. This role involves developing and implementing data validation strategies, identifying and resolving data quality issues, and contributing to the overall data governance framework.
Key Responsibilities
- Develop, implement, and maintain data quality checks and validation rules.
- Analyze data to identify discrepancies, anomalies, and quality issues.
- Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and quality standards.
- Write and execute SQL queries to profile, audit, and validate data.
- Utilize Python for data manipulation, automation of data quality tasks, and development of data quality scripts.
- Work with big data technologies such as Spark to process and validate large datasets.
- Document data quality issues, root causes, and resolutions.
- Monitor data quality metrics and report on the overall health of data.
- Participate in data governance initiatives and contribute to the improvement of data management practices.
Required Skills and Qualifications
- 3-6 years of experience in data quality, data analysis, or a related role.
- Proficiency in SQL for data querying, analysis, and manipulation.
- Strong programming skills in Python, including experience with data analysis libraries.
- Experience with data validation techniques and tools.
- Familiarity with big data technologies like Spark.
- Excellent analytical and problem-solving skills.
- Strong attention to detail and commitment to data accuracy.
- Effective communication and collaboration skills.
Preferred Qualifications
- Experience with data quality frameworks and methodologies.
- Knowledge of data warehousing concepts and ETL processes.
- Experience with cloud platforms (AWS, Azure, GCP) and their data services.
- Familiarity with data cataloging and metadata management tools.
Skills
Python AWS GCP Azure problem-solving skills analytical skills communication skills ETL data validation data quality SQL Data Analysis Data Warehousing Metadata Management spark Collaboration skills Data Cataloging
Skills
Sign in to read and join the discussion.