Senior Data Engineering Analyst

Company Description

Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate in diverse markets, such as financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and new advanced technologies to unlock the power of data. We have an incredible team of 25,200 employees in 32 countries.

Our uniqueness is valuing yours. Experian’s people-centric, inclusive, and purpose-driven culture is recognized by numerous awards — including World’s Best Workplaces™ 2025 (Fortune’s Top 25 global) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity and affirmative action employer.

Job Description

We work in the Data Office of the largest DataTech in the market, building complex data flows and highly resilient pipelines. The professional will work directly on the evolution of data pipelines, supporting the transformation of legacy processes into a more scalable and resilient cloud solution, building new Data Products, and applying complex data transformations using various cloud tools and technologies.

This position will support the data quality team with quality monitoring applications and Dashboard construction, as well as the data flows that make these solutions possible. You will also have contact with large-scale data ingestion, cleaning, and prioritization flows.

Key Responsibilities

• Develop and maintain scalable and efficient data pipelines in PySpark;
• Migrate and modernize legacy processes to new distributed processing models;
• Implement data processing solutions in an AWS environment;
• Collaborate with product teams and Data Office analysts to detail business needs and rules;
• Optimize data architectures considering performance, governance, and cost;
• Participate in automation, observability, and continuous process improvement initiatives.

Qualifications

Technical Requirements

• Completed higher education degree;
• Solid experience with PySpark and distributed processing frameworks;
• Knowledge of Apache Airflow, Spark, and Hadoop (where applicable);
• Proficiency in programming languages, preferably Python;
• Experience with relevant AWS services (e.g., EMR, Lambda, DynamoDB, S3, Glue optional);
• Knowledge of SQL databases;
• Familiarity with DevOps practices and CI/CD pipelines.

Preferred Qualifications

• Experience with infrastructure provisioning (IaC);
• Experience with agile methodologies;
• Previous experience in migrating legacy processes to distributed architectures;
• Applied knowledge of Machine Learning and AI Agent Architecture.

Behavioral Skills

• Ability to handle complex problems and understand business rules;
• Critical thinking and focus on efficiency;
• Passion for optimization and continuous improvement;
• Clear communication and effective collaboration with different areas;
• Results-oriented mindset;
• Fast learner and adaptability to technological changes.

Additional Information

This is an affirmative position for women, as part of our commitment to advancing gender equity in the workplace.

Serasa Experian invests in female leadership and has a partnership with the TODAS Group. Additionally, we adhere to the 'Elas Lideram 2030' (Women Lead 2030) movement, and we have joined UN Women to reduce gender inequality by 2030!!

We also have the Women in Experian group, which seeks to improve gender equity for women by creating development opportunities, different perspectives, skills, among others.

Come be part of this transformation!

If you do not identify with this group, we invite you to explore other opportunities on our careers page. We have several vacancies that may connect with your profile and interests.

#LI-HOME

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here