Data Engineering Analyst II

Company Description

Experian is a global data and technology company that powers opportunities for people and businesses around the world. We operate in diverse markets, such as financial services, healthcare, automotive, agribusiness, insurance, among others. Experian invests in people and new advanced technologies to unlock the power of data. We have an incredible team of 25,200 employees in 32 countries.

Our uniqueness is valuing yours. Experian's people-centric, inclusive, and purpose-driven culture is recognized by numerous awards—including World’s Best Workplaces™ 2025 (Fortune's Top 25 global) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to understand why. Experian is also proud to be an equal opportunity employer and an affirmative action employer.

Job Description

We are looking for a Data Engineer to work with large volumes of data in a highly scalable environment, primarily using Apache Spark/Python in Databricks. This professional will be responsible for developing, optimizing, and maintaining data ingestion pipelines, with a focus on modern and efficient architectures.

Key activities include:

• Building and maintaining ingestion pipelines using Autoloader (incremental, schema evolution, throughput optimization).
• Large-scale data processing using Spark Structured Streaming and Spark SQL.
• Implementing data engineering best practices, such as partitioning and optimization with Delta Lake.
• Knowledge of git version control and pull requests.
• Analysis, improvement, and optimization of costs and performance in Databricks.
• Implementing Data Quality.
• Creating clear documentation for requirements.
• Collaboration with business and analytics teams to ensure data is structured and available securely.

Qualifications

• Experience with Databricks for processing, transforming, and analyzing large volumes of data.
• Solid knowledge of ETL (Extract, Transform, Load) processes, ensuring information integration and quality.
• Experience in Data Engineering, working on the construction, maintenance, and optimization of scalable data pipelines.
• Experience with data architecture, data modeling, and integration between different sources.
• Ability to develop solutions for cloud data environments and Big Data ecosystems.
• Knowledge of best practices in data governance, quality, and performance.

Additional Information

Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for people and businesses, in Brazil we are more than 4,000 people working in diverse teams and specialties. Here, every skill and diversity complements each other and you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with their personal commitments and interests, prioritizing well-being.

We are dedicated to being one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is recognized externally through various market certifications: we have been awarded by Great Place To Work™ in 24 countries and by the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and having a 4.6 rating on Glassdoor. Each recognition indicates that we are on the right path, providing an increasingly better work environment for our talent.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here