Data Engineer – Digital Transformation
Summary
Data Engineer driving digital transformation for an automotive-sector client in Pune: collecting, processing and analyzing large datasets, building and maintaining data pipelines primarily on Palantir Foundry, ensuring data quality, and preparing data for predictive modeling in collaboration with global teams.
Summary: The Data Engineer will contribute to driving digital transformation within the automotive sector by developing and implementing advanced data solutions that enhance decision-making processes across various teams.
Main Responsibilities:
Collect, store, process, and analyze large datasets to support strategic decisions.
Collaborate with global teams to propose and test optimal data solutions.
Implement data solutions primarily on the Palantir Foundry platform or internal AI solutions.
Ensure data quality and interpret data-related issues.
Develop and maintain data pipelines, documentation, and definitions.
Prepare data for predictive modeling and contribute to functional analysis.
Stay updated on new technological tools and promote best practices for sustainable data platforms.
Facilitate knowledge transfer among team members and communicate effectively across departments.
Key Requirements:
3 to 5 years experience in data mining from varied data sources.
Proficiency in implementing data flows and automation between data sources.
Hands-on experience with data processing frameworks such as PySpark and Spark.
Strong understanding of data quality assurance and problem analysis.
Nice to Have:
Bachelor's or Master's degree in Computer Science or Engineering.
Experience with Big Data solutions and BI tools.
Familiarity with Agile software development methodologies.
Excellent communication and problem-solving skills.
Other Details:
Location: Pune
Team Structure: Part of the Digital Transformation Organization.
Key Platform: Primarily Palantir Foundry.