Data Engineer
Summary
Designs and maintains scalable data pipelines using Python, SQL, Spark, and Databricks to process large datasets for analytics and business needs.
Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
Responsibilities:
🌸Design, develop, and maintain robust and scalable data pipelines to support various data-driven initiatives.
🌸Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
🌸Work with large datasets, ensuring data quality, integrity, and reliability throughout the entire data lifecycle.
🌸Leverage Apache Spark within the Databricks environment to process large volumes of data efficiently.
🌸Utilize Python, SQL, Spark, and other technologies to optimize and enhance data processing capabilities.
🌸Implementation experience on containerization and orchestration tools (e.g., Docker, Kubernetes).
🌸Implement and optimize ETL processes for efficient data extraction, transformation, and loading.
🌸Collaborate with Data Scientists and Analysts to provide them with the necessary data infrastructure and support their analytical needs.
🌸Stay current with industry trends and best practices to continuously improve data engineering processes.
Qualifications:
💦Bachelor’s degree in computer science, Information Technology, or a related field.
💦At least 3+ years building data and analytics platforms using AWS Cloud, Python, SQL and Databricks
💦Experience working with Distributed systems like Spark.
💦Knowledge of automation and CI-CD best practices.
💦Outstanding aptitude for problem-solving and a demonstrated ability to excel within a collaborative team setting.
Apply
