Data Engineer
Posted Updated
Description
Compunnel Inc. in Bentonville, AR is looking for a Data Engineer to design, develop, and maintain data pipelines for large-scale analytics.
The role requires strong Python and PySpark skills, Airflow orchestration, and experience with BigQuery and Spark to enable reliable data access for analysts and data scientists.
Develop and optimize data pipelines using Python and PySpark. Implement workflow orchestration using Airflow for ETL processes. Design and maintain scalable data solutions leveraging BigQuery and Spark. Collaborate with data scientists and analysts to ensure efficient data access and transformation. Ensure data quality, integrity, and compliance with governance standards. Monitor and troubleshoot data workflows for performance and reliability. Proven experience in Python programming for data engineering tasks. Strong hands-on experience with PySpark and distributed data processing. Expertise in Airflow for workflow orchestration. Proficiency with BigQuery and Spark for large-scale data analytics. Solid understanding of data modeling, ETL concepts, and performance optimization.Skills
Sign in to read and join the discussion.