Senior Data Engineer (Spark + Python, AWS Pipelines)
Posted Updated
Description
Ascendion is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Python and Apache Spark. The role focuses on cloud-based integrations with AWS and data quality to support analytics and BI initiatives.
You will work on ETL/ELT workflows, data modeling, and data governance while collaborating with stakeholders across the organization to deliver reliable data-driven solutions.
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python, Spark, and AWS. Build and optimize data solutions that support analytics, reporting, and BI requirements. Integrate data from multiple sources into cloud-based data warehouses and data lakes. Perform data validation and quality checks to ensure data accuracy and completeness. Monitor and optimize data processing performance, storage utilization, and query execution. Support data modeling, database design, and cloud migration initiatives. Perform testing, troubleshooting, and documentation of data pipelines and integration processes. Collaborate with business stakeholders, architects, developers, and analytics teams to deliver reliable data-driven solutions. Support data security and governance requirements across enterprise data platforms. 3 to 5 years of relevant Data Engineering experience. Strong hands-on experience with Python and Apache Spark for data processing and pipeline development. Experience developing and maintaining ETL/ELT pipelines. Hands-on experience with AWS cloud services and cloud-based data solutions. Good understanding of SQL, data modeling, databases, data warehouses, and data lakes. Experience with data integration, data quality, pipeline testing, performance optimization, and technical documentation. Familiarity with data security and governance practices. Strong analytical, troubleshooting, and problem-solving skills.Skills
Sign in to read and join the discussion.