Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Avenue Code

Data Engineer – Python, PySpark & AWS

Posted Updated 16 views

Description

Avenue Code is seeking a skilled Data Engineer to design, develop, and optimize scalable data pipelines in an AWS cloud environment. You will build ETL/ELT processes, integrate multiple data sources, and develop data lakes and warehouses using Python, SQL, PySpark, and AWS services.

The role spans the full data engineering lifecycle, from requirements gathering to implementation, testing, and handoff, with strong emphasis on data quality and reliability in a collaborative team setting.

Design, develop, test, and maintain scalable ETL/ELT pipelines across multiple data sources. Build and optimize data-processing solutions using Python, SQL, and PySpark. Develop cloud-native data solutions with AWS services (S3, Glue, Athena, Lambda, Redshift). Design and maintain Data Lakes and Data Warehouses for efficient storage and access. Transform data models and workflows to support analytics and BI requirements. Integrate structured and semi-structured data ensuring quality and reliability. Implement data-quality checks and monitoring across pipelines. Collaborate with stakeholders to translate data needs into technical solutions. Participate in design discussions on data architecture and patterns. Maintain reusable, well-structured code following best practices. Work with Git, CI/CD, and Terraform for deployments and infra management. Troubleshoot pipeline failures and deliver long-term fixes. Produce documentation covering architecture and procedures. Take end-to-end ownership of data engineering deliverables. Solid professional experience in Data Engineering with production data pipelines. Strong proficiency in Python for data processing, transformation, and automation. Advanced SQL skills with complex queries and performance optimization. Hands-on experience with PySpark and distributed data processing. Experience designing, developing, and maintaining ETL/ELT pipelines. Practical experience with AWS services: S3, Glue, Athena, Lambda, Redshift. Understanding of Data Lake and Data Warehouse architectures. Experience with data modeling and data integration across sources. Familiarity with data-quality validation, monitoring, and troubleshooting. Experience with Git and CI/CD; Terraform familiarity.

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →