Senior Data Engineer - AWS, Spark & Lakehouse Remote LATAM
Posted Updated
Description
Coderio is seeking a Senior Data Engineer AWS to design and optimize scalable data platforms handling financial and transactional data. You will build high-throughput pipelines, cloud data warehouses, and lakehouse architectures while collaborating with Data Scientists, Software Engineers, and Product Managers to translate business needs into reliable data solutions.
Ideal candidates have 5+ years in data engineering, strong Python/SQL skills, and hands-on AWS, Spark, dbt, and Airflow
Design, build, and maintain high-throughput, low-latency batch and streaming data pipelines to ingest and process financial transactions from diverse global sources. Design, scale, and optimize cloud data warehouse and lakehouse architectures capable of handling massive volumes of structured and unstructured data. Collaborate with Data Scientists, Software Engineers, and Product Managers to understand business needs and translate them into scalable, reliable data solutions. Implement and enforce data quality frameworks, automated testing, monitoring, and alerting to ensure data integrity, reliability, high availability, and compliance with SLAs. Drive the adoption of DataOps practices, including CI/CD, workflow automation, and Infrastructure as Code (IaC) for data systems. Champion data governance, privacy, and security standards across data storage and compute layers, including GDPR/LGPD compliance. Mentor and guide junior and mid-level Data Engineers, promoting engineering excellence, best practices, and modern architectural patterns. 5+ years of experience in Data Engineering, Big Data, or related Software Engineering roles, with a proven track record managing high-volume, production-grade data systems in fast-paced environments. Strong proficiency in Python and SQL for complex data processing, optimization, and software development; Scala or Java experience is a plus. Hands-on experience with Apache Spark/PySpark, Delta Lake, and modern lakehouse architectures, including Data Mesh principles. Strong expertise in AWS data services, particularly S3, Glue, Athena, EventBridge, Firehose, and Lambda. Solid experience with data orchestration and warehousing technologies, including Apache Airflow or similar DAG-based tools and platforms such as Snowflake, AWS Redshift, or Google BigQuery. Experience designing real-time streaming architectures using Apache Kafka or AWS Kinesis, as well as familiarity with dbt. Strong knowledge of DevOps/DataOps practices, including Git, Docker, CI/CD pipelines (GitHub Actions, GitLab CI, or similar), IaC, and cloud platforms such as AWS or GCP. Advanced English proficiency is required, with the ability to communicate effectively in English in both technical and non-technical contexts. 100% remote Long-term commitment Strategic, high-visibility role Collaborative international team Career development and growthSkills
- Airflow
- Athena
- Automation
- AWS
- Big Data
- BigQuery
- CI/CD
- Cloud
- Data Engineering
- Data Governance
- Data Mesh
- Data Pipelines
- Data Quality
- Data Warehousing
- DataOps
- dbt
- Delta Lake
- DevOps
- Docker
- Eventbridge
- GCP
- Gdpr
- Git
- GitHub
- GitHub Actions
- GitLab
- Infrastructure as Code
- Java
- Kafka
- Kinesis
- Lakehouse
- Lambda
- Lgpd
- PySpark
- Python
- Redshift
- S3
- Scala
- Snowflake
- Spark
- SQL
- Test Automation
Sign in to read and join the discussion.