Data Engineer - Lakehouse & ETL Automation (LATAM)
Posted Updated
Description
Onebeat is seeking an experienced Data Engineer to design, develop, and maintain a scalable data platform, including a Data-Lakehouse, ETL processes, and Temporal workflows. You’ll collaborate with data scientists, analysts, and engineers to deliver reliable data solutions and governance across the stack.
The role emphasizes batch data processing with strong SQL, Python/Scala/Java coding, and cloud experience (AWS). Excellent communication and teamwork are essential for success.
Develop a scalable data platform integrating multiple sources for easy access. Design and enhance data tools (orchestration, governance, Data-Lakehouse, BI). Ensure smooth operation of data systems for analysts, scientists, and engineers. Optimize data pipelines (ingestion, processing, output) in a microservices environment. Build, maintain, and monitor ETL/ELT processes and orchestrate workflows using Temporal. Troubleshoot and improve performance, scalability, and reliability of data infra (S3, Iceberg, ClickHouse). Collaborate cross-functionally with data scientists, analysts, and backend engineers. Implement and champion data quality, governance, and security best practices across the platform. 3+ years of experience as a Data Engineer or in a similar data infrastructure role. Strong proficiency in SQL and data modeling. Experience with data lake/lakehouse architectures (e.g., Apache Iceberg, S3, or similar). Experience with analytical/columnar databases (e.g., ClickHouse). Experience building and orchestrating ETL/ELT pipelines (Temporal, Airflow, or similar). Strong programming skills in Python and/or Scala/Java. Experience working within a microservices architecture and cloud environments (AWS preferred). Self-motivated, multitasking, and team-oriented. Hands-on experience with Apache Spark. Proficient in written and spoken English. Note: focus on batch data processing; not real-time streaming.Skills
Sign in to read and join the discussion.