Data Engineer
Posted Updated
Description
A leading technology consulting firm in Austin, Texas, is seeking an experienced Data Engineer to design scalable data pipelines and develop ETL workflows optimized for performance. The role requires over 6 years of experience in data engineering, proficiency in Python, Scala, or Java, and hands-on experience with tools like Spark and Kafka. Candidates should have a strong understanding of data modeling and cloud platforms such as AWS, Azure, or GCP. This position offers the opportunity to work on advanced use cases, focusing on AI-driven automation and compliance.
Design and implement scalable batch and near-real-time data pipelines.
Develop ETL/ELT workflows optimized for performance and cost.
Ensure data integrity, governance, privacy, and compliance.
6+ years of experience in data engineering for analytics or ML systems.
Hands-on experience with Spark, Kafka, and Airflow (or similar).
Strong understanding of data modeling and lakehouse architectures like Iceberg.
Experience with Snowflake, Databricks, and OLAP/NRT systems.
Skills
Sign in to read and join the discussion.