Senior Data Engineer
Posted
Description
**Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship**
Senior Software Engineer, Data Modernization
Location: Houston, TX - Onsite
Core stack: SQL, Databricks, Java, Spark
Role summary
Modernize and upgrade the technology stack, including legacy-to-cloud data migration, through hands-on engineering, data modelling and performance tuning.
Responsibilities
- Design, build and troubleshoot secure, high-quality production code.
- Produce architecture and design artifacts, and ensure the code meets design constraints.
- Analyze large data sets, build reports and visualizations, and use the findings to improve code and architecture.
- Use enterprise-approved AI coding tools to speed up delivery, validating output through review, testing and secure coding standards.
- Contribute to engineering communities of practice.
Required
- 10-12 years of experience (the posting also says 8+), with formal software engineering training.
- Java or Python; strong relational database and T-SQL skills; Kafka and Apache Spark.
- Working knowledge of Databricks and AWS.
- Experience with enterprise-approved AI dev tools, and an understanding of responsible AI use.
- Strong Oracle PL/SQL: able to read and reason about complex legacy packages, views and procedures.
- Strong SQL and Databricks SQL, Delta Lake (MERGE, time travel, partitioning) and Unity Catalog.
- Hands-on dbt: models, snapshots, macros, Jinja, hooks and unit tests.
- Java, Scala/Spark, Spring Boot, Kafka, Kubernetes, Docker, S3 and Dremio.
- Data modelling: dimensional design, SCD2 history and point-in-time queries.
- Spark/Databricks performance tuning.
- Legacy-to-cloud migrations with formal parity and reconciliation.
- Strong written communication, including turning code into business-rule documentation.
Preferred
- Cloud exposure (AWS, Databricks, Snowflake).
Skills
Sign in to read and join the discussion.