Senior Data Engineer (2)
Summary
Contract Senior Azure Data Engineer (6+ months, hybrid in Dallas/Irving, TX) on the Data Platform Core team, refactoring exploratory notebooks into production-grade cloud data pipelines. Core stack: Databricks, Apache Spark, Python, and SQL, with CI/CD, testing, and data quality work. Must work directly on W2 without sponsorship.
Job Type: 6 month plus Contract
Rate: $68.00-$72.00
MUST BE ABLE TO WORK DIRECTLY ON OUR W2 BASIS WITHOUT SPONSORSHIP AT ANY POINT
NO C2C HELP IN ANY FORM About the Role We are seeking a Senior Data Engineer to join our Data Platform Core team to build, operate, and scale our governed data foundations. In this role, you will take primary technical ownership of productionizing a heavy notebook estate--migrating complex prototypes into robust, tested, and maintainable cloud data pipelines. Key Responsibilities
- Notebook Migration & Standardization: Audit, refactor, and migrate exploratory notebooks and analytically complex code into production-grade, source-controlled assets.
- Pipeline Engineering: Build and maintain ingestion, transformation, and curated data pipelines across our cloud platform.
- Quality & Observability: Implement automated testing, data quality controls, monitoring, lineage tracking, and CI/CD deployment workflows.
- Cross-Functional Collaboration: Partner with Analytics Engineers, Systems Analysts, and domain experts to translate validated requirements into reliable data products.
- Documentation & Operations: Document technical designs, standard operating procedures, data models, and system limitations.
- 9+ years of total experience as a Data Engineer.
- 4+ years of hands-on experience with Databricks, Apache Spark, Python, and SQL operating production cloud pipelines.
- Proven track record of inheriting, refactoring, and productionizing legacy code, prototypes, or complex notebooks.
- Strong expertise in data modeling, performance tuning, and troubleshooting source data issues.
- Practical knowledge of orchestration, Git workflows, CI/CD, data testing, and access controls.
- Self-driven, curious problem solver with excellent documentation and stakeholder communication habits.
#TECH
#DALLAS
#HYBRID