Data Engineer- Databricks
Posted Updated
Description
Omnicomglobalsolutions is seeking a Data Engineer to build and test Databricks pipelines (PySpark/SQL, Delta Lake) for ingestion, transformation, and Gold-layer modeling. This is an early-to-mid career role encouraging rapid growth within an agile team.
You will participate in daily standups, maintain data quality checks, follow security standards, and collaborate on Boomi-based data flows (JDE, UKG). Strong English communication is essential.
Build and test Databricks pipelines (PySpark/SQL, Delta Lake) for ingestion, transformation, and modeling tasks assigned during sprint planning. Write and maintain data quality checks and tests for pipelines built. Participate in daily standups, reporting progress accurately, asking questions when requirements are unclear, and flagging blockers promptly. Follow the platform's data security model (RLS/CLS) and coding/documentation standards set by the Lead and Senior Engineers. Support integration testing and reconciliation checks for Boomi-based data flows (e.g., JDE-Concur, JDE-UKG) as assigned. Apply feedback from code reviews to subsequent work. Document pipelines clearly enough for another engineer to assume ownership. 2–4 years of data engineering experience with Spark/PySpark and SQL. Hands-on Databricks experience (Delta Lake, notebooks, jobs/workflows). Working understanding of data warehousing/lakehouse concepts (Bronze/Silver/Gold). Experience in an agile team with daily standups and sprint-based delivery. Strong written and verbal English communication skills.Skills
Sign in to read and join the discussion.