Data Engineer: SQL/Python on Databricks Lakehouse (Hybrid)
Summary
Build and migrate data pipelines on Databricks Lakehouse, converting legacy SQL views to Declarative Pipelines and adding reconciliation checks.
LA International is recruiting a Data Engineer in Swansea for a hybrid role with on-site 2 days per week. You will migrate legacy IMPALA and Oracle materialised views to Databricks Lakehouse Declarative Pipelines, translating SQL logic and building reconciliation checks. Experience with SQL is essential; some Python on Databricks (Azure) is a plus.
Source data in Unity Catalog; no data ingestion work. Security clearance is required; applicants with prior high-level clearance are welcome;