Data Engineer

Data Engineer

12 Month contract initially + Extensions

Based: 2-3 days p/w onsite in London

Rate: £Market rates p/d (Flexible) - (via Umbrella company)

Key Responsibilities

• Build and maintain Palantir Foundry ontologies, pipelines, and applications.
• Design and develop scalable ETL/data engineering solutions using Python and PySpark.
• Integrate and transform data from multiple enterprise data sources.
• Optimize Spark-based data processing and workflow performance.
• Collaborate with business stakeholders to deliver analytics and AI-ready data products.

Key Skills & Experience

• Palantir Platform Expertise
  • Working with Foundry Ontology, pipelines, and modular applications.
  • Implementing End to End data Solutions in Palantir sourcing data from
• Programming & Scripting (Python and PySpark)
  • Data Processing & Automation: Ability to clean, transform, and process large datasets efficiently.
  • Integration with Palantir Foundry: Build custom Python functions and libraries to extend Foundry's capabilities.
  • Pipeline Development: Write modular, reusable code for ETL workflows and data transformations.
  • Performance Optimization: Use Python libraries like Pandas, NumPy, and PySpark for scalable data operations.
  • Familiarity with SQL for querying and data modelling. Good to have
• Data Engineering Fundamentals
  • Building ETL pipelines for ingestion and transformation.
  • Designing data models and optimizing workflows.
  • Handling structured and unstructured data.
• Big Data & Distributed Systems
  • Experience with Spark (PySpark) for scalable data processing.
  • Understanding of parallel computing and performance tuning.

We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.