Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Pyramid Consulting, Inc

NewBe an early applicant

Data Engineer

Posted

Description

Job Description: Senior Data Engineer – AI & Data Solutions

Job Title: Senior Data Engineer – AI & Data Solutions

Experience: 5+ Years

Location: UK, Germany / Portugal (Remote)

Role Overview

We are looking for an experienced Senior Data Engineer with strong expertise in Python, SQL, Data Engineering, and AI-driven solutions. The ideal candidate will lead technical workstreams, design and deliver scalable data and AI solutions, and drive engineering best practices across teams.

The role involves developing Agentic AI, Generative AI, Machine Learning, and Business Intelligence solutions, with a strong focus on production-ready systems, data governance, MLOps, and LLMOps.

Key Responsibilities

  • Lead technical workstreams, mentor junior engineers, and promote software engineering best practices.
  • Design, develop, and maintain scalable data engineering pipelines and solutions.
  • Build and deploy Agentic AI, Generative AI, Machine Learning, and BI solutions.
  • Implement RAG pipelines, embeddings, vector databases, prompt engineering, and context construction.
  • Lead end-to-end AI feature delivery, ensuring model reliability, evaluation, performance, and cost efficiency.
  • Implement data security and governance controls, including PII/PHI management, authentication, and RBAC.
  • Develop and maintain MLOps/LLMOps processes, CI/CD pipelines, and automated agent evaluation frameworks.
  • Work with cloud platforms and infrastructure-as-code solutions across AWS, Azure, and GCP.
  • Independently manage and deliver technical workstreams while collaborating with cross-functional teams.

Required Skills & Experience

  • 5+ years of professional experience in Data Engineering.
  • Expert-level proficiency in Python and SQL; working knowledge of Scala and Java.
  • Strong experience in Agentic AI, Generative AI, Machine Learning, and Business Intelligence.
  • Hands-on experience with RAG, embeddings, vector databases, prompt engineering, and context construction.
  • Experience with Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro.
  • Strong understanding of AI model evaluation, guardrails, reliability, and production deployment.
  • Experience with MLOps, LLMOps, CI/CD, and agent evaluation tools such as LangSmith, Opik, and Langfuse.
  • Knowledge of Terraform and cloud environments (AWS, Azure, GCP).
  • Understanding of data security, PII/PHI management, authentication, and RBAC.

Qualifications

  • Degree in Computer Science, Engineering, or a related field, or equivalent professional experience.
  • Excellent written and verbal communication skills in English and the relevant local office language.
  • Strong time management, autonomy, and ownership of technical deliverables.
  • Willingness to travel as required.

Preferred Advantage:

  • Experience using AI coding assistants such as Cursor, Claude Code, and Codex.


Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →