Remote Bi & Data Engineer — Sql Server & Power Bi
Summary
Data engineer roles building and maintaining ETL/ELT pipelines, warehouse models, and automated reporting. Core stack is Python and SQL with Airflow, dbt, Snowflake and AWS on one track, and Adverity, BigQuery, dbt/Dataform and Looker Studio on a marketing-agency track.
Company Description Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world‑class engineering, industry expertise and a people‑centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses. From prototype to real‑world impact - be part of a global shift by doing work that matters.
Job Description Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data‑driven decision‑making and innovation through advanced analytics and predictive modelling. As a Data Engineer at Endava you will:
- Data Engineering & Architecture
- Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, validation, and delivery.
- Develop reusable, modular, and configuration‑driven data processing solutions.
- Contribute to technical architecture and evaluate solutions based on scalability, performance, reliability, and maintainability.
- Design and optimise data models, SQL queries, stored procedures, and data processing workflows.
- Workflow Orchestration & Data Quality
- Design and maintain Apache Airflow workflows, including scheduling, dependencies, retries, monitoring, and error handling.
- Develop automated data validation and quality checks using DBT and SQL.
- Implement appropriate monitoring, alerting, and observability for critical data pipelines.
- Troubleshoot and resolve complex data processing and quality issues.
- Cloud & Platform Engineering
- Develop data solutions using AWS and cloud‑based data warehouse technologies such as Snowflake.
- Work with cloud services for data storage, processing, compute, messaging, and serverless workloads.
- Support data platforms across development, QA, staging, and production environments.
- Optimise data workloads for performance, scalability, reliability, and cost.
- CI/CD & Production Support
- Develop and maintain CI/CD pipelines for data engineering applications and infrastructure.
- Apply Infrastructure‑as‑Code practices using Terraform or equivalent technologies.
- Support production deployments, incident resolution, root cause analysis, and continuous improvement.
- Maintain technical documentation, operational runbooks, and troubleshooting guides.
- Technical Leadership
- Take ownership of complex engineering initiatives from design through production.
- Conduct code reviews and promote engineering best practices.
- Mentor junior and mid‑level engineers and provide technical guidance.
- Collaborate with architecture, DevOps, product, and other technology teams.
Qualifications
- Programming: Python, SQL
- Orchestration: Apache Airflow or equivalent
- Data Transformation: DBT, SQL, PySpark
- Data Warehouse: Snowflake or equivalent cloud data warehouse
- Cloud: AWS or equivalent cloud platform
- AWS Services: S3, EMR, Lambda, SNS/SQS or equivalent
- CI/CD: Jenkins, GitHub, GitHub Actions, or equivalent
- 5+ years of professional experience in data engineering or a related software engineering role.
- Strong hands‑on experience building and supporting production‑grade data pipelines.
- Strong knowledge of Apache Airflow, including DAG development, scheduling, dependencies, retries, and monitoring.
- Strong experience with Snowflake or equivalent cloud data warehouse technologies.
- Proven experience with DBT.
- Solid experience with AWS or another major cloud platform.
- Experience with CI/CD and Infrastructure‑as‑Code practices.
- Strong programming skills in Python and SQL.
- Demonstrated experience troubleshooting complex production issues and performing root cause analysis.
- Ability to independently own complex technical initiatives from design through implementation and production.
- Strong communication, problem‑solving, and technical documentation skills.
- Experience with large‑scale data processing.
- Experience with PySpark and EMR.
- Experience mentoring engineers and contributing to technical standards and architecture.
Additional Information Discover some of the global benefits that empower our people to become the best version of themselves:
- Finance: Competitive salary package, value‑based recognition awards, referral bonus;
- Career Development: Career coaching, global career opportunities, non‑linear career paths, internal development programmes for management and technical leadership;
- Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass‑it‑on sessions, workshops, conferences;
- Work‑Life Balance: Hybrid work and flexible working hours, employee assistance programme;
- Health: Global internal wellbeing programme, access to wellbeing apps;
- Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.
At Endava, we’re committed to creating an open, inclusive, and respectful environment where everyone feels safe, valued, and empowered to be their best. We welcome applications from people of all backgrounds, experiences, and perspectives—because we know that inclusive teams help us deliver smarter, more innovative solutions for our customers. Hiring decisions are based on merit, skills, qualifications, and potential. If you need adjustments or support during the recruitment process, please let us know.
Data Engineer (Marketing‑oriented) | Remote for Marketing Agency for Education
Our client is a fast‑growing performance marketing agency specializing in mission‑driven organizations across higher education and nonprofit sectors. Since launching in 2020, the agency has built a strong reputation for combining strategic thinking, creative execution, and data‑driven marketing to help universities and organizations achieve measurable growth.
Company Overview Our client is a fast‑growing performance marketing agency specializing in mission‑driven organizations across higher education and nonprofit sectors. Since launching in 2020, the agency has built a strong reputation for combining strategic thinking, creative execution, and data‑driven marketing to help universities and organizations achieve measurable growth.
Your Role The Senior Data Engineer sits at the center of the agency's Data and Analytics function, connecting every paid media platform and CRM the agency touches into a single, reliable source of truth. You'll own the full path data takes: from a client's ad accounts and CRM, through Adverity, into a BigQuery warehouse, through modular dbt/Dataform transformations, and out to the Looker Studio dashboards and automated Google Sheets reports the team and its partners rely on daily. Reporting to the Data and Analytics Manager, you're joining at a pivotal moment — the agency is scaling its roster of education and nonprofit partners, and this role is instrumental in evolving the automated reporting suite that makes that growth possible without sacrificing data quality or client trust.
You'll:
- Own data ingestion & pipeline architecture — connect and maintain API pipelines from paid media platforms (Meta, Google Ads, LinkedIn, TikTok, programmatic) into Adverity, build custom Python connectors for anything not natively supported, and architect scalable pipelines from source system through to dashboard
- Own CRM integration — build and maintain reliable CRM data connections (Slate, Salesforce, HubSpot) so lead and enrollment data flows cleanly into the warehouse
- Own the data warehouse — route, optimise, and store raw and processed data in Google BigQuery; design efficient schemas for complex, multi‑source marketing data (granularity, normalization, slowly changing dimensions); manage partitioning, clustering, and storage strategy to control query cost and performance
- Own transformation & mapping — build SQL schemas that map, blend, and organise multi‑channel data accurately for each client, in modular, version‑controlled, documented dbt or Dataform pipelines, with standardized naming conventions and metric definitions across platforms and clients
- Own CI/CD & data segregation — maintain CI/CD pipelines (GitHub Actions, automated testing) for robust, version‑controlled releases, and enforce strict data segregation across multi‑client environments
- Enable the reporting layer — create clean, performant data views built specifically for fast Looker Studio dashboards and automated Google Sheets reports, and partner with the Data and Analytics Manager and client teams to translate reporting requirements into warehouse models
- Drive data quality — monitor pipeline health, resolve API breaks, minimise latency, implement validation frameworks and automated testing, troubleshoot discrepancies to root cause across source/warehouse/BI layers, and proactively flag data quality risks to leadership
You Bring:
- 5+ years of hands‑on data engineering experience, ideally in a marketing or agency environment
- Strong experience configuring datastreams, transformations, and destinations in Adverity or a comparable ETL platform (Fivetran, Supermetrics, Funnel)
- Intermediate to advanced SQL, with proven BigQuery experience in transformation, partitioning, and modelling
- Expertise in dbt or Dataform, managing modular, version‑controlled, documented SQL transformation pipelines
- Python proficiency for custom API connections and pipeline automation
- Experience with CRM data flows and integrations (Slate, Salesforce, and/or HubSpot)
- A deep understanding of marketing metrics (ROAS, CPA, CAC) and paid platform schemas, with a proven track record of structuring data to optimise Looker Studio performance
- Proficiency with Git and collaborative development workflows, and proven ability to manage multi‑client data environments with strict data segregation
- An analytical, solution‑driven mindset with a growth orientation, and strong communication skills that turn complex data workflows into clear narratives for non‑technical audiences — education marketing experience (traditional or online) is especially valued
Bonus Points:
- Experience integrating AI‑driven insights or machine learning models into marketing data pipelines to sharpen predictive analytics and data utility
- Familiarity using AI or LLM tools to optimise performance forecasting, automated audience segmentation, or marketing workflows
- Experience connecting, managing, and maintaining APIs for generative AI platforms within a marketing data architecture
- Experience using AI/ML‑driven anomaly detection to monitor pipelines and proactively flag data quality issues
What’s Offered:
- Remote role with the flexibility that comes with a distributed, async‑friendly team
- Competitive compensation based on experience and location
- A pivotal, high‑visibility seat on a scaling Data & Analytics team, with real ownership over the agency's reporting infrastructure
- The chance to build the data backbone for an agency whose partners are education and nonprofit organizations working to build a better world
- A culture built around finding a better way, playing as a team of A‑players, and treating results as the engine rather than the goal
- Direct impact: the pipelines and models you build directly shape how partners see (and trust) their own performance data
Interview Process
- Application Review (resume + a few questions)
- Screening Call with Atomic HR
- Hiring Team Interview (walkthrough of a pipeline or data model you've built)
- Technical Assessment (a real‑world data engineering case study)
- Final Interview with company leadership
Skills
- AI
- Airflow
- Analytics
- Anomaly Detection
- API
- Automation
- AWS
- Backbone.js
- BigQuery
- CI/CD
- Cloud
- CRM
- Data Engineering
- Data Ingestion
- Data Pipelines
- Data Quality
- Data Science
- Data Warehousing
- Dataform
- dbt
- DevOps
- ELT
- ETL
- Fivetran
- Generative AI
- Git
- GitHub
- GitHub Actions
- Google Ads
- HubSpot
- Jenkins
- Lambda
- LLM
- Looker
- Looker Studio
- Machine Learning
- Observability
- Predictive Analytics
- Predictive Modeling
- PySpark
- Python
- Root Cause Analysis
- S3
- Salesforce
- Serverless
- Snowflake
- SNS
- SQL
- SQS
- Terraform
- Test Automation
- Workflow Orchestration
Sign in to read and join the discussion.