Data Engineer
Posted Updated
Description
Luxoft is seeking an autonomous data engineer to strengthen our data foundation for an energy platform using Ruby on Rails, Node.js/TypeScript and Python services on AWS. You will design robust pipelines and well-modeled schemas to turn raw data into analytics-ready insights.
You will collaborate with product teams to define criteria, onboard client data via Delta Sharing, and ensure reliable, automated pipelines with quality tests and schema-change handling.
Define and execute technical criteria with product teams. Architect and maintain data ingestion pipelines feeding both the app and analytics. Design well-modeled, layered tables with clean schemas for analytics-ready data. Onboard client data from sources (e.g. Databricks via Delta Sharing) and integrate with existing services/workflows. Make pipelines reliable and automated: data quality tests, monitoring, safe reprocessing and schema-change handling. Build a documented, well-tested data foundation for the app, analytics and future AI use cases. Own end-to-end production data pipelines as an autonomous IC. Experience designing and building production ingestion pipelines from APIs, files, and shared-data sources with a workflow orchestrator (Airflow, Dagster, Step Functions). Production experience with a cloud data warehouse (Snowflake preferred). Strong SQL, plus production experience in Python (preferred) or Node.js/TypeScript. AWS or another enterprise cloud platform. AI-native development and scaling AI workflows across a team including CI/CD. Strong English communication skills.Skills
Sign in to read and join the discussion.