Data Engineer (Python / Databricks / Azure)
Posted 3
views
Summary
Data Engineer at Luxoft Malaysia building a sales planning and analytics platform for a premium German automotive OEM in Asia — designing scalable data pipelines with Python, Databricks, and SQL, exposing data via FastAPI REST services, and deploying on Azure. Requires 5+ years of data engineering experience and includes mentoring junior engineers.
Project Description:
- Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing,integration, and API-based data consumption.
Responsibilities:
- Design and develop scalable data processing solutions using Python and Databricks
- Build and maintain data pipelines for ingestion, transformation, and aggregation of business data
- Develop REST APIs using FastAPI to expose data and analytical services to consuming applications
- Design and optimize SQL queries and data models
- Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions
- Deploy and maintain solutions on Microsoft Azure
- Drive best practices in performance optimization, monitoring, testing, and code quality
- Mentor junior engineers and contribute to architectural decisions
Mandatory Skills Description:
- 5+ years of software/data engineering experience
- Strong Python development experience
- Hands-on experience with Databricks
- Strong SQL and data modeling skills
- Experience developing APIs with FastAPI
- Experience with Azure cloud services
- Understanding of ETL/ELT concepts and data pipeline design
- Experience with Git and CI/CD pipelines
Nice-to-Have Skills Description:
- Experience with Azure Data Factory
- Experience with Azure Synapse Analytics
- Knowledge of Spark/PySpark
- Experience building data products for Sales, Marketing, or Business Planning
- Exposure to machine learning workflows