Lead AI Solution Engineer with Databricks, ML
Posted Updated
Description
We are looking for a Lead AI Solution Engineer who brings strong expertise in Databricks and Machine Learning to architect, launch, and manage production-level ML systems. The ideal candidate works hands-on as a Data Engineer or Machine Learning Engineer, has demonstrated success delivering both real-time and batch ML solutions, possesses solid skills in building streaming pipelines, and brings experience maintaining the scalability and reliability of ML systems once they are live in production.
Responsibilities
- Design and optimize feature engineering pipelines for both batch and real-time workloads
- Build, deploy, and maintain scalable model training and inference pipelines
- Process structured and unstructured data at scale
- Develop streaming solutions using Spark Streaming
- Enable real-time feature generation and model serving
- Ensure reliability, scalability, and performance of ML solutions in production
- Support batch pipelines for model training and retraining
- Operate and maintain production ML systems to ensure consistent performance
Requirements
- 7+ years of experience building, deploying, and operating offline and online feature engineering pipelines
- Proficiency in Databricks, Spark/PySpark, Python, and SQL
- Expertise in model training and real-time inferencing pipelines
- Experience processing large-scale unstructured data
- Knowledge of Spark Streaming
- Experience with real-time feature generation and low-latency model inference
- Proven track record of running production-grade ML systems
- English proficiency at B2 level or higher
Nice to have
- Exposure to MLflow and established MLOps workflows
- Hands-on background with AWS
- Prior work in Customer Analytics, Recommendation Systems, or Retail industries
Benefits
CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
- Diversity of tasks and projects
- Assessment center for objective review of competency level
- Personal development plan
- Mentoring programs and leadership development
- Certification and professional development support
- Access to learning platforms including more than 2,500 internal courses
- English courses taught by certified teachers
CORPORATE BENEFITS
- Extra leave days
- Referral bonuses
COMPENSATION PACKAGE
- Competitive compensation paid in USD
- Regular salary and performance reviews
MEDICAL & HEALTHCARE
- Private health insurance
- Well-being events
WORKING ENVIRONMENT
- Recreation areas and kitchens
- Tea, coffee and snacks
- Sports equipment and game consoles
- IT Equipment
- Microsoft’s Software Assurance Home Use Program (HUP)