Data Engineer - AI Data Pipelines (Hybrid: Pasig/Remote)
Summary
Builds and maintains data pipelines for AI using Databricks, GCP, and Azure to feed model training, RAG search, and Power BI reporting.
Insight Technology is seeking a Data Engineer to join the AI Development team, building and maintaining data pipelines for AI transformation and analytics using Databricks, GCP, and Azure. You will ensure clean, reliable data for model training, RAG-based search, and enterprise reporting.
You will design scalable ETL/ELT processes, maintain a Databricks lakehouse, implement data quality checks, and collaborate with AI developers and stakeholders to prepare optimized datasets for Power BI