Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

AgileEngine, LLC.

Data Engineer: Databricks + GCP ETL & AI Workflows

Posted Updated

Description

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data automation. You will build reliable, production-grade data solutions using Delta Lake, PySpark, and Advanced SQL, integrating with BigQuery and orchestrating end-to-end data processing.

Collaborate with business, data engineering, and platform teams to identify automation opportunities and deliver high-impact data platforms for Fortune

Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL. Build and operationalize agentic workflows to automate data engineering processes. Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments. Develop data pipelines and processing solutions for new business requirements. Create reusable frameworks and components for data engineering use cases. Implement data quality checks, monitoring, and production controls. Optimize PySpark and SQL workloads for performance and reliability. Support testing, deployment, productionization, and ongoing enhancements. Troubleshoot complex data and production issues and implement sustainable solutions. Collaborate with cross-functional teams to identify automation opportunities. 5+ years of hands-on Databricks and PySpark experience. Advanced SQL and data-processing skills. Hands-on GCP experience, especially BigQuery. Experience with Delta Lake and modern data lake architectures. Strong ETL/ELT design, data pipelines, performance optimization, and data quality. Experience building reliable, scalable production-grade data solutions. Strong analytical and troubleshooting skills. Knowledge of software engineering practices (testing, version control, deployment, monitoring). Professional growth Competitive compensation (USD-based) Exciting projects Flextime & remote

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →