Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

AgileEngine, LLC.

Data Engineer ID89384

Posted Updated

Description

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines, productionize agentic workflows, and integrate with Databricks, GCP, BigQuery, and Delta Lake environments.

You will build reusable data engineering frameworks, implement data quality checks, and optimize workloads for performance and reliability while collaborating with cross-functional teams to automate processes.

Design and optimize scalable ETL/ELT pipelines using Databricks, PySpark, and SQL. Build and operationalize agentic workflows to automate data engineering tasks. Integrate Databricks, GCP, BigQuery, and Delta Lake environments. Develop pipelines and solutions for new business datasets. Create reusable data engineering frameworks and components. Implement data quality checks, monitoring, and production controls. Optimize PySpark and SQL workloads for performance and reliability. Support testing, deployment, and productionization of data solutions. Troubleshoot complex data issues and implement sustainable fixes. Collaborate with business, data engineering, and platform teams to identify more automation opportunities. 5+ years of hands-on Databricks and PySpark experience. Advanced SQL and data-processing skills. Hands-on GCP experience, especially BigQuery. Experience with Delta Lake and data-lake architectures. Production-grade data solutions delivery. Strong analytical and troubleshooting abilities. Understanding of testing, version control, deployment, and monitoring. Upper-intermediate English. Professional growth Competitive compensation A selection of exciting projects Flextime

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →