Data Engineer ID89384
Posted Updated
Description
AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines, productionize agentic workflows, and integrate with Databricks, GCP, BigQuery, and Delta Lake environments.
You will build reusable data engineering frameworks, implement data quality checks, and optimize workloads for performance and reliability while collaborating with cross-functional teams to automate processes.
Design and optimize scalable ETL/ELT pipelines using Databricks, PySpark, and SQL. Build and operationalize agentic workflows to automate data engineering tasks. Integrate Databricks, GCP, BigQuery, and Delta Lake environments. Develop pipelines and solutions for new business datasets. Create reusable data engineering frameworks and components. Implement data quality checks, monitoring, and production controls. Optimize PySpark and SQL workloads for performance and reliability. Support testing, deployment, and productionization of data solutions. Troubleshoot complex data issues and implement sustainable fixes. Collaborate with business, data engineering, and platform teams to identify more automation opportunities. 5+ years of hands-on Databricks and PySpark experience. Advanced SQL and data-processing skills. Hands-on GCP experience, especially BigQuery. Experience with Delta Lake and data-lake architectures. Production-grade data solutions delivery. Strong analytical and troubleshooting abilities. Understanding of testing, version control, deployment, and monitoring. Upper-intermediate English. Professional growth Competitive compensation A selection of exciting projects FlextimeSkills
Sign in to read and join the discussion.