Remote Data Engineer - Azure Databricks & AI Pipelines
Posted Updated
Summary
Designs and optimizes scalable data pipelines and Lakehouse architectures on Azure Databricks, integrating AI capabilities such as LLM APIs to automate classification and generate insights. Works day to day in Python and SQL, collaborating with AI and product teams to keep cloud data workflows reliable and secure.
BairesDev is seeking a Data Engineer to design and optimize scalable data pipelines and Lakehouse architectures on Azure Databricks. You will integrate AI capabilities, including LLM APIs, to automate classification and generate insights while maintaining robust, secure data workflows.
You will collaborate with AI and product teams, write clean Python and SQL, and ensure reliable data processing across cloud environments.