Data Engineer
Posted Updated
Description
Robotic Technologies Automation in Plano, TX is seeking a Data Engineer to develop, maintain, and optimize data pipelines using Databricks and Azure Data Factory.
You will write SQL, use PySpark/Python for large-scale processing, and integrate data from multiple sources into data lakes or warehouses, ensuring data quality and reliability across teams.
Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF). Work with Databricks for data processing and transformation. Write and optimize SQL queries for data extraction and transformation. Work with PySpark or Python for large-scale data processing. Integrate data from multiple sources into data warehouses or data lakes. Monitor, troubleshoot, and optimize data pipelines. Collaborate with teams to ensure data quality and reliability. Experience with Databricks and Azure Data Factory (ADF). Strong understanding of ETL/ELT concepts. Good knowledge of SQL and data transformations. Basic experience with Python or PySpark. Understanding of Azure cloud services and data lake concepts.Skills
Sign in to read and join the discussion.