Data Engineer
Posted Updated
Description
Ethereum Technologies in Plano, TX is seeking a Data Engineer to design, build and optimize data pipelines using Databricks and Azure Data Factory. You will develop ETL/ELT processes, write SQL, and implement PySpark for large-scale data processing.
Collaborate with cross-functional teams to ensure data quality and reliability, monitor pipelines, troubleshoot issues, and optimize performance in a cloud environment leveraging Azure data services.
Develop and maintain ETL/ELT pipelines using Azure Data Factory. Work with Databricks for data processing and transformation. Write and optimize SQL queries for data extraction and transformation. Work with PySpark or Python for large-scale data processing. Integrate data from multiple sources into data warehouses or data lakes. Monitor, troubleshoot, and optimize data pipelines. Collaborate with teams to ensure data quality and reliability. Experience with Databricks and ADF to develop data pipelines. Strong SQL and data transformation skills. Proficiency in Python or PySpark for large-scale processing. Understanding Azure cloud services and data lake concepts.Skills
Sign in to read and join the discussion.