Data Engineer
Posted Updated
Description
Ethereum Technologies is seeking a data engineer to design, develop, and maintain scalable data pipelines and ETL workflows. You will work with Python, SQL, PySpark, and cloud tools like Azure Data Factory, Databricks, and Snowflake to integrate data across systems and deliver analytics-ready datasets.
The role emphasizes collaboration with data analysts, data scientists, and business teams, while participating in Agile ceremonies and CI/CD practices to ensure reliable data delivery.
Designed, developed, and maintained scalable data pipelines to extract, transform, and load data from multiple sources. Developed ETL/ELT workflows using Python, SQL, PySpark, and Azure Data Factory. Built and optimized data processing solutions using Apache Spark and Databricks. Integrated data from multiple enterprise systems using REST APIs and database connectors. Monitored data pipelines, identified failures, and resolved performance and data processing issues. Implemented incremental data loading, partitioning, and optimization techniques to improve pipeline performance. Worked with Snowflake for data loading, transformation, query optimization, and warehouse management. Used Git and Azure DevOps for source control, CI/CD, and deployment management. Collaborated with data analysts, data scientists, and business teams to understand data requirements. Participated in Agile/Scrum ceremonies, technical discussions, code reviews, and production support. Bachelor's degree required in CS/IT or related field. Experience building data pipelines and ETL/ELT processes. Proficient in Python, SQL, and PySpark. Experience with cloud platforms and data warehousing. Strong data modeling and data integration understanding. Excellent analytical, problem-solving, debugging, and communication skills.Skills
Sign in to read and join the discussion.