Blockchain Data Engineer
Summary
Designs, builds, and maintains ETL/ELT data pipelines that ingest and process blockchain data from networks like Ethereum, Bitcoin, and Solana for a blockchain analytics firm in Pretoria. Works with Python/Java/Scala, SQL databases, big data tools (Spark, Hadoop), cloud platforms, and Airflow, in a hybrid work model.
About the Role
Our client, a rapidly growing analytics firm specializing in blockchain data, is looking for a talented Blockchain Data Engineer to join their expanding team in Pretoria, Gauteng. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that extract, transform, and load data from various blockchain networks. You will play a key part in ensuring the quality, reliability, and accessibility of our extensive blockchain datasets, which are used to power advanced analytics and insights for our clients. This position requires a strong foundation in data engineering principles, a passion for blockchain technology, and the ability to work with large, complex datasets. You will collaborate closely with data scientists, analysts, and software engineers to deliver high-quality data solutions.
Key Responsibilities
- Develop, construct, test, and maintain scalable data pipelines for ingesting and processing data from multiple blockchain networks (e.g., Ethereum, Bitcoin, Solana).
- Design and implement data models and database schemas optimized for querying and analysis of blockchain data.
- Ensure data accuracy, consistency, and completeness across all data sources.
- Implement ETL/ELT processes using appropriate tools and technologies.
- Collaborate with data scientists and analysts to understand their data needs and provide tailored data solutions.
- Optimize data pipeline performance and troubleshoot data-related issues.
- Monitor data infrastructure and implement strategies for data quality assurance and data governance.
- Stay up-to-date with the latest trends and technologies in data engineering and blockchain analytics.
Requirements
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related quantitative field.
- 3+ years of experience in data engineering, data warehousing, or ETL development.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL and database technologies (e.g., PostgreSQL, MySQL, NoSQL databases).
- Experience with big data technologies (e.g., Spark, Hadoop) and cloud platforms (AWS, Azure, GCP).
- Familiarity with blockchain technology, cryptocurrency, and common blockchain data structures.
- Experience with data pipeline orchestration tools (e.g., Airflow).
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
Benefits
- Competitive salary and performance incentives.
- Comprehensive health insurance and retirement plans.
- Opportunities for continuous learning and professional development in the exciting field of blockchain analytics.
- Access to cutting-edge technology and tools.
- A collaborative and innovative work culture.
- Hybrid work model offering flexibility.