Data Engineer (Contract)
Posted 4
views
Responsibilities
- Assist in the design and implementation of data pipelines to collect, process, and store data from various sources.
- Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
- Collaborate with data analysts and data scientists to understand data requirements and provide the necessary data support.
- Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
- Build data pipelines to enable scalable processing of large volumes of data. Develop scalable and high-performance application architectures using modern development frameworks. Work closely with business stakeholders and project leads to gather requirements and convert them into effective solutions.
- Document data processes, workflows, and data models to maintain clear communication within the team Maintain technical documentation related to application design, workflows, and deployment
Requirements
- Bachelor’s degree in computer science, Information Technology, or a related field.
- 3 years of experience in data engineering
- Strong knowledge in SQL, ETL Teradata, Hadoop, Python and experience with writing queries for data extraction and manipulation.
- Experience implementing complex ETL and data extraction projects from scratch.
- Fluency in Python, Spark, HIVE-QL, Hadoop eco-system, data-centric workflow management tools Unix/Linux/HDFS environments
- Proficiency in SQL and RDBMS Good working knowledge of Git and CI/CD pipelines
- Experience in Graph database desirable but not mandatory Thorough knowledge of data security, privacy, and compliance regulations