Data Engineer
Summary
Designs and maintains big-data infrastructure, builds ETL pipelines, and prepares raw data for analysis using Python, SQL, and cloud platforms.
- Liaising with coworkers and clients to elucidate the requirements for each task.
- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Preparing raw data for manipulation by data scientists.
- Detecting and correcting errors in your work.
- Ensuring that your work remains backed up and readily accessible to relevant coworkers.
- Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs.
Minimum Qualifications
- Bachelor's degree in data engineering, big data analytics, computer engineering, or related field.
- Master's degree in a relevant field is advantageous.
- Proven experience as a data engineer, software developer, or similar.
- Expert proficiency in Python, C++, Java, R, and SQL.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.
- Familiarity with Hadoop or suitable equivalent.
- Have knowledge and experience in workflow with DATAIKU, or other platforms
- Excellent analytical and problem-solving skills.
- A knack for independence and group work.
- Scrupulous approach to duties.
- Capacity to successfully manage a pipeline of duties with minimal supervision.