Data Engineer III - Reliability Engineer
Summary
Builds and optimizes data pipelines, warehouses, and ETL processes using Python, SQL, Hadoop, and NoSQL to deliver analytics and insights for cross-functional teams.
Overview
What This Job Entails
We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Responsibilities
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
Create data tools for team members to assist them in building and optimizing analytics production
Work with data and analytics experts to strive for greater functionality in our data systems
Other duties as required. This list is not meant to be a comprehensive inventory of all responsibilities assigned to this position
Required Qualifications/Skills
Bachelor’s degree (B.S/B.A) from college or university and 5 to 8 years’ related experience and/or training; or equivalent combination of education and experience
Networks with senior internal and external personnel in own area of expertise
Demonstrates good judgment in selecting methods and techniques for obtaining solutions
Proficiency in languages SAS, Python, Java, and MATLAB
ETL (Extract, Transform, and Load)
Database - SQL and NoSQL
Data Warehousing – Hadoop, MapReduce, HIVE, Presto
Operating system: UNIX, Linux
Follows standard practice and procedures when analyzing situations or data
Preferred Qualifications
Programming language: Javascript, R
Basic Machine Learning
Physical Demand & Work Environment
Must have the ability to perform office-related tasks which may include prolonged sitting or standing
Must have the ability to move from place to place within an office environment
Must be able to use a computer
Must have the ability to communicate effectively
Some positions may require occasional repetitive motion or movements of the wrists, hands, and/or fingers
We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
Responsibilities
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
Create data tools for team members to assist them in building and optimizing analytics production
Work with data and analytics experts to strive for greater functionality in our data systems
Other duties as required. This list is not meant to be a comprehensive inventory of all responsibilities assigned to this position
Required Qualifications/Skills
Bachelor’s degree (B.S/B.A) from college or university and 5 to 8 years’ related experience and/or training; or equivalent combination of education and experience
Networks with senior internal and external personnel in own area of expertise
Demonstrates good judgment in selecting methods and techniques for obtaining solutions
Proficiency in languages SAS, Python, Java, and MATLAB
ETL (Extract, Transform, and Load)
Database - SQL and NoSQL
Data Warehousing – Hadoop, MapReduce, HIVE, Presto
Operating system: UNIX, Linux
Follows standard practice and procedures when analyzing situations or data
Preferred Qualifications
Programming language: Javascript, R
Basic Machine Learning
Physical Demand & Work Environment
Must have the ability to perform office-related tasks which may include prolonged sitting or standing
Must have the ability to move from place to place within an office environment
Must be able to use a computer
Must have the ability to communicate effectively
Some positions may require occasional repetitive motion or movements of the wrists, hands, and/or fingers