Data Engineer II
Role and Responsibilities
- Guide and front the design and development of ETL pipelines and processes
- Collaborate with a team of data science and analytics professionals to understand how best to prepare data for further use
- Build, maintain, and optimize existing data architecture and infrastructure
- Enhance data quality and integrity through pressure testing and validation
- Spearhead the development and unification of multiple systems in a microservice centric architecture
Required Qualification & Education
- University Degree in Computer Science, Data Science, Mathematics or a related field and 4+ years of applicable experience
- Certification in one or more data management technologies or methodologies
Required Skills & Competencies
- Expertise with both SQL and noSQL database solutions
- Experience working with both structured and unstructured data
- Knowledge of programming languages such as Python or Ruby
- Understanding of data warehousing concepts and tools in AWS or Azure
- Understanding of a data lakehouse architecture, design, and implementation
- Strong problem solving skills and a passion for high quality data management
Required Software Knowledge
- 2+ yrs of SQL experience
- 4+ years of programming experience using either Ruby, Python, or another scripting language
- Experience working within expansive AWS systems involving multiple groups of microservices
Preferred Experience
- Masters Degree in Computer Science, Data Science, Mathematics or a related field and 2+ years of applicable experience
- Experience unifying systems with similar but distinct approaches to data management is a plus
Preferred Skills & Competencies
- Understanding of cloud computing and data management technologies in AWS (Sagemaker, Lambda, RDS, Redshift)
- Prior history working under Agile software development methods and tooling, such as Jira ticketing, Kanban process, etc.
- Exposure to data visualization or business intelligence tools is a plus (DOMO, Tableau, PowerBI)
- Experience working with version control systems such as GIT