Senior Data Engineer
Summary
Build and optimize ETL pipelines in AWS using SQL and Python to assemble and transform financial data sets for stakeholders.
You discover, analyze, and assemble complex data sets, build ETL pipelines using SQL and Python in AWS, support stakeholders with data-related technical issues and needs, develop data tools for business departments, and maintain and optimize data models and architecture.
Responsibilities
- Discover complex data sets
- Analyze data sets
- Assemble data sets to meet business requirements
- Build ETL pipelines using SQL and Python in AWS
- Support stakeholders with data-related technical issues
- Develop data tools for business departments
- Maintain data models and architecture
- Optimize data models and architecture
- Perform root cause analysis on data and processes
- Build data transformation and workload management processes
- Validate performance at larger data volumes
Requirements
- Strong experience with relational SQL and NoSQL databases
- Experience with Postgres, Redshift, MySQL, MariaDB, Aurora, and MongoDB
- Experience with Python
- Experience with AWS S3, Athena, Redshift, and Glue
- Experience building, optimizing, and supporting big data pipelines, architectures, and data sets
- Experience performing root cause analysis on data and processes
- Experience building processes for data transformation, data structures, metadata, dependency, and workload management
- Ability to predict and validate performance at larger data volumes
- Experience supporting cross-functional teams
Benefits
- Competitive salary and bonuses
- Flexible and remote working options
- Annual bonuses
- Learning Hub
- Free assorted healthy snacks and fresh fruits in the office
- Weekly gourmet breakfast meet-ups
- Regular exciting team events and parties