Sr. Data Engineer
Posted Updated
Description
Requirements:
- 5+ years of data engineering experience in software engineering in the data space.
- Strong software algorithmic problem-solving expertise.
- Strong fundamental Scala and Python software programming skills.
- Good understanding of AWS or other cloud provider resources (S3).
- Strong SQL skills and ability to creatively problem-solve and dive deep into our data and software ecosystem.
- Hands-on production environment experience with distributed processing systems such as Apache Spark.
- Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines.
- Scripting language experience (Bash, PowerShell).
- Technologies such as OneTrust, Databricks, Jupyter, Snowflake, Redshift, Airflow, DynamoDB, Redis, Kubernetes, Kinesis, REST APIs, Terraform, Go, SQL, Python, Scala, and other computer software languages.
- Willingness and ability to learn and pick up new skill sets.
- Self-starting problem solver with an eye for detail and excellent analytical and communication skills.
Preferred Qualifications:
- Master's Degree in Computer Science, Information Systems preferred.
- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, or BigQuery).
- Experience in developing APIs with GraphQL.
- Deep Understanding of AWS or other cloud providers, as well as infrastructure as code.
- Familiarity with data modeling techniques and data warehousing standard methodologies and practices.
- Familiar with Scrum and Agile methodologies.
- Familiarity with privacy regulations and/or data subject rights.
Skills
Sign in to read and join the discussion.