Data Engineer

Overview

As a Data Engineer within North America Supply Chain, you will be a key member of a growing and passionate group focused on collaborating across business and technology resources to drive forward key programs and projects building enterprise data & analytics capabilities across the enterprise.

Primary Responsibilities

• Good understanding and application of modern data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow, SQOOP, DMS, Spark, and building out performant data consumption layers.

• Design and build product features in collaboration with business and IT.

• Design reusable components, frameworks, libraries like User Defined Functions.

• Build continuous integration and test-driven development environment.

• Performance/scalability tuning, algorithms and computational complexity.

• Manage large data sets that are updated multiple times per day.

• Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints.

• Troubleshoot production support issues post - deployment and come up with solutions as required.

Preferred Experience

• A Bachelor's degree in Business, Information Technology or related field.

• 2+ years’ experience in a professional organization collaborating across multiple functions.

• Familiarity with Agile project delivery methods.

• Experience with AWS components and services (E.G. EC2, EMR, S3, and Lambda).

• Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow.

• Strong programming, Python, shell scripting and SQL.

• Good understanding of file formats including JSON, Parquet, Avro, and others.

• Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake.

• Experience with data warehousing, dimensional modeling and ETL development.

• Demonstrable ability to quickly learn new tools and technologies.

• Exceptional interpersonal and communication skills (written and verbal).