Senior Data Engineer
Summary
Senior Data Engineer designing and maintaining enterprise data pipelines and lakehouse architecture using Microsoft Fabric, Azure, SQL Server, and Oracle Cloud Infrastructure for a large dairy cooperative.
Explore an exciting and rewarding career journey with Darigold! We are seeking an experienced and motivated Senior Data Engineer to join our Data & Business Intelligence team. This key and critical role will report directly to our Vice President, Data & Business Intelligence. The ideal candidate will have deep, hands-on expertise across the core Microsoft data platform & ecosystem with demonstrated ability to design and deliver end-to-end solutions and will possess a meaningful working knowledge of Oracle Cloud Infrastructure and Oracle enterprise applications, with particular emphasis on data integration patterns.
Darigold is the fifth largest dairy cooperative in the United States based on milk volume and one of the largest privately held organizations headquartered in the state of Washington. Since 1918, our producers have taken pride in producing dairy products with unsurpassed quality. Today, we are one of the nation's largest agricultural cooperatives, producing over 8.5 billion pounds of milk every year.
Through innovative technology and our efficient and flexible production capabilities, we deliver value-added products and customer-driven solutions. Darigold is now known throughout the world for bringing fresh, wholesome dairy products and ingredients from the Northwest to people all around the globe.
What You Will Do:
- Design, build and maintain scalable, reliable data pipelines that ingest, transform and serve data from ERP, MES, WMS, IoT and third-party systems.
- Lead architecture decisions for the enterprise data lakehouse, establishing standards for data modeling, pipeline patterns and platform governance.
- Collaborate with business stakeholders in manufacturing operations, supply chain, finance and executive leadership to translate requirements into technical solutions.
- Optimize data platform performance, cost and reliability across Microsoft Fabric, Azure and SQL Server environments.
- Ensure data quality, lineage and observability through automated testing, monitoring and alerting.
- Mentor junior and mid-level data engineers; conduct code reviews and enforce engineering best practices.
- Partner with the Oracle Applications team to maintain and evolve integration patterns between Oracle ERP/OCI and the Azure/Fabric data platform.
- Support regulatory and audit requirements related to data retention, access controls, and traceability.
- Partner with the Oracle Applications team to maintain and evolve integration patterns between Oracle ERP/OCI and the Azure/Fabric data platform.
- Support regulatory and audit requirements related to data retention, access controls and traceability.
What You Will Bring:
- Bachelor’s degree in Computer Science, Engineering or a related technical field.
- Minimum of 12 years of experience, including knowledge of and experience with the following:
- Microsoft Data Platform - Microsoft Fabric
- Architect and implement lakehouses, warehouses and data pipelines within Microsoft Fabric.
- Design medallion (Bronze/Silver/Gold) architectures in OneLake.
- Build and manage Fabric Data Factory pipelines and Dataflows Gen2.
- Develop real-time intelligence solutions using Eventstream and KQL databases.
- Configure workspaces, capacity management and governance policies.
- Integrate Power BI semantic models within Fabric for self-service analytics.
- Azure Data Services
- Design and implement solutions using Azure Data Lake Storage Gen2, Azure Data Factory, Azure Synapse Analytics and Azure Databricks.
- Develop and optimize Spark-based transformation workloads.
- Implement Azure Event Hubs and Stream Analytics for real-time data ingestion.
- SQL Server
- Design and tune complex queries, stored procedures and functions.
- Implement partitioning, indexing strategies and query plan optimization.
- Manage SQL Server Always On availability groups and replication.
- Oracle ERP / Cloud Applications Integration
- Experience with Oracle Cloud Infrastructure (OCI) Data Integration, OCI Data Flow (Apache Spark) and Autonomous Data Warehouse (ADW).
- Familiarity with OCI Object Storage and GoldenGate for real-time data replication.
- Understanding of Oracle ERP Cloud (Oracle Fusion) data models, including Financials, Procurement and Supply Chain modules.
- Experience extracting data from Oracle ERP using BIP (Business Intelligence Publisher) reports, OTBI or direct OTBI-Enterprise extracts.
- Familiarity with Oracle Integration Cloud (OIC) for application-to-application and B2B integration.
- Cross-Platform Integration Patterns.
- Design and implement hybrid integration architectures bridging Oracle and Microsoft ecosystems.
- Knowledge of data synchronization strategies between Oracle and Azure/Fabric environments.
- Manufacturing & Distribution/Supply Chain domain experience. Deep familiarity with the data and operational contexts of industrial environments is strongly preferred:
- Manufacturing
- OEE (Overall Equipment Effectiveness) analytics and shop floor data integration.
- MES (Manufacturing Execution System) and SCADA data pipelines.
- Bill of Materials (BOM), work orders and production scheduling data models.
- Quality management, SPC (Statistical Process Control) and defect tracking.
- IoT sensor data ingestion, time-series analysis and predictive maintenance.
- Distribution & Supply Chain
- Warehouse Management System (WMS) integration and inventory analytics.
- Transportation Management System (TMS) data and freight analytics.
- Demand forecasting, replenishment and S&OP data pipelines.
Nice To Have:
- Microsoft Certified: Azure Data Engineer Associate.
- Microsoft Fabric Analytics Engineer certification.
- Exposure to real-time streaming with Kafka or Azure Event Hubs.
- Experience with Lean/Six Sigma operational data in manufacturing.
- Familiarity with Python or PySpark for complex transformations.
- Background in ERP implementations (Oracle, SAP or similar).
Benefits of Working at Darigold:
We understand that as an employee, benefits that support you and your family in and out of work are important. We’re proud to offer eligible positions a competitive total rewards package that includes:
- 401k competitive employer matching
- Comprehensive medical, dental & vision benefits
- Employer paid life & disability coverage
- Paid time off and paid holidays
- 8 weeks paid parental leave
- Education assistance
- Employee assistance program
- Flexible hybrid working arrangement where it applies (up to 1 day/week after initial 90 days and approval by hiring manager and HR)
- Compensation range: $143,077.55 - $214,616.33 (individual wage based on previous experience, knowledge, and skills)
Our Commitment to Diversity:
Achieving our vision to Lead Dairy Forward requires cultivating and supporting a team with varying backgrounds, experiences, and perspectives. We are committed to providing a workplace based on mutual respect where all employees feel included and can bring their best and authentic selves to work every day. We are proud to be an Equal Opportunity Employer and Affirmative Action Employer. We welcome all qualified applicants without regard to race, color, national origin, sex, gender identity and expression, age, sexual orientation, veteran status, disability, marital status, creed, religion, genetic information or any other characteristic protected by federal, state, or local law. As a condition of employment applicants offered a role will be required to successfully pass our pre-employment background screen, receive a negative drug screen result & confirm eligibility to work in the U.S. We participate in E-Verify - please follow the links for details, English / Spanish & view our Right to Work Statement, English / Spanish.