Data and AI Engineer (Mid-Level)
Shannon & Wilson is a leading geotechnical engineering firm dedicated to delivering innovative solutions in infrastructure, transportation, and environmental projects. As part of our digital transformation journey, we are investing in modern data platforms and analytics capabilities to support better decision-making and operational excellence.
Job Summary:
We are seeking a Data Engineer to manage, optimize, and evolve our new Microsoft-based data platform (Microsoft Fabric, Azure SQL, Power BI, etc.). This role will be instrumental in ensuring that our engineers, supporting staff, and leadership have reliable, trusted access to data for project delivery, reporting, and strategic insights.
Responsibilities:
Platform Operations & Maintenance
- Administer and monitor Microsoft Fabric (or Azure Synapse/Lakehouse), Azure SQL Databases, and Power BI workspaces.
- Ensure data pipelines, notebooks, and scheduled refreshes run reliably and on time.
- Implement monitoring, alerting, and cost optimization strategies for the platform.
Data Engineering & Integration
- Build, maintain, and optimize ingestion pipelines from internal systems (ERP, project management software) and external data sources.
- Design and maintain clean, curated data models to support reporting and analytics needs.
- Collaborate with business analysts to ensure data structures meet business requirements.
Governance & Security
- Apply data governance standards for naming conventions, schema design, and access control.
- Work with IT to enforce security policies, manage permissions, and ensure compliance with client and regulatory requirements.
Continuous Improvement
- Stay current with Microsoft’s data platform capabilities (Fabric, Power BI, Azure Data Factory, etc.).
- Recommend new features, automation, or process improvements to enhance reliability and usability.
- Partner with stakeholders to identify and implement new use cases for analytics and reporting.