Sr. Data Engineer
Description
Responsibilities:
- Designing, developing, and maintaining data infrastructure and systems.
- Design, develop, and maintain our data infrastructure and systems.
- Develop and maintain data pipelines to ingest data and ensure data quality and integrity.
- Design and implement data models and database schemas to support business objectives.
- Develop and maintain data pipelines to support data processing and analysis.
- Partner with cross-functional teams to identify and prioritize data requirements and use cases.
- Manage and optimize distributed systems and data storage solutions.
- Develop and maintain best practices and standards for data engineering within the organization.
Requirements:
- Mandatory: Azure, ADF, ADLS2 Databricks, Snowflake, Python, PySpark, and DevOps.
- Additional Skills: P& G frameworks like AI Factory, Ultimate, and Pygentic.