Solution Data Engineer Sr.
Summary
Senior data engineer builds and maintains cloud data pipelines using Databricks, Snowflake, and Adobe Analytics, focusing on governance, performance, and integrations.
Responsibilities
- Manage the Databricks environment, workspace administration, and configuration
- Implement governance with Unity Catalog and manage Delta Lake storage
- Build and optimize data processing logic with Python, SQL, and PySpark
- Manage code lifecycle and collaboration using Git
- Support data architecture, performance, and integrations in Snowflake
- Handle Adobe Data Feeds and Adobe Analytics ingestion and transformation
- Maintain and monitor pipelines across cloud platforms, including Airflow workflows
- Support data availability and basic operations in BigQuery, Athena, and AWS Glue
Requirements
- Advanced English
- Strong experience with Databricks ecosystem administration
- Experience with Unity Catalog and Delta Lake
- Proficiency in Python, SQL, and PySpark
- Git-based collaborative development
- Snowflake data warehousing experience
- Adobe Analytics and data feed ingestion experience
- Airflow orchestration experience
- Familiarity with BigQuery, Athena, and AWS Glue