CDLF Tech lead
Summary
Leads cloud-based data engineering projects, building and optimizing data pipelines and warehouses using AWS, Snowflake, Spark, and related tools.
- Developer experience in cloud platforms like AWS,
Snowflake, etc.
- Proficient user of Bash, Python, and Shell
scripts for automating builds and deployment procedures, with a focus on
CI/CD and Medallion Architecture.
- Skilled in Shell/Bash scripting and building data pipelines on Unix/Linux systems.
- Hands-on experience with big data technologies such as Spark, Hive,
Iceberg tables, etc.
- Expert in data modeling, is aware of data
modeling, data warehousing concepts.
- Experience with building data pipelines in Python/Pyspark/HiveSQL/Presto/BigQuery
- Prior experience in Pharma and/or AbbVie is
strongly preferred.
- Great communication