Senior Data Engineer( Snowflake , Azure)
Summary
Senior Data Engineer designs and builds data pipelines using Snowflake and Azure to enable analytics and reporting for enterprise clients.
Key Responisiobilities
-
Understanding the business requirements
-
Writing code and implementing the proposed solutions
-
Creating data pipelines, versioning and change management
-
Manage the complexity inherent in versioned data pipelines
-
Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
-
Design, build and maintain batch or real-time data pipelines in production.
-
Automate data workflows such as data ingestion, aggregation, and ETL processing.
-
Logging and instrumentation of pipelines and services.
-
Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
-
Train and mentor junior engineers.
Minimum Qualifications
-
Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role
-
Advanced SQL skills and experience with relational databases and database design.
-
Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.).
-
Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
-
Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc
-
Proficiencient in data pipeline and workflow management tools e.g. Airflow
-
Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc
-
Experience with the AWS/Azure/GCP data engineering services
-
Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM
-
OR
-
Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB
-
Very good exposure of working on Data Lakes & Data Warehouses solutions
-
Excellent problem-solving, communication, and organizational skills.
-
Proven ability to work independently and with a team.
-
Ability to guide other data engineers.
Additional Experience
-
Experience working with data ingestion tools such as Fivetran, stitch, or Matillion.
-
Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
-
Familiarity with machine learning technologies.
-
Experience in Java or Scala
What It's Like to Work at 3Pillar:
- Flexibility & Well-being – Our remote-first approach gives you the flexibility to work where you perform best, while prioritizing your well-being and personal commitments.
- Global Community – Collaborate with talented colleagues across the globe in a culture built on connection, support, and shared success.
- Your Voice Matters – We foster open communication and multiple feedback channels, ensuring every employee has the opportunity to be heard and make an impact.
- Growth & Development – Gain exposure to diverse clients, industries, and challenges that accelerate learning and career growth.
Our culture is guided by four core values: Collaboration, Outperform, Respect, and Evolve—the principles that shape how we work, grow, and succeed together.
Skills
- Agentic AI
- AI
- Ai Enablement
- Airflow
- Analytics
- Athena
- AWS
- Azure
- Azure Synapse
- BigQuery
- Cassandra
- Cloud
- Data Engineering
- Data Ingestion
- Data Pipelines
- Data Visualization
- Data Warehousing
- EC2
- ELT
- ETL
- Fivetran
- GCP
- Hadoop
- Hive
- IAM
- Java
- Lambda
- Machine Learning
- MongoDB
- Neo4j
- NoSQL
- NumPy
- pandas
- Power BI
- Python
- RDS
- Redis
- Redshift
- S3
- Scala
- Snowflake
- Spark
- SQL
- Tableau
As published by lever
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Portfolio URL, GitHub URL, Other website