Data Engineer
Posted 1
view
Summary
On-site Data Engineer in Manila who designs and maintains scalable batch and streaming data pipelines with Databricks and Apache Spark, implements ETL/ELT, optimizes SQL and Snowflake schemas, and manages access controls via Unity Catalog. Requires 2+ years of hands-on Databricks experience.
Are you passionate about building scalable data solutions and optimizing data workflows? Join the team and help transform raw data into reliable, high-quality datasets!
- Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
- Build and manage batch and streaming data workflows.
- Implement ETL/ELT processes to transform raw data into curated datasets.
- Optimize SQL queries and design Snowflake schemas, including fact and dimension tables.
- Manage data access controls and permissions using Unity Catalog.
- Monitor data quality, pipeline performance, and reliability.
- Collaborate with cross-functional teams to improve data processes and solutions.
- At least 2 years of hands-on experience with Databricks Unified Data Analytics Platform.
- Strong knowledge of data pipeline architecture, data integration, and transformation.
- Experience with Apache Spark/PySpark, ETL/ELT, and SQL query optimization.
- Familiarity with cloud-based data platforms and distributed computing.
- Strong analytical, troubleshooting, and problem-solving skills.
