Data Engineer (Databricks)
About the role
As a Data Engineer, you will play a crucial role in designing, building, and maintaining robust data infrastructure and pipelines that support our organization's data-driven initiatives. You will work with cutting-edge technologies including Databricks and AWS to create scalable solutions that enable better business insights and decision-making across the company.
Key responsibilities
Design and develop data pipelines and ETL processes using Databricks and AWS services to extract, transform, and load data from various sources
Build and maintain scalable data architectures on AWS, ensuring optimal performance, security, and cost-efficiency
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions
Implement data quality frameworks and monitoring systems to ensure accuracy and reliability of data across platforms
Optimise data processing workflows and improve system performance through code reviews and continuous refinement
Manage data governance policies and ensure compliance with data security and privacy standards
Troubleshoot and resolve data infrastructure issues promptly to minimise disruption to business operations
Document technical specifications, architecture decisions, and operational procedures for knowledge transfer and maintenance
Stay current with industry best practices and emerging technologies in data engineering and cloud platforms
What we're looking for
Proven experience working with Databricks and AWS (or equivalent cloud platforms) in a production environment
Strong proficiency in programming languages such as Python, Scala, or Java
Solid understanding of data warehouse concepts, dimensional modelling, and relational database design
Experience with distributed data processing frameworks and big data technologies (e.g., Apache Spark, Hadoop)
Familiarity with SQL and ability to write complex queries for data analysis and validation
Knowledge of data pipeline orchestration tools (e.g., Apache Airflow, AWS Glue, or similar)
Understanding of data security, governance, and compliance principles
Excellent problem-solving skills and ability to troubleshoot complex technical issues
Strong communication skills and ability to collaborate effectively with cross-functional teams
Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent professional experience
Preferred: Experience with machine learning platforms and integration of ML models into data pipelines
Preferred: Certification in AWS or Databricks (e.g., AWS Certified Data Analytics - Specialty)
What we offer
At NCS Philippines, we are committed to fostering a dynamic and inclusive workplace where innovation thrives. We provide competitive remuneration packages aligned with industry standards, professional development opportunities to enhance your technical and leadership skills, and a collaborative working environment that values diverse perspectives. Our flexible work arrangements support work-life balance, and we offer comprehensive health and wellness benefits including medical coverage and wellness programmes. You will have access to the latest technologies and tools to perform your role effectively, and opportunities to grow your career through internal mobility and training initiatives. We believe in investing in our people and creating pathways for long-term career progression.