CLOUD DATA ENGINEER

The Cloud Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and cloud infrastructure on AWS. The role builds data integration and transformation solutions using Python, SQL, and AWS services, while applying best practices in software engineering, Infrastructure as Code (IaC), data governance, and cloud architecture to deliver secure, reliable, and high-performing data solutions.

The role follows a hybrid work arrangement, requiring regular onsite work at UP Ayala Technohub in Quezon City. Candidates must be willing to report on-site, work amid-shift schedule, andobserve U.S. holidaysrather than Philippine holidays.

Key Responsibilities:

• Design, develop, and maintain scalable cloud-based data pipelines and workflows to support analytics and operational systems.
• Develop data integration and transformation solutions using Python, SQL, APIs, and AWS services such as Glue, Lambda, Step Functions, S3, and DynamoDB.
• Write clean, efficient, and test-driven Python code for data ingestion, processing, and automation.
• Design and implement data models, including relational, dimensional, and NoSQL models, to support business and reporting requirements.
• Optimize data storage, processing, and query performance using big data formats such as Apache Parquet and ORC.
• Build, deploy, and maintain cloud infrastructure using Infrastructure as Code (IaC) tools such as AWS CloudFormation or CDK.
• Orchestrate, monitor, and troubleshoot data pipelines using workflow orchestration tools such as Apache Airflow, EventBridge, Step Functions, or Dagster.
• Collaborate with clients, business stakeholders, and cross-functional teams to gather requirements, provide technical guidance, and deliver high-quality data solutions.
• Ensure adherence to best practices in data quality, governance, security, testing, and documentation throughout the data lifecycle.
• Provide technical leadership through code reviews, knowledge sharing, and mentoring of team members, as needed.

Core Expertise:

• Experience: At least 5 years in a data engineering role, working on data integration, processing, and transformation use cases using open-source languages(e.g. Python) and cloud technologies.
• Strong programming skills in Python specifically for API integration and data libraries, with emphasis on quality and test-driven development.
• Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies.
• Demonstrated proficiency with SQL
• Demonstrated client-facing experience, multicultural team experience, technical leadership, and team leadership.
• Experience with data modeling:
  • Relational modeling
  • Dimensional modeling
  • NoSQL modeling
• Working knowledge of IaC on AWS (CloudFormation or CDK)
• Working knowledge of AWS Services:
  • Required: Glue, IAM, Lambda, DynamoDB, Step Functions, S3, CloudFormation or CDK
  • Nice-to-have: Athena, Kinesis, MSK, MWAA, SQS
• Experience with orchestration of data flows/pipelines: Ex: EventBridge, Step Functions, Lambda, Airflow (Nice to have)
• Nice-to-have:
  • Experience with data streaming (Kinesis, Kafka)
  • Experience with Apache Spark

Key Competencies & Abilities:

• Ability to work independently and collaboratively in a team environment.
• High level of attention to detail and commitment to delivering quality work.
• Strong analytical and critical thinking skills.
• Effective time management and organizational skills.
• Strong customer focus and the ability to communicate technical concepts clearly to stakeholders.
• Excellent written and verbal communication skills.

Additional Information:

• Must be willing to work in a hybrid setup, with onsite reporting to UP Ayala Technohub, Quezon City.
• Engagement is project-based for 6 months, with a possibility of extension.
• Work schedule is on a mid-shift (3 pm to 12 am on Work-In-Office days) at least twice a week (Tuesday and Wednesday) and 4 pm to 1 am on Work-from-home days
• The role observes U.S. holidays instead of Philippine holidays.
• The candidate will undergo a practical exam (problem-solving) to validate technical knowledge.