Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

PayPay

Data Engineer, DaaS

Posted Updated

Description

Applications: candidates may apply from outside Japan. Visa sponsorship: available. Japanese: Not required. English: Business level. Japan Dev tags: Engineering, Eng - Other, Security, Java, Python, Scala, SQL.

PayPay's growth is driving a rapid expansion of PayPay product teams and the need for a robust Data Engineering Platform to support our growing business needs is more critical than ever. We are looking for a Data Engineer for the DaaS team. The DaaS team’s responsibility is to design, implement, and operate this platform by using cutting edge technologies such as Spark, Hudi, Delta Lake, Scala, and AWS suite of data tools. We are looking for talented Data Engineers to join our team and help us scale our platform across the organizations.

Main Responsibilities

  • Design, develop, and maintain scalable data ingestion pipelines using Databricks, Airflow, Lambda, and Terraform
  • Optimize and manage large scale data pipelines to ensure high performance, reliability, and efficiency
  • Implement data processing workflows using Spark, Delta Lake, PySpark, and Scala
  • Maintain and enhance Data Lakehouse with Unity Catalog for effective data management and discovery
  • Build automation, framework, and improved tooling to support end to end data engineering workflows
  • Collaborate with cross-functional teams to ensure seamless data flow and integration across the organization
  • Implement best practices for observability, data governance, security, and compliance

Qualifications

  • 5+ years experience as a Data Engineer or in a similar role
  • Hands-on experience with Databricks, Delta Lake, Spark, and Scala
  • Experience designing, building, and operating a DataLake or Data Warehouse
  • Knowledge of Data Orchestration tools such as Airflow, Dagster, Prefect
  • Familiarity with change data capture tools like Canal, Debezium, and Maxwell
  • Experience in at least one primary language (e.g. Scala, Python) and SQL (any variant)
  • Experience with data cataloging and metadata management using AWS Glue Data Catalog, Lakeformation, or Unity Catalog
  • Proficiency in Terraform for infrastructure as code (IaC)
  • Strong problem-solving and debugging skills to troubleshoot complex data issues
  • Excellent communication and collaboration skills
  • Able to make sound decisions and learn quickly while factoring in complex technical contexts

Skills

What Middle Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →