Sr Data Engineer
Summary
Senior Data Engineer in Tokyo building and scaling a client's enterprise data platform on Databricks and AWS — turning messy operational data into governed, AI-ready data products powering Tableau, Databricks Genie, ML, and self-service analytics across manufacturing, supply chain, sales, finance, and HR.
Title – Data Engineer
Location Tokyo Japan
Duration – FTE
Client wants a hands-on Senior Data Engineer to build and scale their enterprise data platform on Databricks + AWS. The core goal isn't just moving data around - it's turning messy operational data into trusted, reusable, "AI-ready" data products that power Tableau, Databricks Genie/Genie Code, ML, and self-service analytics across Manufacturing, Supply Chain, Sales, Finance, and HR. They're trying to shift from one-off pipelines and reports toward a governed, single-source-of-truth platform (Databricks).
Responsibilities
- Deliver impactful technical projects by designing and building reference architectures and production-ready solutions using Lakehouse and Delta Lake best practices.
- Scope, plan, and manage engagements in collaboration with customers, engagement managers, and cross-functional teams.
- Guide customers through the design, build, and deployment of big data and AI applications, including migrations, to ensure successful adoption of Databricks.
- Consult on architecture and design, optimizing cluster configurations and enforcing robust data security and governance with Unity Catalog.
- Provide escalated support for complex operational issues and ensure reliable scheduling, monitoring, and management of production jobs.
- Implement CI/CD pipelines, document solutions, and share reusable assets to enable customer self-sufficiency and consistent delivery.
- Continuously monitor, optimize, and improve data pipelines and models, offering product and implementation feedback for continuous improvement.
- Enable customer teams through training, documentation, and best practice sharing.
Skills
Sign in to read and join the discussion.