Databricks Data Engineer
Posted 26
views
Summary
Data & analytics specialist in Singapore who queries, cleanses and transforms data with SQL and Python on Databricks, builds monitoring and reporting dashboards in Tableau/Power BI, maintains documentation in Confluence, and automates manual processes, working to Singapore government IM8 data-quality standards.
We are looking for a
Data & Analytics Specialist
with strong hands-on experience in
SQL, Python, Databricks, and dashboard development . The role will focus on data transformation, analytics, dashboarding, data quality, documentation, and process automation. The successful candidate will work closely with business and technical stakeholders to transform data into meaningful insights and support data-driven decision-making. Key Responsibilities Data Transformation & Quality Query, cleanse, transform, and analyse datasets using
SQL and Python
on Databricks. Ensure data accuracy, consistency, and quality in line with
government Instruction Manual (IM8)
standards. Perform data validation and troubleshoot data quality issues across systems. Analytics & Dashboard Development Develop, enhance, and maintain dashboards for
data monitoring, performance reporting, and user behaviour analytics . Work with business stakeholders to understand reporting requirements and translate them into meaningful visual insights. Analyse data trends and identify opportunities for process or performance improvements. Documentation & Knowledge Management Prepare clear and comprehensive
user guides
for dashboards, reports, charts, and Databricks data workflows. Maintain technical documentation in
Confluence , covering analytics processes, standards, workflows, and best practices. Ensure documentation is kept accurate and up to date. Automation & Project Support Explore and prototype
automation solutions
to reduce repetitive and manual processes. Create
user stories and acceptance criteria
based on business requirements. Manage
JIRA tickets, sprint tasks , and project deliverables. Develop and execute
QA/SIT/UAT test cases
where required. Required Skills & Experience Strong proficiency in
SQL and Python
for data processing and automation. Hands-on experience with
Databricks
or similar data/analytics platforms. Experience with
Tableau, Power BI , or equivalent dashboard/visualisation tools. Strong data analysis and data transformation capabilities. Experience preparing and maintaining
technical documentation . Good understanding of data quality, validation, and reporting processes. Preferred Skills Experience with
Apache Spark / PySpark
and distributed data processing. Exposure to
SIT/UAT, system testing, or QA processes . Knowledge of
Git or other version control systems . Experience working with
JIRA and Confluence . Exposure to automation or workflow optimisation initiatives. Soft Skills Strong analytical and problem-solving abilities. Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders. Strong attention to detail and commitment to data quality. Ability to work independently as well as collaboratively in cross-functional teams. Proactive approach to identifying issues and improving processes.
Data & Analytics Specialist
with strong hands-on experience in
SQL, Python, Databricks, and dashboard development . The role will focus on data transformation, analytics, dashboarding, data quality, documentation, and process automation. The successful candidate will work closely with business and technical stakeholders to transform data into meaningful insights and support data-driven decision-making. Key Responsibilities Data Transformation & Quality Query, cleanse, transform, and analyse datasets using
SQL and Python
on Databricks. Ensure data accuracy, consistency, and quality in line with
government Instruction Manual (IM8)
standards. Perform data validation and troubleshoot data quality issues across systems. Analytics & Dashboard Development Develop, enhance, and maintain dashboards for
data monitoring, performance reporting, and user behaviour analytics . Work with business stakeholders to understand reporting requirements and translate them into meaningful visual insights. Analyse data trends and identify opportunities for process or performance improvements. Documentation & Knowledge Management Prepare clear and comprehensive
user guides
for dashboards, reports, charts, and Databricks data workflows. Maintain technical documentation in
Confluence , covering analytics processes, standards, workflows, and best practices. Ensure documentation is kept accurate and up to date. Automation & Project Support Explore and prototype
automation solutions
to reduce repetitive and manual processes. Create
user stories and acceptance criteria
based on business requirements. Manage
JIRA tickets, sprint tasks , and project deliverables. Develop and execute
QA/SIT/UAT test cases
where required. Required Skills & Experience Strong proficiency in
SQL and Python
for data processing and automation. Hands-on experience with
Databricks
or similar data/analytics platforms. Experience with
Tableau, Power BI , or equivalent dashboard/visualisation tools. Strong data analysis and data transformation capabilities. Experience preparing and maintaining
technical documentation . Good understanding of data quality, validation, and reporting processes. Preferred Skills Experience with
Apache Spark / PySpark
and distributed data processing. Exposure to
SIT/UAT, system testing, or QA processes . Knowledge of
Git or other version control systems . Experience working with
JIRA and Confluence . Exposure to automation or workflow optimisation initiatives. Soft Skills Strong analytical and problem-solving abilities. Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders. Strong attention to detail and commitment to data quality. Ability to work independently as well as collaboratively in cross-functional teams. Proactive approach to identifying issues and improving processes.