Data Engineer, AI Integration Specialist
Salary: $6,000 – $6,900 per month
About the role
We are looking for a Data Engineer to design, build, and support reliable data ingestion and transformation pipelines on AWS and Databricks. The role will work with architects, engineers, QA, and business teams to deliver data pipelines, curated datasets, data-quality controls, and production-ready operational processes.
Key responsibilities
Design and build batch and/or streaming data pipelines using Databricks and AWS services.
Develop data processing across Bronze, Silver, and Gold layers using SQL, Python/PySpark, and Delta Lake.
Implement ingestion from APIs, files, databases, object storage, or other enterprise data sources.
Develop data transformations, dimensional or curated datasets, and reusable data-engineering components.
Implement data validation, reconciliation, error handling, logging, rerun/recovery, and monitoring.
Optimise Spark jobs, clusters, partitioning, and storage for performance and cost.
Support CI/CD, environment promotion, SIT/UAT, production deployment, documentation, and operational handover.
Collaborate with platform, application, BI, and data-governance teams.
About you
3+ years of experience in data engineering or enterprise data-platform delivery.
Hands-on experience with Databricks, Apache Spark, PySpark, and SQL.
Experience with Delta Lake and layered data architecture such as Bronze/Silver/Gold.
Experience building production data pipelines with proper logging, error handling, and recovery.
Experience with AWS services such as S3, IAM, Glue, Lambda, Kinesis, or related services.
Good understanding of data modelling, data quality, and performance optimisation.
Experience with Databricks Workflows, Delta Live Tables, Unity Catalog, Auto Loader, or Structured Streaming.
Experience with APIs, XML/JSON, event or near-real-time ingestion.
Experience with CI/CD and infrastructure/configuration automation using Git-based tools.
Experience with Tableau, BI datasets, or data warehouse integration.
Databricks, AWS, Data Engineering, AI/ML, or GenAI certifications.
We regret to inform you that only shortlisted candidates will be notified.
PERSOL Singapore Pte Ltd • RCB No. 200007268E •
EA License No. 01C4394
Tan Mei Yee (R26161281)
"By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOL Singapore Pte Ltd (""PERSOL"") and its local and overseas subsidiaries and affiliates to collect, use and disclose your personal data to prospective employers/companies based in any country for purposes of evaluating suitability for employment, conducting reference checks, administering employment related services, complying with Government’s health advisories and such other purposes stated in our Privacy Policy.
We may use artificial intelligence (""AI"") and machine learning technologies to support our recruitment and placement services, including screening resumes, assessing qualifications and experience, and identifying skills and job matches. Where permitted by applicable law, we may also use such personal data to develop, train, test, improve and/or fine-tune AI and machine learning technologies that support our recruitment and business operations.
For more information on how we collect, use, disclose and protect your personal data, please refer to our Privacy Policy: https://www.persolsingapore.com/policies. If you wish to withdraw your consent, including consent relating to the use of your personal data for AI-enabled recruitment activities and AI development activities, please email us at sg.dataprotection@persolapac.com."