Data Engineer (Databricks)
Posted Updated 5
views
Summary
Data Engineer in Singapore working on a government project for InfoCepts, a data & analytics services firm. Day to day: designing and optimizing Databricks-based data pipelines with Python/PySpark, ETL and lakehouse/data-warehouse work, plus user training, support and documentation.
InfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner's 2020, 2021 and 2022 customers' choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have stayed true to our mission—to always help our customers stay modern that help them make smart, data-driven decisions. Since 2004, we have deployed hundreds of high performance analytics applications over web and mobile platforms, built several advanced analytics models, processed petabytes of data using Big Data technologies and delivered several high impact business solutions. Driven by our vision of delivering great customer experiences, we are looking for professionals who are passionate about making the world a better place by leveraging the power of data.
We are hiring aspiring / proven Data Engineers to join us in government project!
Location:
Central
Roles and Responsibilities: Design and develop scalable data pipelines, ensuring data integrity and availability. Collaborate with stakeholders to understand their data needs and provide solutions. Assist users in utilizing effectively, providing training and support to enhance their data processing and analysis capabilities. Monitor and optimize data workflows and queries for performance improvements. Implement best practices for data governance, security, and compliance within client's environments. Document data architecture, pipelines, and processes for knowledge sharing and future reference. Troubleshoot and resolve issues related to data processing and Databricks functionalities.
Skills Required: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer with a strong focus on Databricks. Proficiency in Python/Pyspark and data modeling techniques. Experience in Datawarehouse/Lakehouse projects. Experience with ETL tools and data integration processes. Excellent communication skills with the ability to explain complex concepts to non-technical users. Experience in providing user support and training is highly desirable.
We are hiring aspiring / proven Data Engineers to join us in government project!
Location:
Central
Roles and Responsibilities: Design and develop scalable data pipelines, ensuring data integrity and availability. Collaborate with stakeholders to understand their data needs and provide solutions. Assist users in utilizing effectively, providing training and support to enhance their data processing and analysis capabilities. Monitor and optimize data workflows and queries for performance improvements. Implement best practices for data governance, security, and compliance within client's environments. Document data architecture, pipelines, and processes for knowledge sharing and future reference. Troubleshoot and resolve issues related to data processing and Databricks functionalities.
Skills Required: Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer with a strong focus on Databricks. Proficiency in Python/Pyspark and data modeling techniques. Experience in Datawarehouse/Lakehouse projects. Experience with ETL tools and data integration processes. Excellent communication skills with the ability to explain complex concepts to non-technical users. Experience in providing user support and training is highly desirable.