Data Engineer
Posted 18
views
Summary
Data engineer in Singapore building, testing, and maintaining data pipelines and data products on modern data platforms, supporting ingestion, transformation, encryption/masking, and AI-assisted development. Core stack: Python, PySpark, Snowflake, Databricks, and Cloudera, including Cloudera-to-Snowflake/Databricks migrations.
- Build and test data pipelines on modern data platforms
- Develop new pipelines and data products, and automation
- Enhance existing pipelines and data products, and provide support
- Maintain data pipelines and data products of these Solutions
- Support data engineering, ingestion, transformation and consumption activities
- Provide technical services like development, data preparation, data transformation, data encryption, data masking, data optimization and data testing preparation
- Provide support and integration with capability on latest AI tool stack to expedite the development, testing and deployment process
Required Skills:
- Python
- PySpark
- Snowflake
- Databricks
- Cloudera
- Migration from Cloudera to Snowflake/Databricks with metadata-driven design
Required Experience:
- Minimum 5+ years of experience in coding and development work
- Good understanding of data warehouse implementations
- Hands-on experience in big data engineering jobs using Python, PySpark to build and test data pipelines on modern data platforms such as Snowflake, Databricks and Cloudera
Skills
Sign in to read and join the discussion.