Data Engineer
Posted Updated
Summary
Data Engineer in Singapore who designs, builds, and maintains scalable data pipeline architectures and ETL infrastructure on AWS using SQL and big data tools like Hadoop, Spark, and Kafka. Requires ~3 years of software development experience and strong SQL skills.
Our client, an IT services, software development, and dataengineering consulting company, is looking for a Data Engineer to join their team.
Responsibilities:
Design,develop, and maintain scalable and high-performancedata pipeline architectures that support business and analytical requirements.
Build andmanage large, complex datasets that meet functionaland non-functional business requirements, ensuring data quality, reliability,and accessibility.
Identify andimplement process improvements by automating manualworkflows, optimizing data delivery, and redesigning infrastructure to improvescalability, efficiency, and performance.
Develop robustdata infrastructure for the extraction,transformation, and loading (ETL) of data from diverse sources using SQL andAWS big data technologies.
Developanalytics solutions and tools that leverage datapipelines to generate actionable insights into customer acquisition,operational efficiency, and other key business performance metrics.
Collaboratecross-functionally with Executive, Product, Data,and Design teams to resolve data-related technical challenges and supportevolving data infrastructure requirements.
Design andimplement secure, distributed data architecturesthat ensure data is appropriately segregated and protected across nationalboundaries, data centers, and AWS regions.
Develop datatools and platforms that enable analytics and datascience teams to efficiently explore, analyze, and optimize data to supportproduct innovation and business growth.
Partner withdata and analytics specialists to continuouslyenhance the functionality, reliability, scalability, and performance of datasystems.
Champion dataengineering best practices, ensuring that dataplatforms and pipelines are scalable, secure, maintainable, and aligned withevolving business needs.
Requirements:
Bachelor's Degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline.
Around 3 years of software development experience
Strong analytical and problem-solving skills.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
Experience building and optimising big data pipelines, architectures and data sets
Experience in performing root cause analysis on internal and external data and processes to address specific business questions and identify opportunities for improvement
Build processes supporting data transformation, data structures, metadata, dependency and workload management
Experience in manipulating, processing and extracting value from large disconnected datasets
Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
Experience with big data tools: Hadoop, Spark, Kafka, etc., relational SQL and NoSQL databases, data pipeline and workflow management tools, AWS cloud services, stream processing systems and object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
We regret that only shortlisted candidates will be notified.
EALicense No.: 08C3209
RegistrationNo.: R1101742
Responsibilities:
Design,develop, and maintain scalable and high-performancedata pipeline architectures that support business and analytical requirements.
Build andmanage large, complex datasets that meet functionaland non-functional business requirements, ensuring data quality, reliability,and accessibility.
Identify andimplement process improvements by automating manualworkflows, optimizing data delivery, and redesigning infrastructure to improvescalability, efficiency, and performance.
Develop robustdata infrastructure for the extraction,transformation, and loading (ETL) of data from diverse sources using SQL andAWS big data technologies.
Developanalytics solutions and tools that leverage datapipelines to generate actionable insights into customer acquisition,operational efficiency, and other key business performance metrics.
Collaboratecross-functionally with Executive, Product, Data,and Design teams to resolve data-related technical challenges and supportevolving data infrastructure requirements.
Design andimplement secure, distributed data architecturesthat ensure data is appropriately segregated and protected across nationalboundaries, data centers, and AWS regions.
Develop datatools and platforms that enable analytics and datascience teams to efficiently explore, analyze, and optimize data to supportproduct innovation and business growth.
Partner withdata and analytics specialists to continuouslyenhance the functionality, reliability, scalability, and performance of datasystems.
Champion dataengineering best practices, ensuring that dataplatforms and pipelines are scalable, secure, maintainable, and aligned withevolving business needs.
Requirements:
Bachelor's Degree in Computer Science, Software Engineering, Information Technology, Information Systems, or a related discipline.
Around 3 years of software development experience
Strong analytical and problem-solving skills.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
Experience building and optimising big data pipelines, architectures and data sets
Experience in performing root cause analysis on internal and external data and processes to address specific business questions and identify opportunities for improvement
Build processes supporting data transformation, data structures, metadata, dependency and workload management
Experience in manipulating, processing and extracting value from large disconnected datasets
Knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
Experience with big data tools: Hadoop, Spark, Kafka, etc., relational SQL and NoSQL databases, data pipeline and workflow management tools, AWS cloud services, stream processing systems and object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
We regret that only shortlisted candidates will be notified.
EALicense No.: 08C3209
RegistrationNo.: R1101742