Software Developer with DevOps and Data Engineering Expertise

Software Developer with DevOps and Data Engineering Expertise

Job Description: Software Developer with DevOps and Data Engineering Expertise
Location:Singapore
Job Type:Contract
Job Overview:
We are seeking a skilled Data Engineer / DevOps Specialist to join our growing team. The ideal candidate will have experience working with big data engineering, DevOps deployment, data virtualization, and analytics tools. This role involves managing large-scale data platforms, optimizing data pipelines, and ensuring system reliability, security, and performance. The candidate should have experience working with data visualization tools and strong data modeling and SQL skills. You will collaborate with cross-functional teams to implement scalable and secure systems across cloud and on-premise environments.
Key Responsibilities:

• Project Implementation:
  • Lead or contribute to projects using both waterfall and Agile methodologies, ensuring successful delivery within scope, time, and budget.
  • Implement systems usingHive, Impala, andCloudera Data Platformfor optimized big data solutions.
  • UtilizeDevOps deploymentpractices to automate processes, ensuring scalability, efficiency, and integration with existing infrastructure.
• Data Virtualization & Analytics:
  • Implement data virtualization tools likeDenodoto enhance data accessibility and performance across multiple systems.
  • Work with reporting and data visualization tools such asSAP BOandTableauto create dashboards and reports, ensuring data-driven decision-making across the organization.
• Big Data Engineering & ETL:
  • Develop and optimizebig data engineering jobsusingPython, Pyspark, Linux, and ETL tools likeInformaticato manage and transform large datasets.
  • Maintain strongSQLskills to build and optimize queries, perform data modeling, and ensure high-quality data analysis.
• System Troubleshooting & Optimization:
  • Troubleshoot and resolve complex system issues, including application stack traces and system resource bottlenecks.
  • Implement and optimizehigh availability, high performance, and high-security systemshosted in data centers or hybrid cloud environments.
• Data Warehouse & Analytics:
  • Play a key role in thedesign, development, and implementation of data warehouse solutionsand analytics platforms, ensuring alignment with business requirements.
  • Ensure best practices fordata modelingand data management are followed, and solutions are optimized for performance and scalability.

• DevOps & Virtualization:Hands-on experience withDevOps deploymentanddata virtualization toolslike Denodo.
• Big Data & ETL:Strong experience in big data technologies, includingPython, Pyspark, Linux, and ETL tools likeInformatica.
• Analytics Tools:Understanding of reporting and visualization tools such asSAP BOandTableau.
• Data Platforms:Track record of working with systems usingHive, Impala, andCloudera Data Platform.
• Data Modeling & SQL:Strong skills inSQL,data modeling, anddata analysis.
• Troubleshooting:Ability to troubleshoot complex system and application issues.
• System Implementation:Experience in implementinghigh availability, high performance, and high-security systemsin hybrid environments.

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Relevant certifications in DevOps, Big Data, or related fields would be an advantage.

• Experience working withhybrid cloud environmentsand large-scale data centers.
• Familiarity with Agile methodology and collaboration tools.