Data Engineer
Summary
Designs, builds, and maintains cloud-based big data pipelines and ETL infrastructure for analytics and BI reporting on a big data project at Samsung Southeast Asia & Oceania. Core stack includes Java/Scala/Python, Spark, Hadoop, AWS Glue, Airflow, and SQL data warehouses like Redshift and BigQuery.
Position SummaryWe are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.
Position SummaryWe are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.
Role And Responsibilities Duties & Responsibilities:
- Implement, maintain and evolve cloud-based Big Data products and services
- Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
- Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
- Modify structured and unstructured data to provide meaningful reports to business
- Write large amounts of code, perform code reviews, write unit tests
- Write documentation
- Interface with other groups including Product Management, QA and Operations
- Create quick proof-of-concept prototypes
- Participate in an agile team
Work ExperienceAt least 2 years relevant work experience
Skills & Competencies
- Working experience in software development using Java, Scala, or Python is a must
- Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
- Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
- Experience managing and scheduling workflows (Apache Airflow experience is preferred)
- Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
- Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
- Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
- Ability to perform ad-hoc complex SQL queries and query optimization
- Team player with strong communication skills
- Desire to learn fast and pick up latest technologies and tools
- Experience with data visualization software (Tableau preferred) is a plus
- Experience with Kubernetes and Machine Learning is a plus
Skills And Qualifications
- Please visit Samsung membership to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please click here.