Senior Data Engineer
Summary
Build and maintain scalable data pipelines using PySpark, Databricks, and Airflow to integrate financial data from APIs, Oracle, and Kafka into a data warehouse/lakehouse.
Mô tả công việc: Trách nhiệm công việc
Kỹ năng Chuyên môn
Mandatory:
Additional Plus:
Quyền lợi
Quyền lợi ứng viên: Bảo Hiểm Y Tế, Chăm Sóc Sức Khỏe, Cơ Hội Phát Triển
Yêu cầu hồ sơ:
Từ khóa việc làm: .Net Developer, CNTT khác, System Engineer
Kỹ năng cần có: Database, Linux, Oracle
Kinh nghiệm làm việc: Từ 5 đến 6 năm
Giới tính: Không yêu cầu
- Working in a cross-functional Scrum team members)
- Daily coordination with the foreign Product Owner
- Self-assigning tasks and being self-responsible for the delivery
- Joining onsite business trips, if required
Kỹ năng Chuyên môn
Mandatory:
- Have at least 5 years of working experience in a similar position
- Have experience with Pyspark, ideally based on work experience with Databricks (Apache Spark)
- Have experience in data integration with multiple sources (RestAPI, OracleDB, File Import, Confluence Kafka)
- Have experience with workflow management tools such as Apache Airflow, Databricks Workflow
- Understanding of Data Warehouse/Data Lake/Data Lakehouse
- Deep understanding about Star-schema/Snowflake data model
- Understanding of automated testing and CI/CD pipelines in a Trunk-based software development process (GitLab)
- Ability to translate business needs into requirements or stories.
- Scrum knowledge / Experience in working in agile teams
- Good English skills (speaking and listening)
Additional Plus:
- Have hands-on experience with Linux Shell and Power Shell
- Understanding of the financial business context (financial asset reporting)
- Report development for online reporting dashboards i.e. in Power BI
- Cloud software development knowledge, ideally proven in Microsoft Azure and Databricks certifications.
- Knowledge of data product architecture (data mesh)
- Experience in scaled agile environments such as SAFe
Quyền lợi
- Free lunch at the office
- Competitive salary 13th salary
- 100% probationary salary; fully compulsory insurances
- Annual premium healthcare and 24/24 personal accident insurance
- Additional healthcare insurance for family members
- Annual health check-ups
- Working from home option, one day per week
- Flexible working hours; up to 18 days off per year
- Loyalty bonuses (additional annual leaves, travel vouchers, salary bonus)
- Free access to Udemy and ELSA speak
- Free kindergarten for staffs kids
- Onsite/business trips in Europe, US, or Australia
- Annual company trip
Quyền lợi ứng viên: Bảo Hiểm Y Tế, Chăm Sóc Sức Khỏe, Cơ Hội Phát Triển
Yêu cầu hồ sơ:
Từ khóa việc làm: .Net Developer, CNTT khác, System Engineer
Kỹ năng cần có: Database, Linux, Oracle
Kinh nghiệm làm việc: Từ 5 đến 6 năm
Giới tính: Không yêu cầu