Big Data Hadoop Developer
Posted
Summary
Big Data Hadoop Developer at IT consultancy Dellent, embedded in an investment banking client's tech hub project in Lisbon (hybrid). Day to day: develop and optimize Spark 3/Scala 2 applications on an on-prem Cloudera Hadoop stack (YARN, HDFS, Hive, Kafka), wire CI/CD with Jenkins/XL Deploy, and work with Kerberos/Ranger security.
This project is part of the business investment banking and financial services area, that currently has its technological hub in Portugal and is working on the development of innovative solutions and support for all operations related to the business.
We are looking for a Big Data Hadoop Developer to work in this project in Lisbon (Hybrid).
Requirements:
- Experience implementing CI/CD pipelines in a DevOps environment, using tools such as Jenkins, XL Deploy and XL Release.
- Strong proficiency in Apache Spark 3 and Scala 2, including Spark application development and performance optimization.
- Very good knowledge of the Hadoop ecosystem, particularly YARN, HDFS, Hive and Kafka, in an on-premises Cloudera environment.
- Knowledge of security mechanisms such as Kerberos and Ranger, together with strong coding best practices.
- Experience with Control-M, Bitbucket Git, Jira, Confluence, IntelliJ or VS Code, and familiarity with Agile/Scrum methodologies.
- English proficiency at B2 level or above (C1 preferred), with strong communication and collaboration skills.
What can you expect from us?
- Health insurance;
- A personalized training plan, with a budget to spend on the training you find necessary;
- Constant feedback so you can grow professionally;
- Remote onboarding process;
- Team events every semester so you can live new adventures;
- Exclusive discounts and offers from our partners;
- Culture of proximity and transparency. Your ideas and needs are heard and valued by us!
Do you think your profile fits this job description? Join the Dellent Team by sending us your CV to ---@---
We are looking for a Big Data Hadoop Developer to work in this project in Lisbon (Hybrid).
Requirements:
- Experience implementing CI/CD pipelines in a DevOps environment, using tools such as Jenkins, XL Deploy and XL Release.
- Strong proficiency in Apache Spark 3 and Scala 2, including Spark application development and performance optimization.
- Very good knowledge of the Hadoop ecosystem, particularly YARN, HDFS, Hive and Kafka, in an on-premises Cloudera environment.
- Knowledge of security mechanisms such as Kerberos and Ranger, together with strong coding best practices.
- Experience with Control-M, Bitbucket Git, Jira, Confluence, IntelliJ or VS Code, and familiarity with Agile/Scrum methodologies.
- English proficiency at B2 level or above (C1 preferred), with strong communication and collaboration skills.
What can you expect from us?
- Health insurance;
- A personalized training plan, with a budget to spend on the training you find necessary;
- Constant feedback so you can grow professionally;
- Remote onboarding process;
- Team events every semester so you can live new adventures;
- Exclusive discounts and offers from our partners;
- Culture of proximity and transparency. Your ideas and needs are heard and valued by us!
Do you think your profile fits this job description? Join the Dellent Team by sending us your CV to ---@---