Senior Backend Developer (Scala & Spark)
Summary
Build and maintain ETL pipelines in Scala/Spark to move and validate accounting data into a central data lake, using Databricks, Azure, and Agile practices.
Senior Backend Developer (Scala & Spark)
Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.
We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities:
- CONSULTINGin management and innovation : supporting business, managerial, cultural, and technological transformations.
- DATA & TECHNOLOGYto implement major transformation projects.
- CLOUD & APPLICATION SERVICESto build or integrate software solutions.
- SERVICE CENTERS of EXCELLENCEto support the latter through technology, innovation, agility, sustainability of skills and cost optimization.
Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges, with our support, innovation, technology and data, we enable them to be more efficient and resilient.
We believe that only a human oriented-practice of technology will make the new digital age an era of progress for all. Together let's commit!
Job Description
PLEASE NOTE: it is a fixed-term role = 2 years
We are focusing on developing a DataHub to store accounting information of different geographical locations. Our main aim is to create efficient, user friendly and scalable solutions that could be used by different teams in our company. We believe that strong and robust data products could mitigate risks and improve our capability inside our Group.
We manage vast amount of data coming from Accounting systems and store in a data lake.
We run our projects in SCRUM/Agile methodology as we believe that continuous delivery that enables quick feedback loop is the key to our success and satisfaction of our clients.
To achieve our goals, we use Scala, SQL/HQL, Airflow, ControlM, Jenkins, Github, Hive, Databricks, Azure, S3, Maven.
To ensure the highest quality we use Unit Tests with Quality tests, Automation and Pull Requests review.
WHAT YOU WILL BE DOING
- You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to data lake, technical validations, business logic, etc.
- You will use Scrum methodology, and be part of a high performance team
- You will document your solutions in the Group Santander tools: JIRA, Confluence, ALM
- You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery.
Qualifications
- At least 7 years of experience in programming
- At least 3 years of experience as Programming backend applications with BigData technologies, preferably in Spark with Scala
- Agile approach for software development
- SQL
- English (at least B2+)
Additional Information
What do we offer you?
- Permanent, full-time contract
- Training and career development
- Benefits and perks such as private medical insurance,lunch pass card, MultiSport Plus card
- Possibility to be part of a multicultural team and work on international projects
- Hibrid position based in Warsaw, Poland.Realocation is mandatory.
- Possibility to manage work-permits.
If you are passionate about development & tech, we want to meet you!