Big Data Engineer - Spark/Python

Job Description :

- 6+ Years of in Big Data & Data related technology experience

- Expert level understanding of distributed computing principles

- Expert level knowledge and experience in Apache Spark

- Hands on programming with Python

- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop

- Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming

- Experience with messaging systems, such as Kafka or RabbitMQ

- Good understanding of Big Data querying tools, such as Hive, and Impala

- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files

- Good understanding of SQL queries, joins, stored procedures, relational schemas

- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

- Knowledge of ETL techniques and frameworks

- Performance tuning of Spark Jobs

- Experience with native Cloud data services AWS databricks OR Azure databricks

- Ability to lead a team efficiently

- Experience with designing and implementing Big data solutions

- Practitioner of AGILE methodology

WE OFFER :

- Opportunity to work on technical challenges that may impact across geographies

- Vast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certifications

- Opportunity to share your ideas on international platforms

- Sponsored Tech Talks & Hackathons

- Possibility to relocate to any EPAM office for short and long-term projects

- Focused individual development

Benefit package :

- Health benefits, Medical Benefits

- Retirement benefits

- Paid time off

- Flexible benefits

- Forums to explore beyond work passion (CSR, photography, painting, sports, etc)