Data Engineer
Description
Python, Pyspark ,Sql, Data Bricks,AWS and Scala , Big Data, Kafka, Spark,SQL,JSON(should be hands on in project)
Good to have - Databricks, Strong programming background
2 Rounds Will Be ViRtual & Kindly available for face to face Final Client Round - Necessary
8+ years of experience building solutions in big data technologies.
What Were Looking For
Minimum 8+ years of working experience in Technology (application development and production
support).
5+ years of experience in development of pipeline that extract, transform, and load data into an
information product that helps the organization reach its strategic goals.
Minimum 3+ years of experience in developing & supporting ETLs and using Python/Scala in
Databricks/Spark platform.
Experience with Python, Spark, and Hive and Understanding of data-warehousing and data modelling techniques.
Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
Strong data engineering skills with AWS cloud platform
Experience with streaming frameworks such as Kafka
Knowledge of Core Java, Linux, SQL, and any scripting language
Experience working with any relational Databases preferably Oracle.
Experience in continuous delivery through CI/CD pipelines, containers, and orchestration
technologies.
Experience working in an Agile development environment.
Experience working with cross functional teams, with strong interpersonal and written
communication skills.
Candidate must have the desire and ability to quickly understand and work within new technologies
Role & responsibilities
Preferred candidate profile
Perks and benefits