Big Data Engineer - 3 months contract
NewBe an early applicantSummary
3-month remote contract in India for a Big Data Engineer with 8+ years of experience. The person leads hands-on data engineering and BI teams while writing and tuning jobs across the Hadoop ecosystem (MapReduce, Hive, HBase), Spark Streaming, Java, Python/Scala, advanced SQL, and Postgres/Cassandra; Azure and ML experience are a plus.
Job Role: Big Data Engineer
Experience: 8+ years
Contract duration: 3 months
Location : India (Remote)
Requirement:
- Extensive experience in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, NoSQL stores like Cassandra, HBase etc.) across Fractal and contributes to open-source Big Data technologies.
- Write and tune complex Java, MapReduce, and Hive jobs.
- Experience leading a Backend/Distributed Data Systems team while remaining hands-on is very important.
- Manage the business intelligence team and vendor partners, ensuring to prioritize projects according to customer and internal needs, and develops top-quality dashboards using industry best practices.
- Manage team of data engineers (both full-time associates and/or third-party resources)
- Analyzes and confirms the integrity of source data to be evaluated.
- Leads in deployment and auditing models and attributes for accuracy.
- Experience with stream-processing systems: Spark-Streaming, Strom etc.
- Experience with object-oriented/object function scripting languages: Python, Scala etc.
- Experience in designing and building dimensional data models to improve accessibility, efficiency, and quality of data.
- Should be proficient in writing Advanced SQLs, Expertise in performance tuning of SQLs. Experience with data science and machine learning tools and technologies is a plus.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with Azure cloud services is a plus.
- Financial Services Knowledge is a plus.