Cloud Data Engineer

Role: Cloud Data Engineer

Location: Mumbai

Work Mode: Hybrid

Exp: 5+ Yrs

Skills Required

- 5+ years of relevant work experience

- Strong with programming in Python to perform,

• Batch data engineering on Apache Spark and populate downstream batch data stores (such as data mart) for BI use cases & to generate downstream feeds (ie., flat & wide tables or compressed files) for Data Science use cases

- Strong with SQL Server & Hadoop based implementations

- Strong SQL skills

- Good hands-on experience with at least one of the job scheduling tools like Autosys (Preferred), Control-M etc.,

- Experience of working in a Linux environment and can write Python/Shell scripts

- Strong data analytics skills

- Strong oral and written communication skills

- Excellent interpersonal skills and professional approach

- Strong analytical and problem-solving skills

- Ability to learn quickly and pick up new techniques and/or technologies

- Experience in building & maintaining data solutions for BI & Data Science use cases

Skills Desired

- Experience in data architecture and modeling experience. Especially, in dimensional modeling for data mart design and development to support BI use cases

- Real-time service integration to process business events off Kafka and persist in operational MS SQL/MongoDB and/or Neo4j Graph data stores for fraud investigation

- Near-real-time stream processing to derive features for ML model inference.

- Experience in Azure (Databricks, Data Factory, Synapse, Azure Data Lake) and/or AWS (AWS S3, AWS Athena, AWS Glue) Data ecosystem & Snowflake Data Cloud

- Experience in MongoDB and Neo4j Graph databases

- Experience in building virtual data access layer using TIBCO Data Virtualization to support BI & Data Science use cases

- Experience of the full software development life cycle

- Experience of working in an Agile team

- Experience of working with version control systems

- Experience with bash scripting

- Experience of working with Continuous Integration systems

- Experience in Fraud detection and prevention business in Financial Services