Big Data Engineer
Posted Updated 5
views
Description
Job Description
Role Purpose
The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions.
͏
Must Have:
- Strong design and coding skills using Big Data technologies such as Hadoop, Spark(Pyspark), Hive, and Airflow.
- Experience with at least one cloud platform or service, such as Azure or AWS.
- Data warehousing experience with expertise in at least one RDBMS, such as SQL Server or Oracle.
- Experience with any one ETL tool like Informatica, SSIS, Pentaho or Azure Data Factory.
Good to Have:
- Experience developing as part of Agile/Scrum team is preferred
- Nice to have reporting skills on PowerBI/Tableau/QlikView.
- Passionate about delivering zero defect code that meets or exceeds the proposed defect SLA and have high sense of accountability for quality and timelines on deliverables.
Essential Functions
- Work with product owners, business stakeholders and internal teams to understand business requirements and desired business outcomes.
- Assist in scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions.
- Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists.
- Find opportunities to create, automate and scale repeatable analyses or build self-service tools for business users.
- Execute data engineering projects ranging from small to large either individually or as part of a project team.
͏
Deliver
| No | Performance Parameter | Measure |
| 1. | Analyses data sets and provide relevant information to the client | No. Of automation done, On-Time Delivery, CSAT score, Zero customer escalation, data accuracy |