Data Resiliency Engineer - Data Lake

AsaDataResiliencyEngineer,youwillbeattheforefrontofmaintainingandenhancingtherobustnessofourdatainfrastructure.Youwillanalyzeissuestoidentifyrootcausesandimplementsolutionsthatensureaseamelessuserexperience.Yourexpertiseindataecosystemmonitoring,incidentmanagement,anddataqualityenhancementwillplayapivotalroleinmaintainingoperationalexcellence.YouwillutilizeadvancedtoolslikeDatadogandOpsgenietoproactivelymonitorandresolveissues,actasasubjectmatterexpertfordata-relatedinquiries,andchampiondataqualityinitiatives.Additionally,youwillworkcloselywiththeteamtoensureoursuiteofpaymentsreportingsystemsforparticipantsaswellasPayNetinternalreports,areaccurateandalignedwithevolvingorganizationalneeds,drivingcontinuousimprovementinourdata-drivenoperations.

KEYAREASOFRESPONSIBILITIES

• RootCauseAnalysis&BugFixing:Analyzeissuestouncoverrootcausesandimplementeffectivesolutions,ensuringasmoothuserexperience.
• DataEcosystemMonitoring:OverseethedataenvironmentusingadvancedmonitoringtoolslikeDatadog,proactivelyidentifyingandaddressingissuesbeforetheyescalate.
• AlertSystemManagement:CollaboratewiththeteammanagingOpsgenieandotheralertsystems,ensuringtimelyresponsestocriticalincidentsandmaintainingoperationalexcellence.
• DataLakeSupport:Serveastheprimarycontactfordata-relatedinquiries,includingETLincidentmanagement,reportingchallenges,andprovidingactionableinsights.
• DataQualityMonitoring:Ownandenhancedataqualitymonitoringtools,designingrobustpipelinesandframeworkstomaintainthehighestdataintegritystandards.
• ReportingManagement:Leadreportamendmentsandensurereportingprocessesareaccurateandmeettheevolvingneedsoftheorganization.

QUALIFICATIONS&EXPERIENCE

MinimumQualifications

• Bachelor'sdegreeinComputerScience,Engineering,InformationSystems,orarelatedfield.
• StrongexperiencewithAWSdataservices(e.g.,S3,Glue,Athena,Quicksight,Lambda).
• StrongexperienceinPythonprogramminglanguage
• ProficiencyinPySparkforlarge-scaledataprocessing.
• Familiaritywithworkflowmanagementtools(e.g.,ApacheAirflow)
• FamiliaritywithoperatingdatatoolsonKubernetesandEKS
• Expertiseinmonitoringtools(e.g.,Datadog,CloudWatch)toproactivelytrackandresolveissues.
• ExperiencewithalertmanagementsystemslikeOpsgenieorsimilarplatforms.
• Strongunderstandingofdatalakesandmanaginglarge-scaledataenvironments.
• Experienceinperformingrootcauseanalysisforcomplexdataissuesandimplementingeffectivebugfixes.
• TerraformorotherIaCtoolsforinfrastructureprovisioning
• RelevantcertificationsinAWSanddataengineering

PERSONALQUALITIES

• Self-motivatedproblemsolverwhocanworkwithminimalguidance
• Excellentcommunicationskillstoarticulatetechnicaldetailsclearlytonon-technicalstakeholders.
• Detail-orientedwithafocusondataqualityandreliability
• Provenabilitytoworkcross-functionallywithmultipleteams(e.g.,DataEngineering,Operations,Analytics).
• Passionateengineerlookingtolearnnewtechnologies