Senior Data Engineer
Summary
Build and scale a cloud-native data platform in Snowflake, owning ELT pipelines, data models, and governance to deliver trusted analytics and self-service capabilities for a fintech client.
AboutTeamified
TeamifiedworkswithtopenterprisesanddigitalnativebusinessesinAustraliahelpingthembuildtheirremoteteamsinIndia,PhilippinesandSriLanka.Weprideourselveswithhiringgreatteamstoworkonexcitinggamechangingtechnology.Teamifiedcurrentlyhas200+engineers,testers,productmanagersetc.workingacross20+partners.Wefocusonupliftingthewayorganizationsbuildandmanagetheirremoteteamsthroughgreatworkingrelationships,trust,integrity,cultureandhiringprocesses.Additionaltothiswearebuildingourowntechnologyproductofferings.Westrivetodeliverthebestoutcomesforourcustomers,ourpartnersandourpeople.
AboutOurClient
Ourclientisaleadingfintechcompanythathelpsbusinessessimplifycomplexpaymentworkflowsthroughasecure,API-drivenpaymentplatform.Theirsolutionsenableorganizationstocollect,manage,reconcile,andautomatepaymentsatscale,supportingeverythingfrompaymentorchestrationandpayoutstofraudmanagementandembeddedfinancialservices.Theyworkwithmid-marketandenterprisebusinessesacrossarangeofindustriestocreateseamlessandefficientpaymentexperiences.
AbouttheRole
WeareseekinganexperiencedSeniorDataEngineertodesign,build,andscalemoderncloud-baseddataplatformsthatenabletrustedanalytics,operationalreporting,anddata-drivendecisionmakingacrosstheorganization.
Thisrolewillplayacriticalpartinevolvingourdataarchitecture,dataengineeringpractices,andanalyticscapabilities,withastrongfocusonSnowflakeasthecoreenterprisedataplatform.
Asaseniormemberofthedatateam,youwillberesponsibleforbuildingrobustandscalabledatapipelines,optimizingdatamodels,improvingdataqualityandgovernance,andenablingself-serviceanalyticscapabilitiesforbusinessandengineeringstakeholders.
Theidealcandidatecombinesstrongtechnicaldepthinmoderndataengineeringpracticeswithapragmaticmindset,excellentstakeholderengagementskills,andapassionforbuildingreliableandscalabledataplatforms.
KeyResponsibilities
DataPlatform&Engineering
- Design,build,andmaintainscalableandsecurecloud-nativedataplatformsanddatapipelines.
- Leadthearchitecture,optimization,andoperationalmanagementoftheSnowflakedatawarehouseplatform.
- DeveloprobustELT/ETLpipelinestoingest,transform,anddeliverhigh-qualitydatafrommultipleinternalandexternalsources.
- Buildreusableandmaintainabledataframeworks,transformationmodels,andorchestrationworkflows.
- Developandmaintaininfrastructure-as-codeandautomationfordataplatformprovisioningandmanagementwhereappropriate.
- Optimizeperformance,scalability,andcostefficiencyacrossdatastorage,transformation,andqueryworkloads.
- Supportnearreal-timeandbatch-baseddataprocessingrequirements.
SnowflakeEngineering&Optimization
- OwnandcontinuouslyimproveSnowflakearchitecture,performancetuning,security,governance,andoperationalbestpractices.
- DesignandoptimizeSnowflakeschemas,warehouses,clusteringstrategies,anddatasharingcapabilities.
- Implementscalabledatamodellingapproachesincludingdimensionalmodellinganddatavaultmethodologieswhereappropriate.
- ManageSnowflakeaccesscontrols,roles,permissions,andsecuredatasharingpractices.
- MonitorSnowflakeusage,queryperformance,andcostconsumptiontodriveoptimizationinitiatives.
- Supportdatalifecyclemanagement,retention,andgovernancepolicieswithinSnowflake.
DataModelling&AnalyticsEnablement
- Designandmaintaincurated,trusted,andscalabledatamodelstosupportanalytics,reporting,andoperationalusecases.
- Partnerwithanalysts,businessstakeholders,andengineeringteamstotranslatebusinessrequirementsintoscalabledatasolutions.
- Enableself-serviceanalyticscapabilitiesthroughwell-structuredsemanticlayersandgoverneddatasets.
- SupportandoptimizeBIandreportingplatformssuchasLooker,PowerBI,orequivalenttools.
- Ensuredatastructuresandmodelssupportbothoperationalreportingandstrategicanalyticsrequirements.
DataQuality,Governance&Reliability
- Implementdataqualitycontrols,validationframeworks,reconciliationprocesses,andmonitoringcapabilities.
- Proactivelyidentifyandresolvedataintegrity,consistency,andperformanceissues.
- Establishobservabilityandoperationalmonitoringfordatapipelinesandplatformreliability.
- Contributetodatagovernance,lineage,cataloguing,andmetadatamanagementpractices.
- Ensuredataplatformsandengineeringprocessescomplywithsecurity,privacy,andregulatoryrequirements.
Collaboration&Leadership
- CollaboratecloselywithProduct,Engineering,Operations,Finance,andBusinessstakeholderstodeliverimpactfuldatasolutions.
- Mentorandsupportjuniorengineersandanalystswithinthebroaderdatafunction.
- Contributetodataengineeringstandards,bestpractices,andplatformstrategy.
- Drivecontinuousimprovementinitiativesacrossdataarchitecture,tooling,anddeliverypractices.
- Workcross-functionallytoimproveorganizationaldataliteracyanddatamaturity.
Skills&Experience
Essential
- 5+yearsofexperienceinDataEngineering,AnalyticsEngineering,orrelateddataplatformroles.
- Experiencedesigningandsupportingmulti-regionandenterprise-scaledataplatformarchitectures.
- Strongexperiencedrivingperformanceoptimizationandcloudcostefficiencyinitiativesacrosslarge-scaledataworkloads.
- Strongunderstandingofplatformreliability,operationalmaturity,resilience,andproductionsupportpractices.
- Experienceimplementingadvancedgovernance,security,accesscontrol,anddataprotectionmodelswithinenterprisedataplatforms.
- Strongcapabilityindevelopingarchitecturalstandards,engineeringdocumentation,andscalableplatformdesignpatterns.
- Stronghands-onexpertisewithSnowflakeinenterprise-scaleenvironments.
- AdvancedSQLskillswithexperienceoptimizingcomplexanalyticalqueriesanddatatransformations.
- StrongexperiencebuildingandmaintainingmodernELT/ETLpipelinesandorchestrationworkflows.
- Strongunderstandingofmoderndatawarehousingconcepts,dimensionalmodelling,andscalabledataarchitecture.
- ExperienceworkingwithcloudplatformssuchasAWS,Azure,orGCP.
- Experiencewithdatatransformationandorchestrationtoolssuchasdbt,Airflow,Fivetran,Matillion,orequivalentplatforms.
- Experienceintegratingstructuredandsemi-structureddatasources.
- Strongunderstandingofdatagovernance,security,andaccessmanagementprinciples.
- Provenabilitytomanagelargeandcomplexdatasetsinproductionenvironments.
- Stronganalytical,troubleshooting,andproblem-solvingcapabilities.
- Excellentcommunicationandstakeholderengagementskills.
- Abilitytoworkeffectivelyinfast-paced,agile,andcollaborativeenvironments.
Desirable
- Experiencewithinfintech,payments,SaaS,orhighlyregulatedindustries.
- Experiencewithreal-timedatastreamingtechnologiessuchasKafkaorKinesis.
- Exposuretomachinelearningdatapipelinesandadvancedanalyticsworkloads.
- ExperienceimplementingCI/CDpracticesfordataengineeringworkflows.
- FamiliaritywithInfrastructure-as-CodetoolssuchasTerraform.
- Experiencewithdataobservabilityandqualitytooling.
- ExposuretocomplianceframeworkssuchasPCI-DSS,ISO27001,orSOC2.
- Experiencementoringengineersorleadingtechnicalinitiatives.
KeyTechnologies
- Snowflake
- SQL
- dbt
- Python
- AWS/Azure/GCP
- Airflow/Matillion/Fivetran
- Looker/PowerBI
- Git
- Kafka/Kinesis(desirable)
SuccessintheRoleLooksLike
- TheSnowflakeplatformisscalable,performant,secure,cost-efficient,andtrustedacrosstheorganisation.
- Datapipelinesandtransformationsarereliable,well-monitored,andhighlyautomated.
- Stakeholdersconsistentlyrelyonhigh-quality,trusted,andtimelydataforoperationalandstrategicdecisionmaking.
- Datamodels,semanticlayers,andreportingstructuresarewell-designed,maintainable,andscalable.
- Dataqualityissuesareproactivelyidentifiedandresolvedbeforeimpactingbusinessoutcomes.
- Engineeringandanalyticsteamsareempoweredthroughreliableself-servicedatacapabilities.
- Documentationfordatapipelines,models,governanceprocesses,andplatformarchitectureiscomprehensiveandmaintained.
- Thebroaderorganizationexperiencesmeasurableimprovementsindatamaturity,operationalefficiency,andanalyticscapability.
- Thedataengineeringfunctionisrecognizedasatrustedtechnicalandstrategicpartneracrossthebusiness.
Benefits(PH):
- Flexibilityinworkhoursandlocation,withafocusonmanagingenergyratherthantime.
- Accesstoonlinelearningplatformsandabudgetforprofessionaldevelopment
- Acollaborative,no-silosenvironment,encouraginglearningandgrowthacrossteams
- Adynamicsocialculturewithteamlunches,socialevents,andopportunitiesforcreativeinput
- Healthinsurance
- LeaveBenefits
- 13thMonthSalary