Data Engineer
Summary
Design and maintain scalable data pipelines, ETL/ELT workflows, and data warehouses to transform raw data into actionable insights using SQL, Python, and cloud platforms like AWS/Azure.
As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.
What you will do
Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization.
Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
Design,build,launchandmaintainefficientandreliablelarge-scalebatchand real-time data pipelines with data processing frameworks.
Integrate and collate data silos in a manner which is both scalable andcompliant.
Collaborate with Project Manager, Data Architect, Business Analysts, Frontend Developers, Designers and Data Analyst to build scalable data- driven products.
Be responsible for developing backend APIs & working on databases to support the applications.
Work in an Agile Environment that practices Continuous Integration andDelivery.
Work closely with fellow developers through pair programming and code review process.
Required Skills and Experience
Proficientingeneraldatacleaningandtransformation(e.g.SQL,pandas,R,etc)to ensure data accuracy and consistency.
Proficient in building ETL pipeline (eg.SQL Server Integration Services (SSIS), AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task,Eventbridge, AWS Glue, Spring).
Proficientindatabasedesignandvariousdatabases(e.g.SQL,PostgreSQL, AWS S3, Athena,mongodb,postgres/gis,mysql,sqlite,voltdb,cassandra,etc).
Proficient inDatabricks & Data Fabric (Microsoft)
Experience in cloud technologies such as GPC, GCC (i.e. AWS, Azure, Google Cloud).
Experienceandpassionfordataengineeringinabigdataenvironmentusing Cloud platforms such as GPC, GCC (i.e. AWS, Azure, Google Cloud).
Experience with building production-grade data pipelines, ETL/ELT dataintegration.
Knowledgeaboutsystemdesign,datastructureandalgorithms.
Familiarwithdatamodelling,dataaccess,anddatastorageinfrastructurelike Data Mart, Data Lake, DataVirtualisationand Data Warehouse for efficient storage and retrieval.
Familiarwithrestapiandwebrequests/protocolsingeneral.
Familiar with big data frameworks and tools (eg. Hadoop, Spark,Kafka,RabbitMQ).
Familiar with W3C Document Object Model and customized web scraping(e.g.BeautifulSoup,CasperJS,PhantomJS, Selenium, Nodejs,etc).
Familiarwithdatagovernancepolicies,accesscontrolandsecuritybestpractices.
Comfortableinatleastonescriptinglanguage(eg.SQL,Python).
Comfortableinbothwindowsandlinuxdevelopmentenvironments.
Interestinbeingthebridgebetweenengineeringandanalytics.
Unlock job insights
Hirer responsiveness Salary match Number of applicants
Your application will include the following questions:
- Which of the following statements best describes your right to work in Singapore?
- What's your expected monthly basic salary?
- Which of the following types of qualifications do you have?
- How many years' experience do you have as a Data Engineer?
Information Technology Services 101-1,000 employees
As the world's largest provider of IT infrastructure services, Kyndryl is committed to the health and continuous improvement of the vital systems at the heart of the digital economy. With our partners and thousands of customers worldwide, we co-create solutions to help enterprises reach their peak digital performance.
"Kyn" comes from "kin." It represents the strong bonds we form with customers and with each other. "-dryl" is coined from "tendril," evoking new growth and connections. By working together, we are growing.
As the world's largest provider of IT infrastructure services, Kyndryl is committed to the health and continuous improvement of the vital systems at the heart of the digital economy. With our partners and thousands of customers worldwide, we co-create solutions to help enterprises reach their peak digital performance.
"Kyn" comes from "kin." It represents the strong bonds we form with customers and with each other. "-dryl" is coined from "tendril," evoking new growth and connections. By working together, we are growing.