DATA ENGINEER
Summary
Build and maintain scalable data pipelines, ETL workflows, and warehouse tables to feed analytics and backend services using SQL, Python, and cloud tools.
Design, develop and deploy data tables , views and marts in data warehouses, operational data store, data lake and data virtualization.
Perform data extraction, cleaning, transformation and flow . Web scraping may be also a part of the work scope in data extraction.
Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
Integrate and collate data silos in a manner which is both scalable and compliant .
Collaborate with Project Manager , Data Architect, Business Analysts, Frontend developers, Designers and Data analysts to build scalable data-driven products.
Be responsible for developing backend APIs & working on databases to support the applications.
Work in an Agile Environment that practices Continuous Integration and Delivery.
Work closely with fellow developers through pair programming and code review process.
Proficient in general data cleaning and transformation (e.g. SQL, pandas, R etc.,) to ensure data accuracy and consistency.
Proficient in building ETL pipeline (eg. SQL Server Integration services(SSIS), AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task, Eventbridge, AWS Glue , Spring)
Proficient in database design and various databases (e.g SQL, Postgre SQL,AWS S3, Athena , mongodb, Postgres/gis, mysql, sqlite, voltdb, cassandra, etc.,)
Experience in cloud technologiessuch as GPC, GCC, (i.e.,AWS, Azure, Google Cloud)
Thanks, and Best Regards
Karanam Vijaya Kiran
(EA Registration no: R1443178)
HP:+65 92333815
Recruitment Manager
Helius Technologies Pte Ltd (EA Licence No: 11C3373)
https://www.linkedin.com/in/vijay-karanam-68462131/