Data Engineer
Description
Please carefully review the position requirements before submitting a potential candidate for consideration.
Responsibilities:
Lead the architecture, design, and development of data warehousing solutions.
Provide technical guidance and mentorship to the data engineering team.
Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
Ensure data accuracy, integrity, and consistency across data sources.
Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
Implement and manage data warehousing solutions using Snowflake.
Utilize AWS Glue for data integration and ETL / ELT tasks.
Optimize data storage and retrieval processes to enhance performance.
Apply AI/ML concepts to extract insights from large datasets.
Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
Develop data solutions that address specific needs within these domains.
Collaborate with stakeholders to gather and analyse business requirements
Requirement:
Overall, 3 to 5 years’ experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture
BTech in Computer Science or IT
Technical expertise with data models, data mining, and segmentation techniques
Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design
Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have)
Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team
Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools
Domain expertise in Finance, Accounts, and Manufacturing.
Exposure to agile software development, and/or development management
Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines
For additional details regarding submission eligibility and payment terms, please refer to your contract. Only submissions from agencies with current service contracts in place will be considered.