RQ10941 - 2 x Sr. Software Developer
Summary
The Senior Software Developer will design, develop, and maintain data pipelines and transformation procedures using Python and AWS services. This role involves working with both structured and unstructured data, utilizing tools like Informatica IDMC, and mentoring junior team members.
RQ10941 - 2 x Sr. Software Developer
2 openings - 2 different submissions
11-month contract - possible extension
ONSITE 5 days - 5700 Yonge St.
Security Level: CRJMC
Responsibilities:
1. Design, develop, test, implement, and troubleshoot:
o data pipelines using Python and AWS services (Glue, StepFunctions, Lambda)
o complex data transformation procedures
o data models for the efficient storing of data in relational databases as well as in unstructured data repositories
o re-useable classes and modules as to enhance the maintainability and ability to deliver solutions quickly.
2. Review existing code base and assist other more junior team members ensuring a consistent level of quality.
3. Assess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
MUST HAVES:
- Data engineering (pandas, pyspark)
- Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
- Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
- Extract/Transform/Load data using tools such as Informatica IDMC
Nice-to-have:
· Data processing automation
· Linux experience
· Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)
- Public sector experience