Data Engineer
Posted Updated 6
views
Summary
On-site Data Engineer in Taguig owning in-house financial data from vendors like BlackRock, Bloomberg, ICE, and BNY — designing ETL and data storage, improving ingestion with strong governance, documenting processes, and testing pipelines. Core stack: Python, SQL, with Azure, Snowflake, and Databricks as a plus.
Role: Data Engineer
Tasks/Responsibilities
- Innovative Solutions: Design and implement cutting-edge solutions across Cloud, DevOps, and Data Engineering to streamline our processes.
- Data Stewardship: Take ownership of all data managed in-house, sourced from top-tier vendors like BlackRock, Clearwater, Bloomberg, ICE, BONY, and external managers.
- Collaborative Onboarding: Partner with business units and IT together to onboard new data sources and enhance our ingestion processes.
- Process Enhancement: Continuously develop and refine data ingestion processes, emphasizing robust data governance and control mechanisms.
- Architectural Design: Play a pivotal role in designing our data storage systems and ETL processes to ensure efficiency and scalability.
- Strategic Collaboration: Work closely with AIM's GSO partner to oversee and improve manual or ad hoc data ingestion tasks.
- Comprehensive Documentation: Maintain detailed documentation of all data engineering processes and solutions to ensure clarity and continuity.
- Quality Assurance: Develop and execute rigorous test plans to guarantee the reliability and accuracy of our data pipelines and systems. Required.
Skills/Experience
- Familiar with script coding in Python and SQL.
- Experience with Azure Services, Azure Blob Storage, Snowflake and Databrick is a plus.
- Well-functioning team player and strong oral and written communicatorExcellent organizational skills with the ability to work on own initiative and follow instructions.
- Comfortable with tracing data flow and troubleshooting issues under limited
- time restriction Desired Skills/Experience.
Education
BS in Engineering, Computer Science, Information Technology degree, Data Analytics or equivalent