Senior PySpark Data Engineer & ETL Architect
Summary
A senior data engineer designs and deploys big data applications with PySpark (SparkSQL and Spark Streaming), builds Python data pipelines, converts PowerCenter mappings to PySpark jobs, and loads data from multiple databases into Amazon S3. The role also involves graph algorithms, advanced recursion, XML/JSON handling, and REST API work.
V2 Solutions in the Philippines is seeking senior data engineering expertise to build and deploy BigData applications using SparkSQL and SparkStreaming in Python. Design and implement Python-based data pipelines, and convert PowerCenter mappings to PySpark jobs.
Create PySpark frames to load data from multiple databases into Amazon S3. Expertise in graph algorithms, advanced recursion, and handling XML/JSON documents along with REST API interactions is required.