Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

DXC Luxoft

Lead Pyspark Developer

Posted Updated

Description

Luxoft is seeking a senior data engineer to join a surveillance enhancement program. You will lead a data-intensive PySpark development team, design data pipelines, and optimize performance while aligning with MAR/Dodd-Frank regulations.

You will work on core Python development, integrate with PostgreSQL/other data sources, and apply Gen AI techniques to improve data processing and analytics. The role requires strong architecture skills and a proactive, collaborative approach.

Develop software applications based on business requirements. Maintain and enhance software per project specs. Participate in requirements analysis, design, development, testing, and implementation. Review requirements and propose architecture for data pipelines. 15+ years of experience in data-intensive PySpark development and performance optimization. Experience leading a development team and delivering complex data pipelines. Proven Python developer with strong OO design and testing practices. Knowledge of Gen AI in data processing and analytics. Strong DB connectivity and data loading/transformation skills. Experience with Pandas/Numpy and large-scale data wrangling.

Skills

Apply

See also