Data Engineer
Posted Updated
Description
LPL Financials Hyderabad seeks a skilled Data Engineer to design and maintain distributed data pipelines on AWS, using Spark, Python, and modern DevOps practices. You will craft event-driven data solutions, APIs, and scalable data services, collaborating across teams to ensure reliability and performance.
The role emphasizes end-to-end data quality, monitoring, and auditability, with opportunities to implement near real-time data processing and cloud-native architectures.
Design, develop, and maintain distributed data pipelines on AWS at scale. Ingest, process, and deliver data using batch and event-driven patterns. Build event-driven data solutions with asynchronous architectures for near real-time processing. Ensure end-to-end data quality with validation, monitoring, lineage, and orchestration. Design and develop RESTful and event-driven APIs for data exposure. Build and deploy data services using Docker and manage workloads on Kubernetes. Collaborate with data consumers, architects, platform teams, and business stakeholders. Contribute to monitoring, logging, alerting, and incident response for data platforms. BE in Computer Science, Engineering, or equivalent practical experience. 5+ years of experience in data engineering or distributed systems development. Strong hands-on experience with AWS cloud services. Advanced proficiency in Python. Hands-on experience with Apache Spark and AWS services such as Glue, Lambda, Step Functions, EventBridge, S3, Athena, RDS Aurora PostgreSQL. Experience building event-driven data pipelines.Skills
Sign in to read and join the discussion.