AWS Devops
Summary
A senior data engineer (listed as AWS DevOps) at TCS's Noida office who builds and maintains Databricks data pipelines on AWS, implements ingestion, quality and governance frameworks, and optimizes performance, cost and reliability. Core stack includes PySpark, Delta Lake, Unity Catalog, Structured Streaming, and AWS services like S3, Kinesis/MSK and Glue.
TCS WALKIN @NOIDA
Job Requirements*
4+ years in Data Engineering, including 3+ years with Databricks on AWS.
Strong expertise in PySpark, Spark performance tuning, and Delta Lake.
Experience with Unity Catalog, SQL, dimensional modeling, and Medallion architecture.
Hands-on with Structured Streaming, Auto Loader, CDC, and AWS services (S3, IAM, DMS, Kinesis/MSK, Glue).
Proficient in CI/CD, Git, and Databricks Asset Bundles.
Experience managing production SLAs, performance optimization, and cost management.
Strong communication, stakeholder management, and problem-solving skills.
Databricks and/or AWS certifications preferred.
Key Responsibilities*
Build and maintain Databricks data pipelines.
Implement data ingestion, quality, and governance frameworks.
Optimize performance, costs, and platform reliability.
Support deployments, monitoring, and issue resolution.
Collaborate with teams and mentor junior engineers.