Data Engineer
Posted
Summary
Data Engineer at Tata Consultancy Services (4-12 years experience, PAN India) designing, building, and maintaining scalable data pipelines and ETL/ELT frameworks for analytics, reporting, and ML use cases. Core stack: Python, SQL, Spark, cloud platforms (AWS/Azure/GCP), and tools like Databricks, Snowflake, Kafka, and Airflow.
Role: Data Engineer
Experience: 4 to 12 Years
Location: PAN India
Must Have Skills
- Strong experience in Python, SQL, and Spark
- Hands-on experience with ETL/ELT pipeline development
- Expertise in Data Modeling, Data Warehousing, and Data Lakes
- Experience with Cloud Platforms (AWS/Azure/GCP)
- Proficiency in Databricks, Hadoop, or Snowflake
- Strong knowledge of Apache Spark, Kafka, Airflow, or similar data tools
- Experience in building scalable and high-performance data pipelines
- Good understanding of CI/CD, Git, and Agile methodologies
Responsibilities
- Design, develop, and maintain scalable data pipelines.
- Build and optimize data ingestion, transformation, and processing frameworks.
- Develop data solutions for analytics, reporting, and machine learning use cases.
- Ensure data quality, governance, security, and performance optimization.
- Collaborate with cross-functional teams to deliver end-to-end data solutions.
Preferred
- Cloud certifications (AWS/Azure/GCP)
- Experience with real-time data processing and streaming technologies
- Strong communication and stakeholder management skills
Mandatory Education: 15 Years Full-Time Education.
Provide your feedback on BizChat
Show sample JD for senior roleCustomize JD for healthcare sectorTailor JD for financial services