Senior Data Engineer (Scala)
Summary
Senior Data Engineer (5+ years) building and owning batch and streaming data pipelines with Scala, Apache Spark, Kafka, Flink, and Airflow on AWS, including data modeling, data quality, and production reliability. Fully remote role based in India with working hours aligned to US Central Time, serving an Intellias client.
Dear Candidates,
We are hiring for a Senior Data Engineer for our client in India, Remote - US Central Timezone
Exp: 5+ years
Job Location: Remote
Work Mode: Remote
Working Hours: US Central Timezone
Notice Period: Immediate to 30 days Max
Skills Required: Data Engineer, Scala, Python, Kafka, AI, Flink, Spark, Streaming, AWS
Role:
- 5+ years of Data Engineering experience.
- Strong Scala and Apache Spark.
- Experience building and owning production ETL/ELT pipelines.
- Streaming experience with Kafka, Kafka Streams, Flink, or similar.
- Apache Airflow.
- Comfortable with Java, Scala, Python, and configuration-heavy code.
- Strong data modeling, schema design, and source-to-target mapping.
- Data quality, validation, and production troubleshooting.
- Strong software engineering practices (testing, CI/CD, versioning).
- Ability to review AI-generated code.
Strong nice-to-have
- Flink expertise.
- ScyllaDB, Cassandra, DynamoDB, or other NoSQL platforms.
- Customer Data Platform (CDP), identity resolution, loyalty, clickstream, or booking data experience.
- Experience with SLAs, SLOs, observability, and monitoring.
- GitHub Copilot, Claude, Cursor, or similar AI-assisted development tools
Responsibilities:
- Design, build, and optimize batch and streaming data pipelines using Scala and Spark.
- Develop and support Kafka/Flink-based streaming solutions.
- Build and maintain Airflow DAGs, backfills, and production workflows.
- Design data models, schemas, and source-to-target mappings.
- Implement data quality controls, validation, and monitoring.
- Troubleshoot production issues and ensure platform reliability.
- Review and validate AI-generated code and maintain engineering quality standards.
- Own systems end-to-end, including performance, cost, scalability, and reliability.
If you find above job description relevant to your profile then do DM me or forward me your resume on Ankita.Soni@intellias.com
Regards,
Ankita
Ankita.Soni@intellias.com