Data Engineer
Summary
Build and maintain data pipelines and troubleshoot production issues for client projects using Python, SQL, and Spark.
Job Responsibilities:
- Provide day-to-day support (50%) for existing data pipelines, jobs, and platforms —monitoring, troubleshooting, and resolving issues to ensure smooth operations
- Design, build, and maintain (50%) scalable data pipelines and ETL/ELT workflows using Python, SQL, and Spark
- Collaborate with cross-functional and client teams to understand data requirements and translate them into technical solutions
- Perform root-cause analysis on data/pipeline issues and implement fixes with minimal downtime
- Optimize existing data workflows for performance, reliability, and cost-efficiency
- Document processes, pipeline architecture, and support runbooks for knowledge continuity
- Participate in on-call/support rotations as needed for the client engagement
- Work with Databricks and/or AWS cloud environments where applicable to build or support data solutions
Basic Qualifications:
- 2–4 years of experience in a Data Engineering role
- Strong proficiency in Python and SQL
- Hands-on experience with Apache Spark
- Prior experience working on client-based projects (mandatory)
- Ability to work across both support and development responsibilities
- Strong problem-solving and communication skills for client-facing situations
Preferred Skills:
- Experience working with Databricks
- Familiarity with AWS Cloud services (e.g., S3, Glue, EMR, Lambda, Redshift)
- Exposure to CI/CD pipelines for data engineering workflows
- Experience with workflow orchestration tools (e.g., Airflow)
Skills
As published by lever · 9 questions · 9 written answers
Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, GitHub URL, Portfolio URL
- How much is your relevant experience as a Data Engineer?
- How many years of experience do you have with SQL?
- How many years of experience do you have with Python?
- How many years of experience do you have with Spark?
- How many years of experience do you have with Databricks?
- How many years of experience do you have with AWS Cloud or any other Cloud?
- What is your total notice period?
- What is your Current CTC?
- What is your Expected CTC?