Senior Data Engineer (Python / Spark / Kafka)
Summary
Senior Data Engineer designing and scaling real-time data platforms and pipelines using Python, Java, Apache Spark, and Kafka. The role involves building distributed applications, event-driven architectures, and backend services within an Agile environment.
Everforth Apex Systems Mexico is a leading technology consulting and talent solutions firm, connecting top engineering professionals with innovative projects across global organizations. We help clients build scalable, high-performing technology solutions by providing exceptional talent and technical expertise.
Position OverviewEverforth Apex Systems Mexico is seeking a Senior Data Engineer with strong expertise in Python or Java, Apache Spark, and Kafka to design, develop, and scale real-time data platforms and customer-centric data products.
In this role, you will work within a highly collaborative engineering environment, partnering with software engineers, architects, product teams, and operations to build scalable data pipelines, real-time streaming solutions, and distributed applications. The ideal candidate is passionate about developing reliable, high-performance systems capable of handling large-scale workloads and enabling data-driven experiences across multiple products and services.
Key Responsibilities- Design, develop, and maintain scalable real-time and batch data pipelines.
- Build and optimize distributed data processing applications using Spark.
- Develop high-performance applications using Python, Java, or Scala.
- Implement event-driven architectures and streaming solutions using Kafka and Kafka Streams.
- Create reliable, scalable, and maintainable backend services and APIs.
- Build highly available systems capable of handling high-volume traffic and large-scale data processing.
- Monitor application performance and use operational metrics to drive continuous improvements.
- Participate in troubleshooting, root cause analysis, and production support activities.
- Ensure code quality through testing, code reviews, refactoring, and software engineering best practices.
- Containerize applications using Docker for cloud deployments.
- Collaborate on CI/CD processes and deployment automation.
- Leverage observability and monitoring tools to maintain system health and performance.
- Work in Agile teams with product managers, developers, and operations teams.
- Contribute to technical design discussions and architectural decisions.
- Support the implementation of scalable solutions that improve customer and business experiences.
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or equivalent experience.
- 5+ years of experience in Data Engineering, Software Engineering, or Backend Development.
- Strong programming experience in Python or Java.
- Strong experience with Apache Kafka and event-driven architectures.
- Experience designing and developing distributed systems.
- Solid understanding of backend application development and RESTful APIs.
- Experience working in Linux environments.
- Knowledge of software engineering best practices, including testing, code reviews, and CI/CD.
- Experience working within Agile development methodologies.
- Strong problem-solving and debugging skills.