Software Engineer ID45371

Software Engineer ID45371 – AgileEngine

AgileEngine is an Inc. 5000 company that creates award‑winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in application development and AI/ML, and our people‑first culture has earned us multiple Best Place to Work awards.

Why Join Us

If you’re looking for a place to grow, make an impact, and work with people who care, we’d love to meet you.

About the Role

Join our ambitious team as a Senior Software Engineer specializing in Data Engineering to develop cutting‑edge trade surveillance technology, protecting investors and ensuring market integrity. You will have a profound impact by designing and scaling robust, highly available data pipelines and microservices, tackling complex data challenges using modern tools. This unique opportunity offers significant influence and professional growth in a dynamic, collaborative environment that values accountability and a self‑starter attitude.

What You Will Do

• Design and develop microservices for the data team – Java services running on Kubernetes.
• Scale our data pipeline to support processing billions of events in both low‑latency real‑time and T+1 batch using advanced technologies like ClickHouse, Spark, and Kafka.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop and maintain our data pipeline written mostly in Java and running on Kubernetes in a micro‑service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Continuously improve how data is stored and served, optimizing queries and data formats to ensure the data is ready for consumption by a variety of clients.
• Optimize queries in our data warehouses, ensuring data completeness and reliability at scale.

MUST HAVE

• BSc. in Computer Sciences from a top university, or equivalent.
• Strong background as a software engineer with at least 3+ years experience with Java.
• Experience in data engineering and data pipeline development.
• Proven experience with relational and non‑relational DBs; expert in SQL and query optimizations – preferably in ClickHouse.
• Experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Experience in object‑oriented development; strong software engineering foundations.
• Curiosity, ability to work independently, and proactively identify solutions.
• Excellent verbal and written communication skills in a remote environment.
• Upper‑intermediate English level.

NICE TO HAVE

• Experience working in low‑latency, real‑time systems processing billions of events per day.
• Experience with cloud data‑engineering technologies such as Apache Airflow, Kubernetes, ClickHouse, Snowflake, Redis, Spark, caching technologies, and/or Kafka.

Perks and Benefits

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever‑growing skills, talent, and contributions with competitive USD‑based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top‑tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work‑life balance by having the option of working from home and going to the office – whatever makes you the happiest and most productive.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

IT Services and IT Consulting