freehire launches on Product Hunt on 26 August.

Follow →

Senior Data Engineer

Summary

Design and build large-scale batch and real-time data pipelines for enterprise analytics platforms using Java, Python, SQL, Kafka, and Spark.

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

Tiger Analytics is looking for an experienced Data Engineer to design, build, and operate large-scale batch and real-time data pipelines that power enterprise data and analytics platforms.

You will work closely with Agile engineering, architecture, and product teams to build reliable, scalable data solutions spanning data ingestion, transformation, orchestration, event streaming, and downstream data delivery. The ideal candidate is someone who enjoys solving complex data engineering problems and building highly available systems that operate at enterprise scale.

Key Responsibilities:

  • Design and develop high-volume batch and real-time data pipelines for enterprise applications and analytics platforms.
  • Build end-to-end data solutions covering ingestion, transformation, orchestration, streaming, and downstream delivery.
  • Develop event-driven and real-time data processing solutions using technologies such as Kafka and Spark.
  • Build scalable data processing solutions using distributed computing frameworks such as Spark, EMR, Hadoop, or equivalent technologies.
  • Develop applications and data solutions using Java, Python, and SQL.
  • Implement and manage workflow orchestration and scheduling for complex data pipelines.
  • Work with cloud data warehouse and cloud-native data platforms to support enterprise-scale workloads.
  • Design solutions with a strong focus on reliability, scalability, performance, security, and low latency.
  • Implement secure approaches for secrets management, credentials, and service-to-service authentication in production environments.

Requirements

  • 4+ years of experience building or operating enterprise-scale data pipelines and orchestration systems.
  • 4+ years of data or application engineering experience with Java, Python, and SQL.
  • 4+ years of experience building and operating real-time or event-driven data systems.
  • 4+ years of experience with distributed data and computing technologies such as Kafka, Spark, EMR, Hadoop, or equivalent.
  • 4+ years of experience working with cloud data warehouse/data platforms at scale.
  • 4+ years of experience with at least one major cloud platform: AWS, Azure, or GCP.
  • 3+ years of experience with workflow orchestration and scheduling tools such as Airflow, Control-M, Autosys, Step Functions, or equivalent.
  • 2+ years of experience implementing secure secrets and credential management in production environments.
  • 2+ years of experience working in Agile engineering teams.
  • Strong understanding of distributed systems, data processing, and enterprise data architecture principles.
  • Familiarity with data observability, including monitoring, alerting, SLA management, pipeline health, and data quality.
  • Strong problem-solving, communication, and collaboration skills.

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy,
national origin, ancestry, marital status, protected veteran status, disability
status, or any other basis as protected by federal, state, or local law.

What this application asks

workable

First name, Last name, Email, Headline, Phone, Photo, Resume

  • What kind of US work authorization do you have (resident, visa - please specify type)? written answer
  • *Will you require Tiger Analytics to sponsor you for work authorization now or in the future? written answer
  • What is your current location? Are you open to Hybrid role in Dallas TX? written answer
  • How many years of full-time corporate work experience do you have in data engineering? written answer
  • What are your core skills in Big Data technologies? written answer
  • What is your preferred programming language? written answer
  • How many years of experience do you have working on AWS? written answer
  • Do you have experience with Databricks, If yes how many years? written answer
  • Please share a link to your LinkedIn profile (if available). written answer

See also