Big Data Developer
Posted 2
views
Summary
Dataflix is hiring a Big Data Developer in Irvine to design, build, and maintain scalable data pipelines, ETL, and batch/streaming solutions for large structured and unstructured datasets. Core stack: Hadoop, Spark, Hive, Kafka, SQL, Python/Scala/Java, and cloud platforms (AWS, Azure, or GCP).
Overview
We are seeking a skilled Big Data Developer with expertise in building scalable data pipelines and processing large datasets. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and data engineering best practices.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines.
- Process and transform large volumes of structured and unstructured data.
- Develop data ingestion, ETL, and batch/streaming solutions.
- Optimize data processing performance and reliability.
- Collaborate with data architects, analysts, and business stakeholders.
- Ensure data quality, governance, and security standards.
Required Skills
- 8-10 years of experience in Data Engineering or Big Data development.
- Strong experience with Hadoop, Spark, Hive, Kafka, and SQL.
- Hands-on experience with Python, Scala, or Java.
- Experience with cloud platforms such as AWS, Azure, or GCP.
- Knowledge of data warehousing and distributed computing concepts.
- Strong troubleshooting and performance tuning skills.