Data Engineer: Hadoop & PySpark Pipelines
Posted Updated
Description
Keoni is seeking a Data Engineer to join its European team to design and implement data ingestion, transformation, and analytics pipelines. You will work with Hadoop, PySpark, Hive, SQL, and Unix/Linux shell scripting to deliver robust data solutions.
The ideal candidate has 3–6 years of experience, is autonomous, proactive, and collaborative within an international environment. Fluent English is essential for daily communication.
Implement new data ingestion processes and pipelines. Perform data preparation and transformation tasks. Develop and upgrade data pipelines using PySpark. Perform Unix/Linux shell scripting and automation. Collaborate with DevOps on platform enhancements. Maintain operational readiness and data processing workflows. Write technical specifications and document solutions. 3–6 years of Data Engineer experience in Hadoop/PySpark ecosystems. Strong knowledge in SQL, Hive, and data warehousing concepts. Proficient in Unix/Linux shell scripting and automation. Experience in data ingestion, transformation, and pipeline development.Skills
Sign in to read and join the discussion.