Data Engineer
Posted Updated
Description
Responsibilities
Participate in technical workshops with Quantexa architects. Support decisions around Spark execution approaches. Support data ingestion and ETL development activities. Assist with loading and preparing demonstration datasets. Support integration between Spark processing and Elasticsearch/OpenSearch.
Requirements
Strong experience in Apache Spark. Experience in ETL development, data integration, data transformation, and data modelling. Experience with Elasticsearch / OpenSearch is preferred. Proficiency in Python and/or Scala is preferred.
Participate in technical workshops with Quantexa architects. Support decisions around Spark execution approaches. Support data ingestion and ETL development activities. Assist with loading and preparing demonstration datasets. Support integration between Spark processing and Elasticsearch/OpenSearch.
Requirements
Strong experience in Apache Spark. Experience in ETL development, data integration, data transformation, and data modelling. Experience with Elasticsearch / OpenSearch is preferred. Proficiency in Python and/or Scala is preferred.