Data Engineer
NewBe an early applicantSummary
Support the design and development of data ingestion and ETL processes within the Quantexa demo environment, utilizing Apache Spark for data integration and transformation.
Role: Data Engineer
Role Overview:
Support the design and development of data ingestion and ETL processes used within the Quantexa demo environment.
Required Skills:
- Apache Spark
- ETL development
- Data integration
- Data transformation
- Data modelling
- Elasticsearch / OpenSearch (preferred)
- Python / Scala (preferred)
Key Responsibilities:
- Participate in technical workshops with Quantexa architects.
- Support decisions around Spark execution approaches.
- Support data ingestion and ETL development activities.
- Assist with loading and preparing demonstration datasets.
- Support integration between Spark processing and Elasticsearch/OpenSearch.