Data Engineer: Scalable Big Data & Streaming
Summary
Data Engineer at Xpand IT (Lisboa/Braga, remote-friendly) building large-scale batch and streaming data pipelines with Java/Scala/Python, Apache Spark, Kafka, and cloud data services (AWS/Azure/GCP), plus APIs for fast data querying. Fluency in Portuguese and English is required.
Xpand IT seeks a Data Engineer to drive large-scale data processing and distributed systems. You will build robust data pipelines, implement both batch and streaming processing, and ensure high performance across the data ecosystem.
You will work with Java/Scala/Python, Spark, and cloud services, collaborating with platform engineers to deliver scalable, reliable solutions and APIs for fast data querying. Proficiency in Portuguese and English is required.
Implement batch and streaming processing solutions where performance is essential. Design data pipelines and models to optimize search and storage operations. Ensure scalability and reliability as data volume grows. Collaborate with platform engineers to integrate industry standards into production solutions. Develop APIs for high-speed data querying. Bachelor’s or Master’s degree in Computer Science or related field. Solid programming experience in Java, Scala or Python and distributed systems design patterns. Hands-on experience with Apache Spark and big-data processing frameworks. Strong knowledge of Cloud data services (Azure, AWS or Google Cloud) and Kafka event-driven architectures. Proficiency in SQL and NoSQL databases. Mandatory fluency in both Portuguese and English (written and spoken).Skills
Sign in to read and join the discussion.