Data Engineer
Summary
Data Engineer at Xpand IT (Lisboa/Braga, remote possible) building large-scale data pipelines with batch and streaming processing using Java/Scala/Python, Apache Spark, Kafka and cloud data services (Azure/AWS/GCP), plus APIs for fast data querying. Portuguese and English fluency are mandatory.
Xpand IT seeks a Data Engineer to drive large-scale data processing and distributed systems. You will build robust data pipelines, implement both batch and streaming processing, and ensure high performance across the data ecosystem.
You will work with Java/Scala/Python, Spark, and cloud services, collaborating with platform engineers to deliver scalable, reliable solutions and APIs for fast data querying. Proficiency in Portuguese and English is required.
Implement batch and streaming processing solutions where performance is essential. Design data pipelines and models to optimize search and storage operations. Ensure scalability and reliability as data volume grows. Collaborate with platform engineers to integrate industry standards into production solutions. Develop APIs for high-speed data querying. Bachelor’s or Master’s degree in Computer Science or related field. Solid programming experience in Java, Scala or Python and distributed systems design patterns. Hands-on experience with Apache Spark and big-data processing frameworks. Strong knowledge of Cloud data services (Azure, AWS or Google Cloud) and Kafka event-driven architectures. Proficiency in SQL and NoSQL databases. Mandatory fluency in both Portuguese and English (written and spoken).Skills
Sign in to read and join the discussion.