Data Engineer
Posted Updated 1
view
Summary
Senior data engineer (6+ years) in Dublin building large-scale data pipelines and validation using Databricks, PySpark, the Hadoop ecosystem, and cloud platforms, plus AI-powered features with LLMs, RAG, and agentic workflows. On-site role requiring Java/Spring Boot and strong SQL skills.
- 6+ years of experience in Data Engineering, Data Quality Engineering, or Data Testing
- Hands-on experience with Databricks and PySpark
- Strong experience with Hadoop ecosystem components such as Hive, HDFS, Spark, and related Apache technologies
- Advanced SQL expertise for large-scale data validation and analysis
- Experience working with Data Warehouses, Data Lakes, and Lakehouse architectures
- Understanding of Star Schema, Snowflake Schema, and dimensional modeling
- Experience with cloud platforms (Azure, AWS, or GCP)
- Proficiency with Java, Spring Boot, RESTful APIs, Databricks, and Spark/PySpark for data pipelines
- Hands-on experience building AI-powered products using LLMs, RAG/retrieval systems, orchestration frameworks (e.g., LangChain, LlamaIndex), and tool-calling/function-calling patterns
- Strong grasp of agentic workflow concepts, including planning/reasoning loops, memory management, grounding, evaluation frameworks, safety mechanisms, and human-in-the-loop design
- 6+ years of software engineering experience building scalable, distributed systems and cloud-native applications in an agile environment
- Proven ability to lead team-level design, evaluate technical trade-offs, and translate business needs into secure, maintainable solutions
- Strong collaboration, communication, and problem-solving skills, comfortable working through ambiguity
- Bachelor's degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.