Data Engineer
Summary
A hands-on Data Engineer joining a technology team in Letterkenny (hybrid, 2-3 days onsite) to design, build and optimise data pipelines and large-scale data solutions using Python, SQL, PySpark/Apache Spark and AWS, plus data lakes, warehouses, streaming tools and CI/CD practices.
We are looking for an experienced Data Engineerto join a growing technology team in Letterkenny, working on modern data platforms and large-scale data engineering initiatives.
This is a hands-on role where you’ll be responsible for designing, developing and optimising data pipelines and data solutions that support key business and technology initiatives.
Key Responsibilities
- Build and optimise data pipelines and data integration solutions.
- Develop high-quality code using Python, SQL and PySpark/Apache Spark.
- Work with data lakes, data warehouses and database technologies.
- Develop data ingestion, transformation and real-time data solutions.
- Work with cloud technologies, ideally AWS.
- Contribute to DevOps, automation, testing and CI/CD practices.
- Help improve data quality, reliability, security and performance.
- Provide technical guidance to other engineers.
Key Skills
- Strong commercial experience in Data Engineering.
- Excellent Python and SQL skills.
- Experience with PySpark / Apache Spark.
- Experience building data pipelines and working with large datasets.
- Experience with data lakes, data warehouses and data modelling.
- AWS experience is highly desirable.
- Experience with Kafka, Kinesis, Airflow or similar is advantageous.
- Strong problem-solving and communication skills.
Microsoft Fabric is not essential. Experience with Fabric is a bonus, but strong Data Engineering experience across Python, SQL, Spark, AWS and modern data platforms will be considered.
Hybrid role with 2/3 days per week in the Letterkenny office.