Data Engineer

We are looking for a Data Platform Engineer in Portugal who's eager to embark on an exciting new opportunity!

🤩 About KWAN

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

🚀 What is this challenge about:

• Provide user support for the data platform by troubleshooting, diagnosing, and resolving technical issues.
• Support and maintain data pipelines and ETL/ELT processes to ensure reliable, scalable, and efficient data flows.
• Collaborate with platform architects to enhance the performance, security, availability, and scalability of the data platform.
• Improve platform monitoring, performance, and operational efficiency through continuous optimization.
• Support data quality frameworks and monitoring processes to ensure data accuracy, consistency, and completeness.
• Maintain and support data lakes, data warehouses, and data streaming solutions.
• Work closely with data scientists, analysts, and business stakeholders to resolve platform-related issues and support data initiatives.
• Automate repetitive operational tasks and optimize data ingestion, transformation, and delivery processes.
• Troubleshoot and optimize data workflows and SQL queries to improve performance and cost efficiency.
• Document platform changes, operational procedures, and best practices.
• Review, validate, and approve data product releases before deployment to production.

🛠 What we are looking for:

• +3 years of experience supporting and maintaining data pipelines in production environments.
• Strong hands-on experience with SQL and distributed data processing technologies such as Apache Spark.
• Practical experience troubleshooting and supporting technologies including dbt, Apache Kafka, Apache Ignite, Apache NiFi, and Apache Airflow.
• Proficiency in Python or Scala for data engineering and automation tasks.
• Experience working with AWS cloud data services.
• Familiarity with monitoring and observability tools such as Grafana.
• Good understanding of data governance, security, and compliance in cloud environments.
• Experience implementing CI/CD pipelines and testing frameworks for data workflows.
• Strong analytical and problem-solving skills with the ability to troubleshoot complex data platform issues.
• Excellent communication and collaboration skills, with experience working in cross-functional teams.
• Living in Portugal (remote role).
• Fluent level of English.

✨ What we offer

• A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
• A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
• An empowering and respectful work culture enriched with social and learning events.
• A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

🙌 Some Words From Our Colleagues

“At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.”

- Luis Caldeira, DevOps @ KWAN

Grab this opportunity, apply now! 🤩