Data Engineer

We are looking for a Data Engineer in Portugal who's eager to embark on an exciting new opportunity!

🤩 About KWAN

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

🚀 What is this challenge about:

• Design, build, and maintain reliable, scalable data pipelines and ETL/ELT processes for production environments.
• Develop and optimize data ingestion, processing, transformation, and orchestration workflows across cloud and on-premise data platforms.
• Implement data quality frameworks, including validation, monitoring, and alerting, to ensure data integrity and reliability.
• Design and maintain data models and schemas for operational and analytical use cases, applying appropriate normalization, denormalization, and dimensional modeling techniques.
• Manage and optimize data infrastructure using Infrastructure as Code (IaC) and modern CI/CD practices.
• Troubleshoot data pipeline issues and performance bottlenecks, identifying and implementing effective optimization strategies.
• Collaborate with Data Scientists, Analytics teams, Business Intelligence stakeholders, and other technical teams to translate business requirements into scalable data solutions.
• Contribute to the design and evolution of data warehouses, data lakes, and enterprise-scale data platforms.
• Maintain technical documentation and follow best practices for development, deployment, monitoring, and data governance.
• For Senior/Lead profiles, provide technical guidance and mentorship to junior engineers and contribute to architectural decisions.

🛠 What we are looking for:

• +5 years experience building and maintaining production-grade data pipelines, with strong expertise in ETL/ELT and data orchestration.
• Strong proficiency in SQL and experience with relational and non-relational databases such as PostgreSQL, MySQL, Redis, Elasticsearch, and DynamoDB.
• Experience with cloud data warehouses and analytics platforms such as Snowflake, Amazon Redshift, BigQuery, or equivalent.
• Hands-on experience with orchestration tools such as Apache Airflow, AWS Step Functions, Luigi, or similar.
• Strong Python skills for data processing, transformation, and automation.
• Experience with AWS data services, including S3, Glue, Athena, EMR, Kinesis, Lambda, Step Functions, and RDS.
• Familiarity with big data and distributed processing technologies such as Apache Spark, Kafka, Kinesis, or Flink is a plus.
• Strong understanding of data modeling, including dimensional modeling, normalization, denormalization, and analytical schema design.
• Experience with Infrastructure as Code tools such as Terraform, CloudFormation, or Ansible.
• Experience with Git and CI/CD pipelines for data pipeline deployment and infrastructure management.
• Good knowledge of data quality, monitoring, alerting, and observability practices.
• Experience with data visualization and BI tools such as Tableau, Looker, or Grafana is a plus.
• Familiarity with monitoring platforms such as Datadog, CloudWatch, and Grafana.
• Strong problem-solving skills, with the ability to diagnose complex technical issues and optimize data pipeline performance.
• Living in Portugal (remote role).
• Fluent level of English.

✨ What we offer

• A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
• A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
• An empowering and respectful work culture enriched with social and learning events.
• A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

🙌 Some Words From Our Colleagues

“At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.”

- Luis Caldeira, DevOps @ KWAN

Grab this opportunity, apply now! 🤩