Data engineer for cloud-native systems
Summary
Senior Data Engineer (Snowflake) building modern, cloud-native data pipelines and data products on AWS or Azure using Python and SQL. Day to day: develop batch/streaming pipelines, model data, ensure performance and testability, and support data governance in an Agile/Scrum team (hybrid, 2 office days/week in Portugal).
Описание: At iU Talent, we believe that true success comes from the perfect combination of happy people, genuine talent, unwavering commitment and the power of technology. We are currently recruiting Senior Data Engineers (Snowflake) (m/f/d) to join an international team focused on developing modern, scalable and cloud-native data solutions. If you have experience with AWS or Azure, Python and SQL, and enjoy building high-performance data pipelines, this could be an excellent opportunity to be part of high-impact technology projects. You will be part of an Agile/Scrum team, collaborating with Data Analysts and other technical teams to develop, optimize and maintain data products.
Задачи:
- Develop and implement data pipelines in an AWS or Azure environment
- Build batch and streaming solutions with monitoring and alerts
- Model data and develop database objects (views, tables, procedures and scripts)
- Ensure the quality, performance and scalability of solutions
- Implement functional and non-functional tests
- Support Data Governance and metadata management initiatives
- Collaborate on incident resolution and the continuous improvement of products
Требования:
- Bachelor's degree in Engineering or a similar field
- Experience with Snowflake
- Solid experience in Data Engineering in an AWS or Azure environment
- Strong command of SQL and development of complex queries
- Experience with Python and libraries such as Pandas and Boto3
- Knowledge of data platform architecture and Data Governance principles
- Fluent English.
- A valid work permit for Portugal is mandatory.
- Будет плюсом:
- Knowledge of dbt Core
- CI/CD
- Orchestration tools such as Airflow, Step Functions or Prefect
- GitHub or GitLab
- Infrastructure as Code (Terraform or CloudFormation)
- Tableau or other visualization tools
- AWS and/or Snowflake certifications
Условия:
- Hybrid model (2 days per week in the office)
- Flexible working hours
- Modern technology environment focused on engineering best practices
- State-of-the-art equipment
- Collaborative culture focused on knowledge sharing, innovation and continuous improvement
- Opportunity to contribute to technical decisions and have a real impact on projects
- Monthly base salary + Coverflex Meal allowance: €9.60 / day