Fullstack Data Engineer

Challenge yourself and us

At AdvanceWorks, we learn together, grow together, and have fun together. And we do all this while creating great software solutions for clients across many industries and geographies.

We are constantly challenging ourselves and each other to use the latest technologies and the best methodologies and make sure we walk the talk.

About the project

You’ll join a small and dynamic team working on data-driven solutions within a Big Data platform in the cloud.

The project focuses on developing and operating data analysis and processing applications, turning complex datasets into reliable and valuable solutions. You’ll have the opportunity to work across the full development lifecycle, from proof of concept and architecture discussions to production deployment, monitoring, and continuous improvement.

You’ll work in an environment where software engineering, data processing, cloud technologies, and data science come together, with the opportunity to contribute to the design and evolution of data-driven solutions.

What will be your role

We are looking for a Python & Data Engineer to develop, operate, and maintain data analysis and processing applications within a Big Data platform on AWS.

You’ll work end-to-end on data-driven features, contributing to architecture discussions, defining data flows and processes, building proofs of concept, and turning them into reliable production solutions.

You’ll be expected to work autonomously and proactively, investigate problems, find practical solutions, and collaborate closely with the team to deliver robust and scalable data solutions.

Your responsibilities will include

• Developing end-to-end data analysis and processing features within a cloud-based Big Data platform.

• Designing and implementing data flows and processing solutions based on business and analytical needs.

• Actively participating in technical discussions around feature architecture, data flows, and processing approaches.

• Creating proofs of concept to validate technical approaches and potential solutions.

• Developing production-ready versions of data processing applications.

• Testing and deploying solutions across development, quality, and production environments.

• Monitoring newly deployed solutions and investigating unexpected behaviours or issues.

• Debugging applications and implementing evolutionary maintenance and improvements.

• Supporting data extraction activities and exploratory data analysis.

• Working with large and complex datasets to prepare, transform, process, and analyse data.

• Documenting the features, processes, and solutions developed.

• Collaborating with team members to identify opportunities to improve data processing workflows and solutions.

• Taking ownership of technical challenges and proactively investigating possible solutions.

• Continuously improving the reliability, efficiency, and maintainability of data-driven applications.

What should you bring to the team

• Professional hands-on experience with Python, particularly for data manipulation and processing.

• Good practical knowledge of SQL.

• Experience with software development, debugging, and troubleshooting.

• Interest in Data Science and data-driven solutions.

• Experience developing software or data processing solutions in a professional environment.

• Good understanding of programming principles and software development practices.

• Ability to work autonomously and take ownership of technical challenges.

• Strong analytical and problem-solving skills.

• Proactive mindset and willingness to investigate and find solutions independently.

• Comfortable working in a small, collaborative, and dynamic team.

• Strong interest in learning new technologies and developing new technical skills.

• Good written and spoken English communication skills.

• Availability to work in a hybrid model in Lisbon, with 2/3 days per week onsite.

Nice to have

• Professional experience with AWS cloud services, such as S3, Lambda, Athena, EC2, Glue, CDK / CloudFormation, Step Functions, Batch, or Fargate.

• Experience with Spark / PySpark.

• Familiarity with Git and version control practices.

• Experience working with Jupyter Notebooks.

• Previous experience developing and operating applications in production environments.

• Experience with cloud-based Big Data platforms and data processing architectures.

• Familiarity with data pipelines, ETL/ELT processes, or distributed data processing.

• Experience with monitoring, logging, deployment, and troubleshooting of cloud-based applications.

• Previous exposure to Data Science, Machine Learning, or advanced data analysis.

• Experience working in environments where software development and data analysis overlap.

• Previous experience working in small, autonomous, and highly collaborative technical teams.

What is in it for you

• An amazing informal culture of smart, hardworking, and friendly people who support and care about each other.

• A mentorship program from day one.

• The opportunity to work with real-world operational data from tolling and Intelligent Transportation Systems.

• The opportunity to work on large-scale data and cloud projects using modern technologies.

• Formal training and certifications in data, cloud, and engineering excellence.

• Access to cutting-edge tools and technologies.

• A dynamic company where your ideas matter more than job titles.

• Flexibility with responsibility.

• A Rubber Duck to help you debug those tricky data pipelines.

Don’t hold off any longer and apply now!

• If you have any questions, drop us a line at people@advanceworks.ai