Cloud System Engineer ( data focus)
Summary
Cloud/system engineer with a data focus in Brussels: builds and maintains a Databricks-based data platform, administers and troubleshoots databases (MySQL, MongoDB, Redis), and automates deployment and scaling of containerized apps on public cloud Kubernetes using Terraform and CI/CD pipelines, including security and incident management.
What your job looks like
-
Assist developers with database setups and structure to maintain the integrity, performance, and efficiency of the systems;
-
Troubleshoot database performance issues, and define both short and long term actions to fix structural issues
-
Setup and maintain a new data platform based on databricks
-
Automating deployment, scaling, and management of the containerized applications in a public cloud environment (e.g., setting up new infrastructure components with terraform and automated pipelines)
-
Implementation/configuration of security standards (e.g., NIST, OWASP);
-
Manage problems and (security) incidents (e.g. increased error rates in the itsme components, etc.):
-
Identifying the root causes of problems (i.e. root cause analysis at every level of the solution (application, network, infrastructure, storage)
-
Increase database/datalake knowledge in the team in general to make sure everybody in the team has the basic skills needed to troubleshoot database related incidents
-
Automate repetitive tasks that are performed manually.
-
You take ownership of your projects, reach out to your colleagues and can act as a go-to person;
-
You have an open and flexible mindset; You can easily adapt to changing contexts;
-
You have an automation mindset and are used to managing infrastructure as code.
-
You are a critical thinker and think about what the best solution is when you are asked to perform a task.
-
You are a team player who shares his/her knowledge and likes to celebrate joint achievements;
-
You are service- and customer-oriented;
-
You have strong SQL skills (query optimization, schema design, troubleshooting)
-
You have experience with MySQL administration specific on replication setups
-
You have a working knowledge of apache spark and pyspark for distributed data processing
-
Experience with azure synapse
-
Experience with databricks (workspace administration, cluster management, job orchestration)
-
Familiarity with noSQL DB's like MongoDB
-
Knowledge of Redis or alternatives
-
Experience with Kubernetes based cloud environments (compute, networking, iam, storage)
-
Knowledge of infrastructure-as-code software (e.g. terraform)
-
Plus: Knowledge of scripting languages: python, golang, ...
-
Plus: experience with Grafana observability stack
-
Plus: experience with github actions pipelines
-
You are fluent in English, and in Dutch or French.