DataOps & Observability Engineer
Posted
Description
We are looking for a DataOps & Observability Engineer to join a challenging project, helping improve data observability capabilities, automate operational processes and ensure greater visibility across complex data ecosystems.
What will you do?
- Develop and continuously improve Data Observability capabilities across multiple platforms and environments, including cloud and legacy systems.
- Implement monitoring mechanisms to track data pipelines and orchestration activities.
- Develop automation workflows using DiFy, an ITOps platform focused on process automation and AI Agent development.
- Develop and maintain monitoring dashboards using OpenSearch and ELK technologies.
- Work with different teams to gather requirements, prioritize needs and support the adoption of new tools and platforms.
- Organize workshops and knowledge-sharing sessions to promote tool awareness and user enablement.
What are we looking for?
- Experience with Python, particularly FastAPI and/or Flask.
- Knowledge of Google Cloud Platform (GCP), namely Cloud Run, BigQuery, Firestore and Google Cloud Storage (GCS).
- Experience with Apache Airflow and data pipeline orchestration.
- Knowledge of OpenSearch, Elasticsearch and/or Kibana.
- Experience using GitHub.
- Strong problem-solving and automation skills.
- Good communication skills and the ability to collaborate with different technical teams.
Nice to Have
- Experience delivering technical workshops, facilitating knowledge-sharing sessions and supporting users throughout the onboarding and adoption of new tools.
Skills
Sign in to read and join the discussion.