Reorganize monitoring documentation #617

[panta-123]

• Add figures to illustrate monitoring setup
• Add configuration examples for common monitoring tools
• Have each section for different monitoring tool.
• add note that dashboard might be outdated.
• remove some dev stuff from it as this is operator docs not development.
• Listing metrics is hard to keep track and risk of being outdated. Code search link is added.

[voetberg]

These are overall really good changes! I think it is worth it to talk about how these can be actually set up (e.g., what sort of pods should be running, what sort of infra people need to run these monitoring things, the exact executables to run a hermes daemon, etc). I am unsure if this is outside the scope of this PR though (mostly just want to call this out as something that's missing)

[panta-123]

These are overall really good changes! I think it is worth it to talk about how these can be actually set up (e.g., what sort of pods should be running, what sort of infra people need to run these monitoring things, the exact executables to run a hermes daemon, etc). I am unsure if this is outside the scope of this PR though (mostly just want to call this out as something that's missing)

I think we can add hermes daemon required and point to daemon deployment doc.
But any other infrastructure deployment strategies should not be mentioned, as they are outside the rucio docs scopes.
The available inetgration to infrastructure is already listed in doc and related config choices is mentionedin this PR.

[rdimaio]

Please fix merge conflict

[panta-123]

Please fix merge conflict

Done.