Add the fail-notify flag to perf benchmark

[vvukomanTT]

Problem

With the switch of the release process to tt-xla, the triggering logic for fail message has to change.

Solution

Introduce a flag which defines whether the fail notification should be sent.

note: When perf benchmark is fully tested on tt-xla and we switch to it, this flag won't be used there. We will trigger fail notifications there based on what workflow called the perf benchmark. (e.g. notifications sent if perf triggered by schedule-nightly.yml)

[nsumrakTT]

Why we have fail-notify on each test suite (basic, demo, perf)? Especially on workflow_dispatch, if you dispatch workflow you won't need notification...

[vvukomanTT]

@nsumrakTT
We can't really filter on workflow disptach type since triggers from other repos are also seen as workflow_dispatchs.
This is off by default so it won't trigger messages unless someone specifies it + the workflow has to be on main.