Deprecated backend `sendnn_decoder`,

[rzbhatti]

When using the model.compile(backend="sendnn_decoder") the backend shows the following warning:

You're using a deprecated backend. Please use sendnn in conjunction with warmup_mode

This is because we are not warming up using warmup_mode with backend=“sendnn”, it should be done as following:

model.forward = torch.compile(model.forward, backend = "sendnn", dynamic=False)

# warmup
with torch_sendnn.warmup_mode():
     generate(model, ...)

It is currently being used in the following locations:

aiu-fms-testing-utils/scripts/inference.py

Line 467 in 6e7e360

model.compile(backend="sendnn_decoder")

aiu-fms-testing-utils/scripts/validation.py

Line 465 in 6e7e360

model.compile(backend="sendnn_decoder")

aiu-fms-testing-utils/tests/models/test_decoders.py

Line 336 in 6e7e360

model.compile(backend="sendnn_decoder")

[flaviabeo]

Hi! I can work on this - add me as assignee, please :)