[Feature] DocSum (Performance, accuracy and stability)

[joshuayao]

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

• Create benchmark scripts for DocSum, the owner is Rantala, Valtteri:
  Added docsum service as a part of stresscli #252

• Integrate DocSum benchmark scripts to the unified benchmark in GenAIExamples, the owner is Rantala, Valtteri:
  Update GenAIExamples Benchmark script to include DocSum GenAIExamples#1724

• Automatic benchmark via CI/CD system for DocSum, the owner is Chen, Suyue
  [Task] Automatic benchmark via CI/CD system for DocSum #258

• Benchmark and analysis for Dosum, the owner is Rantala, Valtteri

The following tasks will move the next releases:

• Create benchmark scripts for CodeGen, the owner is Syrja, Harri
  [Feature] Added CodeGen as a part of stresscli #259

• Integrate CodeGen benchmark scripts to the unified benchmark in GenAIExamples, the owner is Syrja, Harri
  [Feature] Update GenAIExamples Benchmark script to include CodeGen GenAIExamples#1774

• Automatic benchmark via CI/CD system for CodeGen, the owner is Chen, Suyue
  [Task] Automatic benchmark via CI/CD system for CodeGen GenAIExamples#1775

• Benchmark and analysis for CodeGen, the owner is Syrja, Harri