Description
We need a walkthrough at walkthroughs/serving-llms-on-epyc.md (and a link in walkthroughs/README.md), matching the style of the existing ones.
Goal: walk a user through serving an LLM endpoint on AMD EPYC GPUs. This walkthrough should demonstrate how using this skill is more effective for the task than not using it.
Please use the other existing walkthroughs as reference (follow the same sections)
Description
We need a walkthrough at
walkthroughs/serving-llms-on-epyc.md(and a link in walkthroughs/README.md), matching the style of the existing ones.Goal: walk a user through serving an LLM endpoint on AMD EPYC GPUs. This walkthrough should demonstrate how using this skill is more effective for the task than not using it.
Please use the other existing walkthroughs as reference (follow the same sections)