Skip to content

Commit cb02159

Browse files
authored
Update llm_linux.rst - fixing model instructions
1 parent a6fe9ec commit cb02159

1 file changed

Lines changed: 10 additions & 14 deletions

File tree

docs/llm_linux.rst

Lines changed: 10 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -52,26 +52,23 @@ This page showcases an example of running LLM on RyzenAI NPU
5252
5353
deployment model_benchmark amd_genai_prompt.txt Phi-3.5-mini-instruct-onnx-ryzenai-npu
5454
55-
- Few files under Phi-3.5 Model have to be updated to make it work for Linux environment
55+
- Two files under Phi-3.5 Model have to be updated to make it work for Linux environment
5656

5757
.. code-block:: bash
5858
59-
1) vim Phi-3.5-mini-instruct-onnx-ryzenai-npu/genai_config.json
59+
1) Edit genai_config.json file under Model folder:
6060
61-
# Update line 8 to search for correct filename:
62-
"custom_ops_library": "deployment/lib/libonnx_custom_ops.so"
61+
- "custom_ops_library": "deployment/lib/libonnx_custom_ops.so" (line 8)
6362
64-
# Add a flag under line 11 as shown below:
65-
"config_entries": {
66-
"hybrid_dbg_use_aie_rope": "0",
63+
- "config_entries": {
64+
"hybrid_dbg_use_aie_rope": "0", (line 11 - Add flag under config_entries)
6765
68-
2) vim Phi-3.5-mini-instruct-onnx-ryzenai-npu/.cache/MatMulNBits_2_0_meta.json
6966
70-
# We have to update Model Json file to port originally in Windows("\\") to now Linux("/") environment.
71-
- Windows flow - "file_name": ".cache\\MatMulNBits_2_0_0.const"
72-
- Linux flow - "file_name": ".cache//MatMulNBits_2_0_0.const"
73-
74-
# Helper script
67+
2) Edit .cache/MatMulNBits_2_0_meta.json file under Model folder:
68+
69+
# Python utility script helps convert Windows-style paths in "MatMulNBits_2_0_meta.json" to Linux-style paths
70+
71+
# Python utility script
7572
import json
7673
7774
with open('Phi-3.5-mini-instruct-onnx-ryzenai-npu/.cache/MatMulNBits_2_0_meta.json','r') as f:
@@ -84,7 +81,6 @@ This page showcases an example of running LLM on RyzenAI NPU
8481
f.writelines(lines)
8582
8683
87-
8884
- Lastly, add directories for LD_LIBRARY_PATH
8985
9086
.. code-block:: bash

0 commit comments

Comments
 (0)