@@ -52,26 +52,23 @@ This page showcases an example of running LLM on RyzenAI NPU
5252
5353 deployment model_benchmark amd_genai_prompt.txt Phi-3.5-mini-instruct-onnx-ryzenai-npu
5454
55- - Few files under Phi-3.5 Model have to be updated to make it work for Linux environment
55+ - Two files under Phi-3.5 Model have to be updated to make it work for Linux environment
5656
5757.. code-block :: bash
5858
59- 1) vim Phi-3.5-mini-instruct-onnx-ryzenai-npu/ genai_config.json
59+ 1) Edit genai_config.json file under Model folder:
6060
61- # Update line 8 to search for correct filename:
62- " custom_ops_library" : " deployment/lib/libonnx_custom_ops.so"
61+ - " custom_ops_library" : " deployment/lib/libonnx_custom_ops.so" (line 8)
6362
64- # Add a flag under line 11 as shown below:
65- " config_entries" : {
66- " hybrid_dbg_use_aie_rope" : " 0" ,
63+ - " config_entries" : {
64+ " hybrid_dbg_use_aie_rope" : " 0" , (line 11 - Add flag under config_entries)
6765
68- 2) vim Phi-3.5-mini-instruct-onnx-ryzenai-npu/.cache/MatMulNBits_2_0_meta.json
6966
70- # We have to update Model Json file to port originally in Windows("\\") to now Linux("/") environment.
71- - Windows flow - " file_name " : " .cache \\ MatMulNBits_2_0_0.const "
72- - Linux flow - " file_name " : " .cache//MatMulNBits_2_0_0.const "
73-
74- # Helper script
67+ 2) Edit .cache/MatMulNBits_2_0_meta.json file under Model folder:
68+
69+ # Python utility script helps convert Windows-style paths in "MatMulNBits_2_0_meta.json" to Linux-style paths
70+
71+ # Python utility script
7572 import json
7673
7774 with open(' Phi-3.5-mini-instruct-onnx-ryzenai-npu/.cache/MatMulNBits_2_0_meta.json' ,' r' ) as f:
@@ -84,7 +81,6 @@ This page showcases an example of running LLM on RyzenAI NPU
8481 f.writelines(lines)
8582
8683
87-
8884- Lastly, add directories for LD_LIBRARY_PATH
8985
9086.. code-block:: bash
0 commit comments