Closed
Description
Command used:
mlc run script --tags=run-mlperf,inference,_r5.0-dev \
--model=resnet50 \
--implementation=reference \
--framework=onnxruntime \
--category=edge \
--scenario=SingleStream \
--execution_mode=valid \
--device=cpu \
--quiet
Error:
[2025-02-07 15:23:02,751 main.py:159 WARNING] - Warning: /home/junikki/MLC/repos/GATEOverflow@mlperf-automations/meta.yaml not found. Skipping...
[2025-02-07 15:23:05,136 module.py:574 INFO] - * mlcr run-mlperf,inference,_r5.0-dev
[2025-02-07 15:23:05,146 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:05,151 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,151 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:05,203 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:05,259 module.py:574 INFO] - * mlcr detect,cpu
[2025-02-07 15:23:05,275 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:05,285 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,285 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:05,312 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:05,324 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,324 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-02-07 15:23:05,449 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-02-07 15:23:05,462 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:05,469 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:05,469 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:05,469 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:05,487 module.py:574 INFO] - * mlcr get,mlcommons,inference,src
[2025-02-07 15:23:05,493 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json
[2025-02-07 15:23:05,503 module.py:574 INFO] - * mlcr get,sut,description
[2025-02-07 15:23:05,512 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:05,517 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,517 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:05,549 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:05,564 module.py:574 INFO] - * mlcr detect,cpu
[2025-02-07 15:23:05,579 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:05,585 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,585 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:05,622 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:05,637 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,637 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-02-07 15:23:05,695 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-02-07 15:23:05,710 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:05,711 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:05,712 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:05,712 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:05,725 module.py:574 INFO] - * mlcr get,compiler
[2025-02-07 15:23:05,732 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-llvm_5712a1be/mlc-cached-state.json
[2025-02-07 15:23:05,796 module.py:574 INFO] - * mlcr get,generic-python-lib,_package.dmiparser
[2025-02-07 15:23:05,816 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:05,817 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:05,817 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:05,818 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:05,818 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:05,818 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:05,984 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 5.1
[2025-02-07 15:23:06,032 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:06,033 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:06,033 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:06,034 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:06,035 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_6d752be3/mlc-cached-state.json
[2025-02-07 15:23:06,045 module.py:574 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-descriptions
[2025-02-07 15:23:06,050 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-cache-dir_1d7ae6e0/mlc-cached-state.json
Generating SUT description file for junikki-onnxruntime
[2025-02-07 15:23:06,059 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-description/customize.py
[2025-02-07 15:23:06,071 module.py:574 INFO] - * mlcr get,mlperf,inference,results,dir,_version.r5.0-dev
[2025-02-07 15:23:06,077 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/mlc-cached-state.json
[2025-02-07 15:23:06,084 module.py:574 INFO] - * mlcr install,pip-package,for-cmind-python,_package.tabulate
[2025-02-07 15:23:06,088 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/install-pip-package-for-cmind-python_bfa97df5/mlc-cached-state.json
[2025-02-07 15:23:06,095 module.py:574 INFO] - * mlcr get,mlperf,inference,utils
[2025-02-07 15:23:06,115 module.py:574 INFO] - * mlcr get,mlperf,inference,src
[2025-02-07 15:23:06,116 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json
[2025-02-07 15:23:06,120 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py
Using MLCommons Inference source from /home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference
Running loadgen scenario: SingleStream and mode: performance
[2025-02-07 15:23:06,272 module.py:574 INFO] - * mlcr app,mlperf,inference,generic,_reference,_resnet50,_onnxruntime,_cpu,_valid,_r5.0-dev_default,_singlestream
[2025-02-07 15:23:06,285 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:06,290 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:06,290 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:06,322 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:06,338 module.py:574 INFO] - * mlcr get,sys-utils-cm
[2025-02-07 15:23:06,340 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-sys-utils-cm_b9703e08/mlc-cached-state.json
[2025-02-07 15:23:06,348 module.py:574 INFO] - * mlcr get,python
[2025-02-07 15:23:06,349 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:06,350 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:06,350 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:06,370 module.py:574 INFO] - * mlcr get,mlcommons,inference,src
[2025-02-07 15:23:06,372 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json
[2025-02-07 15:23:06,379 module.py:574 INFO] - * mlcr get,mlperf,inference,utils
[2025-02-07 15:23:06,428 module.py:574 INFO] - * mlcr get,mlperf,inference,src
[2025-02-07 15:23:06,430 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json
[2025-02-07 15:23:06,434 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py
[2025-02-07 15:23:06,447 module.py:574 INFO] - * mlcr get,dataset-aux,imagenet-aux
[2025-02-07 15:23:06,449 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-dataset-imagenet-aux_f0ba00e8/mlc-cached-state.json
[2025-02-07 15:23:06,559 module.py:574 INFO] - * mlcr app,mlperf,reference,inference,_onnxruntime,_singlestream,_cpu,_resnet50,_fp32
[2025-02-07 15:23:06,575 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:06,579 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:06,579 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:06,619 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:06,636 module.py:574 INFO] - * mlcr detect,cpu
[2025-02-07 15:23:06,645 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:06,650 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:06,651 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:06,676 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:06,690 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:06,690 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-02-07 15:23:06,745 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-02-07 15:23:06,760 module.py:574 INFO] - * mlcr get,sys-utils-cm
[2025-02-07 15:23:06,761 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-sys-utils-cm_b9703e08/mlc-cached-state.json
[2025-02-07 15:23:06,776 module.py:574 INFO] - * mlcr get,python
[2025-02-07 15:23:06,777 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:06,778 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:06,778 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:06,985 module.py:574 INFO] - * mlcr get,generic-python-lib,_onnxruntime
[2025-02-07 15:23:06,998 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:06,999 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:07,000 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:07,000 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:07,000 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:07,000 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:07,093 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 1.20.1
[2025-02-07 15:23:07,109 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:07,110 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:07,111 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:07,111 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:07,111 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_ae88eefc/mlc-cached-state.json
[2025-02-07 15:23:07,186 module.py:574 INFO] - * mlcr get,ml-model,image-classification,resnet50,raw,_onnx,_fp32
[2025-02-07 15:23:07,192 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-ml-model-resnet50_6e42d8eb/mlc-cached-state.json
[2025-02-07 15:23:07,193 module.py:2234 INFO] - Path to the ML model: /home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx
[2025-02-07 15:23:07,273 module.py:574 INFO] - * mlcr get,dataset,image-classification,imagenet,preprocessed,_NCHW
[2025-02-07 15:23:07,282 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11/mlc-cached-state.json
[2025-02-07 15:23:07,303 module.py:574 INFO] - * mlcr get,dataset-aux,image-classification,imagenet-aux
[2025-02-07 15:23:07,304 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-dataset-imagenet-aux_f0ba00e8/mlc-cached-state.json
[2025-02-07 15:23:07,322 module.py:574 INFO] - * mlcr generate,user-conf,mlperf,inference
[2025-02-07 15:23:07,331 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:07,336 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:07,336 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:07,370 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:07,387 module.py:574 INFO] - * mlcr detect,cpu
[2025-02-07 15:23:07,395 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:07,401 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:07,401 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:07,428 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:07,442 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:07,443 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-02-07 15:23:07,503 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
[2025-02-07 15:23:07,535 module.py:574 INFO] - * mlcr get,python
[2025-02-07 15:23:07,539 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:07,541 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:07,541 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:07,565 module.py:574 INFO] - * mlcr get,mlcommons,inference,src
[2025-02-07 15:23:07,567 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json
[2025-02-07 15:23:07,575 module.py:574 INFO] - * mlcr get,sut,configs
[2025-02-07 15:23:07,584 module.py:574 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-configs
[2025-02-07 15:23:07,585 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-cache-dir_87e54fb9/mlc-cached-state.json
[2025-02-07 15:23:07,587 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-configs/customize.py
Using MLCommons Inference source from '/home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference'
Original configuration value 0.1 target_latency
Adjusted configuration value 0.04000000000000001 target_latency
Output Dir: '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1'
resnet50.SingleStream.target_latency = 0.04000000000000001
resnet50.SingleStream.max_duration = 660000
[2025-02-07 15:23:07,659 module.py:574 INFO] - * mlcr get,loadgen
[2025-02-07 15:23:07,663 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-loadgen_becfd7bd/mlc-cached-state.json
[2025-02-07 15:23:07,664 module.py:2234 INFO] - Path to the tool: /home/junikki/MLC/repos/local/cache/get-mlperf-inference-loadgen_becfd7bd/install
[2025-02-07 15:23:07,714 module.py:574 INFO] - * mlcr get,mlcommons,inference,src
[2025-02-07 15:23:07,717 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json
[2025-02-07 15:23:07,770 module.py:574 INFO] - * mlcr get,mlcommons,inference,src
[2025-02-07 15:23:07,772 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json
[2025-02-07 15:23:07,978 module.py:574 INFO] - * mlcr get,generic-python-lib,_package.psutil
[2025-02-07 15:23:07,991 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:07,991 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:07,992 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:07,992 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:07,993 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:07,993 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:08,094 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 6.1.1
[2025-02-07 15:23:08,113 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,114 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,114 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,115 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,115 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_eb259fd2/mlc-cached-state.json
[2025-02-07 15:23:08,324 module.py:574 INFO] - * mlcr get,generic-python-lib,_opencv-python
[2025-02-07 15:23:08,337 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,338 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,338 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,339 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,339 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:08,339 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:08,441 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 4.11.0.86
[2025-02-07 15:23:08,459 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,461 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,461 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,461 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,462 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_1791e3ac/mlc-cached-state.json
[2025-02-07 15:23:08,671 module.py:574 INFO] - * mlcr get,generic-python-lib,_numpy
[2025-02-07 15:23:08,684 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,685 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,685 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,685 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,686 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:08,686 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:08,784 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 1.26.4
[2025-02-07 15:23:08,802 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,803 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,804 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,804 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,804 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:08,805 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:08,905 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 1.26.4
[2025-02-07 15:23:08,941 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:08,945 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:08,947 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:08,947 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:08,950 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_b0eede39/mlc-cached-state.json
[2025-02-07 15:23:09,167 module.py:574 INFO] - * mlcr get,generic-python-lib,_pycocotools
[2025-02-07 15:23:09,180 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:09,181 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:09,181 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:09,182 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:09,182 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:09,182 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh
[2025-02-07 15:23:09,291 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py
Detected version: 2.0.8
[2025-02-07 15:23:09,311 module.py:574 INFO] - * mlcr get,python3
[2025-02-07 15:23:09,312 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json
[2025-02-07 15:23:09,313 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3
[2025-02-07 15:23:09,313 module.py:2234 INFO] - Python version: 3.12.3
[2025-02-07 15:23:09,314 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_1077e419/mlc-cached-state.json
Using MLCommons Inference source from '/home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference'
[2025-02-07 15:23:09,323 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/app-mlperf-inference-mlcommons-python/customize.py
[2025-02-07 15:23:09,340 module.py:574 INFO] - * mlcr benchmark-mlperf
[2025-02-07 15:23:09,349 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program-mlperf/customize.py
[2025-02-07 15:23:09,364 module.py:574 INFO] - * mlcr benchmark-program,program
[2025-02-07 15:23:09,375 module.py:574 INFO] - * mlcr detect,cpu
[2025-02-07 15:23:09,384 module.py:574 INFO] - * mlcr detect,os
[2025-02-07 15:23:09,391 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:09,391 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh
[2025-02-07 15:23:09,430 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py
[2025-02-07 15:23:09,445 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:09,445 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh
[2025-02-07 15:23:09,511 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py
***************************************************************************
CM script::benchmark-program/run.sh
Run Directory: /home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference/vision/classification_and_detection
CMD: ./run_local.sh onnxruntime resnet50 cpu --scenario SingleStream --threads 8 --user_conf '/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf' --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt 2>&1 | tee '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1/console.out'; echo \${PIPESTATUS[0]} > exitstatus
[2025-02-07 15:23:09,522 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons
[2025-02-07 15:23:09,522 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program/run-ubuntu.sh from tmp-run.sh
./run_local.sh onnxruntime resnet50 cpu --scenario SingleStream --threads 8 --user_conf '/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf' --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt 2>&1 | tee '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1/console.out'; echo ${PIPESTATUS[0]} > exitstatus
python3 python/main.py --profile resnet50-onnxruntime --model "/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx" --dataset-path /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --output "/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1" --scenario SingleStream --threads 8 --user_conf /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt
INFO:main:Namespace(dataset='imagenet', dataset_path='/home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11', dataset_list='/home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='SingleStream', max_batchsize=32, model='/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx', output='/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=8, qps=None, cache=0, cache_dir='/home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=False, find_peak_performance=False, debug=False, user_conf='/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf', audit_conf='audit.config', time=None, count=None, performance_sample_count=None, max_latency=None, samples_per_query=8)
INFO:imagenet:Loading 50000 preprocessed images using 8 threads
INFO:imagenet:loaded 50000 images, cache=0, already_preprocessed=True, took=2.2sec
INFO:main:starting TestScenario.SingleStream
./run_local.sh: line 30: 31308 Killed python3 python/main.py --profile resnet50-onnxruntime --model "/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx" --dataset-path /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --output "/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1" --scenario SingleStream --threads 8 --user_conf /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt
Traceback (most recent call last):
File "/media/junikki/research/mlcommons/mlc/bin/mlc", line 8, in <module>
sys.exit(main())
^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1414, in main
res = method(run_args)
^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run
return self.call_script_module_function("run", run_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1786, in _run
r = customize_code.preprocess(ii)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-app/customize.py", line 286, in preprocess
r = mlc.access(ii)
^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access
result = method(self, options)
^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run
return self.call_script_module_function("run", run_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1856, in _run
r = self._call_run_deps(prehook_deps, self.local_env_keys, local_env_keys_from_meta, env, state, const, const_state, add_deps_recursive,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3552, in _call_run_deps
r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps
r = self.action_object.access(ii)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access
result = method(self, options)
^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run
return self.call_script_module_function("run", run_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1872, in _run
r = prepare_and_run_script_with_postprocessing(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 5508, in prepare_and_run_script_with_postprocessing
r = script_automation._call_run_deps(posthook_deps, local_env_keys, local_env_keys_from_meta, env, state, const, const_state,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3552, in _call_run_deps
r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps
r = self.action_object.access(ii)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access
result = method(self, options)
^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run
return self.call_script_module_function("run", run_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function
result = automation_instance.run(run_args) # Pass args to the run method
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run
r = self._run(i)
^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1899, in _run
r = self._run_deps(post_deps, clean_env_keys_post_deps, env, state, const, const_state, add_deps_recursive, recursion_spaces,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps
r = self.action_object.access(ii)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access
result = method(self, options)
^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run
return self.call_script_module_function("run", run_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1175, in call_script_module_function
raise ScriptExecutionError(f"Script {function_name} execution failed. Error : {error}")
mlc.main.ScriptExecutionError: Script run execution failed. Error : MLC script failed (name = benchmark-program, return code = 35072)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Please file an issue at https://github.com/mlcommons/mlperf-automations/issues along with the full MLC command being run and the relevant
or full console log.
Metadata
Assignees
Labels
No labels