[CUDA] Support FP8 (E4M3) KV Cache for Group Query Attention #9339
Annotations
4 warnings
|
Test ONNX Runtime (x64 / Release)
stderr: + PATH=/opt/python/cp312-cp312/bin:/opt/intel/openvino_2025.4.1/runtime/bin/intel64:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --test
2026-02-13 20:16:59,956 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available
2026-02-13 20:16:59,991 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --test
2026-02-13 20:16:59,993 build [INFO] - Build started
2026-02-13 20:16:59,993 build [DEBUG] - create symlink /data/models -> build/Release/models
2026-02-13 20:16:59,993 build [INFO] - Running tests for Release configuration
2026-02-13 20:16:59,993 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800
2026-02-13 20:33:36,439 build [INFO] - Build complete
|
|
Build ONNX Runtime (x64 / Release)
stderr: + PATH=/opt/python/cp312-cp312/bin:/opt/intel/openvino_2025.4.1/runtime/bin/intel64:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --build
2026-02-13 20:09:06,819 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available
2026-02-13 20:09:06,854 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --build
2026-02-13 20:09:06,857 build [INFO] - Build started
2026-02-13 20:09:06,857 build [INFO] - Building targets for Release configuration
2026-02-13 20:09:06,857 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16
2026-02-13 20:16:47,035 build [INFO] - Build complete
|
|
Generate Build Files (CMake) (x64 / Release)
stderr: + PATH=/opt/python/cp312-cp312/bin:/opt/intel/openvino_2025.4.1/runtime/bin/intel64:/usr/lib/jvm/msopenjdk-17/bin:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --update
2026-02-13 20:05:13,229 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available
2026-02-13 20:05:13,270 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_openvino --use_openvino CPU --enable_generic_interface --build_shared_lib --update
2026-02-13 20:05:13,273 build [INFO] - Build started
2026-02-13 20:05:13,273 build [INFO] - Generating CMake build tree
2026-02-13 20:05:13,286 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp312-cp312/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=OFF -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=OFF -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=ON -Donnxruntime_USE_CUDA_INTERFACE=ON -Donnxruntime_USE_NV_INTERFACE=ON -Donnxruntime_USE_OPENVINO_INTERFACE=ON -Donnxruntime_USE_VITISAI_INTERFACE=ON -Donnxruntime_USE_QNN_INTERFACE=ON -Donnxruntime_USE_MIGRAPHX_INTERFACE=ON -Donnxruntime_USE_MIGRAPHX=OFF -Donnxruntime_DISABLE_CONTRIB_OPS=OFF -Donnxruntime_DISABLE_ML_OPS=OFF -Donnxruntime_DISABLE_RTTI=OFF -Donnxruntime_DISABLE_EXCEPTIONS=OFF -Donnxruntime_MINIMAL_BUILD=OFF -Donnxruntime_EXTENDED_MINIMAL_BUILD=OFF -Donnxruntime_MINIMAL_BUILD_CUSTOM_OPS=OFF -Donnxruntime_REDUCED_OPS_BUILD=OFF -Donnxruntime_CLIENT_PACKAGE_BUILD=OFF -Donnxruntime_BUILD_MS_EXPERIMENTAL_OPS=OFF -Donnxruntime_ENABLE_LTO=OFF -Donnxruntime_USE_ACL=OFF -Donnxruntime_USE_ARMNN=OFF -Donnxruntime_ARMNN_RELU_USE_CPU=ON -Donnxruntime_ARMNN_BN_USE_CPU=ON -Donnxruntime_USE_JSEP=OFF -Donnxruntime_USE_WEBGPU=OFF -Donnxruntime_USE_EXTERNAL_DAWN=OFF -Donnxruntime_WGSL_TEMPLATE=static -Donnxruntime_ENABLE_NVTX_PROFILE=OFF -Donnxruntime_ENABLE_TRAINING=OFF -Donnxruntime_ENABLE_TRAINING_OPS=OFF -Donnxruntime_ENABLE_TRAINING_APIS=OFF -Donnxruntime_ENABLE_CPU_FP16_OPS=OFF -Donnxruntime_USE_NCCL=OFF -Donnxruntime_BUILD_BENCHMARKS=OFF -Donnxruntime_GCOV_COVERAGE=OFF -Donnxruntime_ENABLE_MEMORY_PROFILE=OFF -Donnxruntime_ENABLE_CUDA_LINE_NUMBER_INFO=OFF -Donnxruntime_USE_CUDA_NHWC_OPS=OFF -Donnxruntime_BUILD_WEBASSEMBLY_STATIC_LIB=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_CATCHING=ON -Donnxruntime_ENABLE_WEBASSEMBLY_API_EXCEPTION_CATCHING=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_EXCEPTION_THROWING=ON -Donnxruntime_WEBASSEMBLY_RUN_TESTS_IN_BROWSER=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_JSPI=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_THREADS=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_DEBUG_INFO=OFF -Donnxruntime_ENABLE_WEBASSEMBLY_PROFILING=OFF -Donnxruntime_ENABLE_LAZY_TENSOR=OFF -Donnxruntime_ENABLE_CUDA_PROFILING=OFF -Donnxruntime_USE_XNNPACK=OFF -Donnxruntime_USE_WEBNN=OFF -Donnxruntime_USE_CANN=OFF -Donnxruntime_DISABLE_FLOAT8_TYPES=OFF -Donnxruntime_DISABLE_FLOAT4_TYPES=OFF -Donnxruntime_DISABLE_SPARSE_TENSORS=OFF -Donnxruntime_DISABLE_OPTIONAL_TYPE=OFF -Donnxruntime_CUDA_MIN
|
|
Build Docker Image (x64 / Release)
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'.
Configure a credential helper to remove this warning. See
https://docs.docker.com/go/credential-store/
|
Loading