gim_alloc_dma_mem:1118 Allocate iova method memory failed. #8
Description
Test environment:
- gim-dkms-8.1.0.K-0.noarch
- both MI210 and MI300X
How I compile the GIM driver:
- git clone https://github.com/amd/MxGPU-Virtualization.git ~/MxGPU-Virtualization
- cd ~/MxGPU-Virtualization && rpmbuild -y --quiet -bb --build-in-place ./package/rpm/gim-dkms.spec
- yum -y install ~/rpmbuild/RPMS//
How I reproduce this issue:
- create AMD MxGPU devices based on MI210 or MI300X
# modprobe gim
- remove the AMD MxGPU devices
# modprobe -r gim
- repeat the above test steps if this issue is not reproduced
- check the host dmesg
# dmesg -l err
[ 428.831197] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.831331] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.835557] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.835562] [gim][gim_alloc_dma_mem:1121] Allocate system memory failed (length: 16777216)!
[ 428.835566] gim error libgv: [0:f:0:0][mi200_migration_sw_init:310] Failed to initialize migration data memory.
[ 428.837418] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.837430] [gim][gim_alloc_dma_mem:1121] Allocate system memory failed (length: 16777216)!
[ 428.837438] gim error libgv: [0:b7:0:0][mi200_migration_sw_init:310] Failed to initialize migration data memory.
The above gim errors are generated when running "modprobe gim" and the full related dmesg is as following:
# dmesg
...
[ 427.578254] gim: loading out-of-tree module taints kernel.
[ 427.581164] gim: module verification failed: signature and/or required key missing - tainting kernel
[ 427.710283] gim info:(gim_init:658) Start AMD open source GIM initialization
[ 427.710287] gim info:(gim_init:660) GPU IOV MODULE - version 8.1.0.K
[ 427.710288] gim info:(gim_init:663) Copyright (c) 2014-2025 Advanced Micro Devices, Inc.
[ 428.815417] gim info:(gim_conf_save:822) configurations:
vf_num=1
accelerator_partition_mode=0
memory_partition_mode=9
[ 428.815611] gim info:(gim_conf_init:1028) INIT CONFIG
[ 428.815613] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: map_framebuffer
[ 428.815614] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: unmap_framebuffer
[ 428.815615] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: pause_timer
[ 428.815625] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: get_random_bytes
[ 428.815626] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: create_hash_64
[ 428.815628] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: get_ih_rb_info
[ 428.815629] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: get_device_numa_node
[ 428.815629] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: notify_shim_ext
[ 428.815630] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: map_queue
[ 428.815630] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: bh_init
[ 428.815631] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: bh_queue
[ 428.815632] gim info libgv: [amdgv_init_ex:270] warn: no implementation for interface: bh_fini
[ 428.815632] gim info libgv: [amdgv_init_ex:286] module loaded - libgv 8.1.0
[ 428.817529] gim info:(gim_probe:481) AMD GIM start to probe device 0000:0f:00.0
[ 428.817816] gim info:(gim_probe:481) AMD GIM start to probe device 0000:b7:00.0
[ 428.830683] gim info:(b7:00.0)(gim_import_data:344) live update is skipped
[ 428.830690] gim info:(0f:00.0)(gim_import_data:344) live update is skipped
[ 428.831070] gim info libgv: [0:b7:0:0][amdgv_debug_set_mode:111] LibGV Debug mode set to 0x0
[ 428.831073] gim info libgv: [0:b7:0:0][amdgv_parse_config_opt:1086] Dynamic time slice disabled.
[ 428.831075] gim info libgv: [0:b7:0:0][amdgv_parse_config_opt:1088] 1 VF will be enabled.
[ 428.831112] gim info libgv: [0:f:0:0][amdgv_debug_set_mode:111] LibGV Debug mode set to 0x0
[ 428.831117] gim info libgv: [0:f:0:0][amdgv_parse_config_opt:1086] Dynamic time slice disabled.
[ 428.831119] gim info libgv: [0:f:0:0][amdgv_parse_config_opt:1088] 1 VF will be enabled.
[ 428.831173] gim info:(gim_alloc_dma_mem_iova:999) DMA buffers not contiguous
[ 428.831197] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.831300] gim info:(gim_alloc_dma_mem_iova:999) DMA buffers not contiguous
[ 428.831331] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.831600] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_vbios_early_func
[ 428.831700] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_vbios_early_func
[ 428.831721] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_mem_func
[ 428.831730] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_ucode_func
[ 428.831733] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_psp_func
[ 428.831750] gim info libgv: [0:b7:0:0][amdgv_psp_tmr_init:1199] TMR: GPU_ADDR=0xfffffffff8000000 MEM_ADDR=0x8000000 MEM_SIZE=0x8000000
[ 428.831781] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_mem_func
[ 428.831784] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_smu_func
[ 428.831787] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_ucode_func
[ 428.831789] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_psp_func
[ 428.831803] gim info libgv: [0:f:0:0][amdgv_psp_tmr_init:1199] TMR: GPU_ADDR=0xfffffffff8000000 MEM_ADDR=0x8000000 MEM_SIZE=0x8000000
[ 428.831806] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_vbios_late_func
[ 428.831811] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_df_func
[ 428.831816] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_ecc_func
[ 428.831842] gim info libgv: [0:b7:0:0][amdgv_ras_eeprom_sw_init:138] Using legacy EEPROM format.
[ 428.831843] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_smu_func
[ 428.831846] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gpuiov_func
[ 428.831855] gim info libgv: [0:b7:0:0][amdgv_gpuiov_ctrl_block_setup:1306] Discovered 4 HW schedulers
[ 428.831859] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_vbios_late_func
[ 428.831860] gim info libgv: [0:b7:0:0][amdgv_gpuiov_ctrl_block_setup:1316] GFX sched mode 0 is not supported on current asic
[ 428.831861] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_df_func
[ 428.831863] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_doorbell_func
[ 428.831864] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_ecc_func
[ 428.831870] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_xgmi_func
[ 428.831874] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_irqmgr_func
[ 428.831876] gim info libgv: [0:f:0:0][amdgv_ras_eeprom_sw_init:138] Using legacy EEPROM format.
[ 428.831879] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gpuiov_func
[ 428.831882] gim warning libgv: [0:b7:0:0][amdgv_ih_ring_init:152] Not support bottom-half or bh_init failure, revert to legacy interrupt handler
[ 428.831884] gim info libgv: [0:f:0:0][amdgv_gpuiov_ctrl_block_setup:1306] Discovered 4 HW schedulers
[ 428.831886] gim info libgv: [0:f:0:0][amdgv_gpuiov_ctrl_block_setup:1316] GFX sched mode 0 is not supported on current asic
[ 428.831888] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_doorbell_func
[ 428.831890] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_xgmi_func
[ 428.831892] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_irqmgr_func
[ 428.831895] gim warning libgv: [0:f:0:0][amdgv_ih_ring_init:152] Not support bottom-half or bh_init failure, revert to legacy interrupt handler
[ 428.832227] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_mailbox_func
[ 428.832230] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_reset_func
[ 428.832231] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_powerplay_func
[ 428.832233] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gpumon_func
[ 428.832234] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_misc_func
[ 428.832236] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of amdgv_vfmgr_func
[ 428.832242] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_sched_func
[ 428.832245] gim info libgv: [0:f:0:0][amdgv_sched_init:112] Number of VFs per GFX scheduler block: 0x1
[ 428.832256] gim info libgv: [0:f:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[0] type=UVD hw_sched_mask=0x1
[ 428.832259] gim info libgv: [0:f:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[1] type=GFX hw_sched_mask=0x4
[ 428.832260] gim info libgv: [0:f:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[2] type=UVD1 hw_sched_mask=0x8
[ 428.832264] gim info libgv: [0:f:0:0][amdgv_sched_manual_switch_init:897] enable fair scheduling mode for GFX scheduler
[ 428.832297] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_mailbox_func
[ 428.832303] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_reset_func
[ 428.832306] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_powerplay_func
[ 428.832310] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gpumon_func
[ 428.832313] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_misc_func
[ 428.832317] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of amdgv_vfmgr_func
[ 428.832331] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_sched_func
[ 428.832335] gim info libgv: [0:b7:0:0][amdgv_sched_init:112] Number of VFs per GFX scheduler block: 0x1
[ 428.832352] gim info libgv: [0:b7:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[0] type=UVD hw_sched_mask=0x1
[ 428.832357] gim info libgv: [0:b7:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[1] type=GFX hw_sched_mask=0x4
[ 428.832360] gim info libgv: [0:b7:0:0][amdgv_sched_world_switch_init_sw_config:1592] Created world_switch[2] type=UVD1 hw_sched_mask=0x8
[ 428.832367] gim info libgv: [0:b7:0:0][amdgv_sched_manual_switch_init:897] enable fair scheduling mode for GFX scheduler
[ 428.832459] gim info libgv: [0:b7:0:0][amdgv_sched_event_queue_process_init:3730] allowed time for full access is 3000ms
[ 428.832501] gim info libgv: [0:f:0:0][amdgv_sched_event_queue_process_init:3730] allowed time for full access is 3000ms
[ 428.832516] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_diag_data_func
[ 428.832660] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_diag_data_func
[ 428.832714] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_live_migration_func
[ 428.832716] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_live_migration_func
[ 428.835006] gim info:(gim_alloc_dma_mem_iova:999) DMA buffers not contiguous
[ 428.835557] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.835558] gim info:(gim_alloc_dma_mem_system:1031) Please enlarge MAX_ORDER from 10 to 12 to alloc 16MB pysical contiguous system memory
[ 428.835562] [gim][gim_alloc_dma_mem:1121] Allocate system memory failed (length: 16777216)!
[ 428.835563] gim warning libgv: [0:f:0:0][mi200_migration_mem_init:85] Failed to allocate 16MB continuous dma memory
[ 428.835566] gim error libgv: [0:f:0:0][mi200_migration_sw_init:310] Failed to initialize migration data memory.
[ 428.835570] gim info libgv: [0:f:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gfx_func
[ 428.836266] gim info libgv: [0:f:0:0][amdgv_device_internal_init:1792] IP Discovery Size being used: 2048
[ 428.836269] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_vbios_early_func
[ 428.836321] gim info:(gim_alloc_dma_mem_iova:999) DMA buffers not contiguous
[ 428.836495] gim info libgv: [0:f:0:0][mi200_vbios_read_rom_from_reg:93] Reading VBios from ROM
[ 428.836528] gim info libgv: [0:f:0:0][mi200_vbios_read_rom_from_reg:93] Reading VBios from ROM
[ 428.837418] [gim][gim_alloc_dma_mem:1118] Allocate iova method memory failed.
[ 428.837422] gim info:(gim_alloc_dma_mem_system:1031) Please enlarge MAX_ORDER from 10 to 12 to alloc 16MB pysical contiguous system memory
[ 428.837430] [gim][gim_alloc_dma_mem:1121] Allocate system memory failed (length: 16777216)!
[ 428.837434] gim warning libgv: [0:b7:0:0][mi200_migration_mem_init:85] Failed to allocate 16MB continuous dma memory
[ 428.837438] gim error libgv: [0:b7:0:0][mi200_migration_sw_init:310] Failed to initialize migration data memory.
[ 428.837447] gim info libgv: [0:b7:0:0][amdgv_device_func_sw_init:1302] start sw_init of mi200_gfx_func
[ 428.840736] gim info libgv: [0:b7:0:0][amdgv_device_internal_init:1792] IP Discovery Size being used: 2048
[ 428.840741] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_vbios_early_func
[ 428.840984] gim info libgv: [0:b7:0:0][mi200_vbios_read_rom_from_reg:93] Reading VBios from ROM
[ 428.841024] gim info libgv: [0:b7:0:0][mi200_vbios_read_rom_from_reg:93] Reading VBios from ROM
[ 428.841938] gim info libgv: [0:f:0:0][amdgv_vbios_print_vbios_header_info:387] vbios starts: 0x55, 0xaa
[ 428.841944] gim info libgv: [0:f:0:0][amdgv_vbios_print_vbios_header_info:390] vbios version major 0x14 minor 0x28
[ 428.841953] gim info libgv: [0:f:0:0][amdgv_vbios_get_info:129] found anchor at 1131
[ 428.841957] gim info libgv: [0:f:0:0][amdgv_vbios_get_info:141] build num: 613661
[ 428.841959] gim info libgv: [0:f:0:0][amdgv_vbios_get_info:144] part info: AMD_MI200_D67301_XT_A1_HBM2E_64GB_SRIOV
[ 428.841962] gim info libgv: [0:f:0:0][amdgv_vbios_get_info:146] build date: 12/01/22,17:18
[ 428.844990] gim info libgv: [0:b7:0:0][amdgv_vbios_print_vbios_header_info:387] vbios starts: 0x55, 0xaa
[ 428.844994] gim info libgv: [0:b7:0:0][amdgv_vbios_print_vbios_header_info:390] vbios version major 0x14 minor 0x28
[ 428.845000] gim info libgv: [0:b7:0:0][amdgv_vbios_get_info:129] found anchor at 1131
[ 428.845003] gim info libgv: [0:b7:0:0][amdgv_vbios_get_info:141] build num: 613661
[ 428.845005] gim info libgv: [0:b7:0:0][amdgv_vbios_get_info:144] part info: AMD_MI200_D67301_XT_A1_HBM2E_64GB_SRIOV
[ 428.845007] gim info libgv: [0:b7:0:0][amdgv_vbios_get_info:146] build date: 12/01/22,17:18
[ 428.943754] gim info libgv: ATOM BIOS: 113-D67301V-073
[ 428.943762] gim info libgv: [0:f:0:0][mi200_vbios_need_post:70] BIOS_SCRATCH_7 = 0x00000000
[ 428.943769] gim info libgv: [0:f:0:0][mi200_vbios_need_post:79] ATOM_ASIC_NEED_POST
[ 428.943773] gim info libgv: [0:f:0:0][amdgv_atomfirmware_post:200] Do a asic init
[ 428.943805] gim info libgv: atom post costs 28 usec
[ 428.943808] gim info libgv: [0:f:0:0][mi200_vbios_early_hw_init:499] VBIOS posted successfully.
[ 428.943816] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_mem_func
[ 428.943828] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_ucode_func
[ 428.943831] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_psp_func
[ 428.945367] gim info libgv: [0:f:0:0][psp_v13_load_key_db:124] PSP: Key DB(version:0.0.0.0) is loaded.
[ 428.947735] gim info libgv: [0:f:0:0][psp_v13_load_sysdrv:161] PSP: SYS(version:0.27.0.85) is loaded.
[ 428.951744] gim info libgv: ATOM BIOS: 113-D67301V-073
[ 428.951752] gim info libgv: [0:b7:0:0][mi200_vbios_need_post:70] BIOS_SCRATCH_7 = 0x00000000
[ 428.951759] gim info libgv: [0:b7:0:0][mi200_vbios_need_post:79] ATOM_ASIC_NEED_POST
[ 428.951764] gim info libgv: [0:b7:0:0][amdgv_atomfirmware_post:200] Do a asic init
[ 428.951794] gim info libgv: atom post costs 26 usec
[ 428.951797] gim info libgv: [0:b7:0:0][mi200_vbios_early_hw_init:499] VBIOS posted successfully.
[ 428.951806] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_mem_func
[ 428.951818] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_ucode_func
[ 428.951821] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_psp_func
[ 428.953352] gim info libgv: [0:b7:0:0][psp_v13_load_key_db:124] PSP: Key DB(version:0.0.0.0) is loaded.
[ 428.955706] gim info libgv: [0:b7:0:0][psp_v13_load_sysdrv:161] PSP: SYS(version:0.27.0.85) is loaded.
[ 429.055658] gim info libgv: [0:f:0:0][psp_v13_load_sos:201] PSP: OS(version:0.27.0.85) is loaded.
[ 429.062211] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SMU(68.65.0)
[ 429.063354] gim info libgv: [0:f:0:0][psp_v13_set_mb_int:374] psp mailbox disabled for VF0
[ 429.063660] gim info libgv: [0:b7:0:0][psp_v13_load_sos:201] PSP: OS(version:0.27.0.85) is loaded.
[ 429.066716] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA0(version:8)
[ 429.070058] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA1(version:8)
[ 429.070172] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SMU(68.65.0)
[ 429.071333] gim info libgv: [0:b7:0:0][psp_v13_set_mb_int:374] psp mailbox disabled for VF0
[ 429.073390] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA2(version:8)
[ 429.074687] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA0(version:8)
[ 429.076700] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA3(version:8)
[ 429.078035] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA1(version:8)
[ 429.080023] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA4(version:8)
[ 429.081315] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA2(version:8)
[ 429.082972] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_GPM(version:0)
[ 429.084600] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA3(version:8)
[ 429.085998] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_SRM(version:0)
[ 429.087946] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded SDMA4(version:8)
[ 429.088946] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_CNTL(version:0)
[ 429.090919] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_GPM(version:0)
[ 429.092126] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_G(version:17)
[ 429.093956] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_SRM(version:0)
[ 429.095213] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_V(version:13)
[ 429.096893] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_SRLIST_CNTL(version:0)
[ 429.098386] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded MMSCH(version:0x600000a)
[ 429.100080] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_G(version:17)
[ 429.101657] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded Register WhiteList (version:a1.0.1c.0)
[ 429.103174] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded RLC_V(version:13)
[ 429.104701] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded DFC(version:0.1.0.1)
[ 429.106318] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded MMSCH(version:0x600000a)
[ 429.109602] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded Register WhiteList (version:a1.0.1c.0)
[ 429.110264] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded CP_MEC1(version:32837)
[ 429.112639] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded DFC(version:0.1.0.1)
[ 429.113267] gim info libgv: [0:f:0:0][amdgv_psp_load_np_fw:1797] loaded CP_MEC1_JT(version:32837)
[ 429.113272] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_smu_func
[ 429.113294] gim info libgv: [0:f:0:0][mi200_smu_13_0_read_pptable_from_vbios:786] VBIOS PPLIB_PPTABLE_ID = 2524
[ 429.113296] gim info libgv: [0:f:0:0][mi200_smu_13_0_read_pptable_from_vbios:790] overwrite pptable id to 0, to force using vbios's pptable
[ 429.113302] gim info libgv: atom post costs 3 usec
[ 429.113456] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_vbios_late_func
[ 429.113484] gim info libgv: [0:f:0:0][mi200_mc_location_setting:319] MC base is at 0x20000000000
[ 429.113499] gim info libgv: [0:f:0:0][amdgv_atomfirmware_update_checksum:44] update guest vbios checksum to 0xd7
[ 429.113599] gim info libgv: [0:f:0:0][mi200_enable_pci_atomic_request:142] Atomic Request Enabled
[ 429.113604] gim info libgv: [0:f:0:0][mi200_disable_pci_aer:167] Disable pci aer
[ 429.113606] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_df_func
[ 429.113607] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_ecc_func
[ 429.113608] gim warning libgv: [0:f:0:0][mi200_ecc_hw_init:157] RAS ECC is not supported
[ 429.113610] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gpuiov_func
[ 429.113627] gim info libgv: [0:f:0:0][amdgv_gpuiov_init:1334] allowed time for gpuiov cmd completion is 500ms
[ 429.113631] gim info libgv: [0:f:0:0][mi200_gpuiov_get_fb_info:740] Total FB Available = 65520 MB, Max usable FB size = 65360 MB
[ 429.113640] gim info libgv: [0:f:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ac UVD_SCH0_MMSCH block offset = 0xc0
[ 429.113643] gim info libgv: [0:f:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ad VCE_SCH0_MMSCH block offset = 0x0
[ 429.113646] gim info libgv: [0:f:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ae GFX_SCH0_RLCV block offset = 0x120
[ 429.113648] gim info libgv: [0:f:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5af UVD_SCH1_MMSCH block offset = 0x150
[ 429.118222] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded CP_MEC1(version:32837)
[ 429.121233] gim info libgv: [0:b7:0:0][amdgv_psp_load_np_fw:1797] loaded CP_MEC1_JT(version:32837)
[ 429.121239] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_smu_func
[ 429.121256] gim info libgv: [0:b7:0:0][mi200_smu_13_0_read_pptable_from_vbios:786] VBIOS PPLIB_PPTABLE_ID = 2524
[ 429.121257] gim info libgv: [0:b7:0:0][mi200_smu_13_0_read_pptable_from_vbios:790] overwrite pptable id to 0, to force using vbios's pptable
[ 429.121262] gim info libgv: atom post costs 2 usec
[ 429.121396] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_vbios_late_func
[ 429.121419] gim info libgv: [0:b7:0:0][mi200_mc_location_setting:319] MC base is at 0x20000000000
[ 429.121433] gim info libgv: [0:b7:0:0][amdgv_atomfirmware_update_checksum:44] update guest vbios checksum to 0xd7
[ 429.121513] gim info libgv: [0:b7:0:0][mi200_enable_pci_atomic_request:142] Atomic Request Enabled
[ 429.121517] gim info libgv: [0:b7:0:0][mi200_disable_pci_aer:167] Disable pci aer
[ 429.121518] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_df_func
[ 429.121519] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_ecc_func
[ 429.121521] gim warning libgv: [0:b7:0:0][mi200_ecc_hw_init:157] RAS ECC is not supported
[ 429.121522] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gpuiov_func
[ 429.121534] gim info libgv: [0:b7:0:0][amdgv_gpuiov_init:1334] allowed time for gpuiov cmd completion is 500ms
[ 429.121537] gim info libgv: [0:b7:0:0][mi200_gpuiov_get_fb_info:740] Total FB Available = 65520 MB, Max usable FB size = 65360 MB
[ 429.121544] gim info libgv: [0:b7:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ac UVD_SCH0_MMSCH block offset = 0xc0
[ 429.121546] gim info libgv: [0:b7:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ad VCE_SCH0_MMSCH block offset = 0x0
[ 429.121549] gim info libgv: [0:b7:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5ae GFX_SCH0_RLCV block offset = 0x120
[ 429.121551] gim info libgv: [0:b7:0:0][mi200_gpuiov_get_sch_offset:769] pci offset = 0x5af UVD_SCH1_MMSCH block offset = 0x150
[ 429.215696] pci 0000:0f:02.0: [1002:7410] type 00 class 0x038000
[ 429.215718] pci 0000:0f:02.0: enabling Extended Tags
[ 429.216765] pci 0000:0f:02.0: Adding to iommu group 220
[ 429.216943] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_doorbell_func
[ 429.216949] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_xgmi_func
[ 429.216953] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_irqmgr_func
[ 429.216972] gim info libgv: [0:f:0:0][mi200_ih_iv_ring_hw_init:306] rb_base_addr=0x2000003b000
[ 429.216983] gim info libgv: [0:f:0:0][mi200_ih_iv_ring_hw_init:355] writeback_addr=0x2000004b000
[ 429.217000] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_mailbox_func
[ 429.217008] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_reset_func
[ 429.217010] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_powerplay_func
[ 429.223691] pci 0000:b7:02.0: [1002:7410] type 00 class 0x038000
[ 429.223714] pci 0000:b7:02.0: enabling Extended Tags
[ 429.224789] pci 0000:b7:02.0: Adding to iommu group 221
[ 429.225003] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_doorbell_func
[ 429.225010] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_xgmi_func
[ 429.225014] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_irqmgr_func
[ 429.225033] gim info libgv: [0:b7:0:0][mi200_ih_iv_ring_hw_init:306] rb_base_addr=0x2000003b000
[ 429.225047] gim info libgv: [0:b7:0:0][mi200_ih_iv_ring_hw_init:355] writeback_addr=0x2000004b000
[ 429.225066] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_mailbox_func
[ 429.225074] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_reset_func
[ 429.225078] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_powerplay_func
[ 429.238499] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1520] SMU Feature Enabled: DATA
[ 429.238501] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1523] SMU Feature Enabled: GFX DPM
[ 429.238503] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1529] SMU Feature Enabled: UCLK DPM
[ 429.238505] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1532] SMU Feature Enabled: SOC CLK DPM
[ 429.238506] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1538] SMU Feature Enabled: LCLK DPM
[ 429.238508] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1556] SMU Feature Enabled: GFX CLK SPREAD SPECTRUM
[ 429.238509] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1559] SMU Feature Enabled: VCN DPM
[ 429.238510] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1562] SMU Feature Enabled: RSMU SMN CLOCK GATING
[ 429.238512] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1565] SMU Feature Enabled: WAFL CLOCK GATING
[ 429.238513] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1568] SMU Feature Enabled: FUSE CLOCK GATING
[ 429.238514] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1571] SMU Feature Enabled: MP1 CLOCK GATING
[ 429.238515] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1574] SMU Feature Enabled: SMUIO CLOCK GATING
[ 429.238517] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1577] SMU Feature Enabled: THERMAL CLOCK GATING
[ 429.238519] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1580] SMU Feature Enabled: CLK CLOCK GATING
[ 429.238520] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1583] SMU Feature Enabled: PACKAGE POWER TRACKING
[ 429.238522] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1586] SMU Feature Enabled: THERMAL DESIGN CONTROL
[ 429.238523] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1592] SMU Feature Enabled: APCC DIGITAL FREQUENCY LOCKED LOOP
[ 429.238525] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1595] SMU Feature Enabled: CRITICAL TEMP FAULT
[ 429.238526] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1598] SMU Feature Enabled: THERMAL
[ 429.238527] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1601] SMU Feature Enabled: OUT OF BAND MONITOR
[ 429.238528] gim info libgv: [0:b7:0:0][mi200_smu_13_0_print_enabled_smu_features:1604] SMU Feature Enabled: PER LINK GMI PWR DOWN
[ 429.243542] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gpumon_func
[ 429.243615] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_misc_func
[ 429.243618] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of amdgv_vfmgr_func
[ 429.243620] gim info libgv: [0:b7:0:0][amdgv_vfmgr_init_pf_config:348] LARGE_BAR=true: FB Aperture Size=0x1000000000 (65536 MB)
[ 429.243625] gim info libgv: [0:b7:0:0][amdgv_vfmgr_init_vfs_config:866] total vf fb size: 65344 MB
[ 429.243626] gim info libgv: [0:b7:0:0][amdgv_vfmgr_init_vfs_config:867] vf fb starts at: 16 MB, vf fb size: 65344 MB
[ 429.243630] gim info libgv: [0:b7:0:0][amdgv_vfmgr_set_pf_fb:138] PF FB size set to 16 MB
[ 429.243632] gim info libgv: [0:b7:0:0][mi200_gpuiov_set_vf_fb:200] idx_vf = 0x0, fb_offset = 16 MB, fb_size = 65344 MB
[ 429.282696] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1520] SMU Feature Enabled: DATA
[ 429.282705] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1523] SMU Feature Enabled: GFX DPM
[ 429.282709] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1529] SMU Feature Enabled: UCLK DPM
[ 429.282711] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1532] SMU Feature Enabled: SOC CLK DPM
[ 429.282714] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1538] SMU Feature Enabled: LCLK DPM
[ 429.282717] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1556] SMU Feature Enabled: GFX CLK SPREAD SPECTRUM
[ 429.282720] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1559] SMU Feature Enabled: VCN DPM
[ 429.282722] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1562] SMU Feature Enabled: RSMU SMN CLOCK GATING
[ 429.282724] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1565] SMU Feature Enabled: WAFL CLOCK GATING
[ 429.282727] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1568] SMU Feature Enabled: FUSE CLOCK GATING
[ 429.282729] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1571] SMU Feature Enabled: MP1 CLOCK GATING
[ 429.282731] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1574] SMU Feature Enabled: SMUIO CLOCK GATING
[ 429.282733] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1577] SMU Feature Enabled: THERMAL CLOCK GATING
[ 429.282735] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1580] SMU Feature Enabled: CLK CLOCK GATING
[ 429.282738] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1583] SMU Feature Enabled: PACKAGE POWER TRACKING
[ 429.282740] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1586] SMU Feature Enabled: THERMAL DESIGN CONTROL
[ 429.282742] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1592] SMU Feature Enabled: APCC DIGITAL FREQUENCY LOCKED LOOP
[ 429.282744] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1595] SMU Feature Enabled: CRITICAL TEMP FAULT
[ 429.282747] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1598] SMU Feature Enabled: THERMAL
[ 429.282749] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1601] SMU Feature Enabled: OUT OF BAND MONITOR
[ 429.282751] gim info libgv: [0:f:0:0][mi200_smu_13_0_print_enabled_smu_features:1604] SMU Feature Enabled: PER LINK GMI PWR DOWN
[ 429.287575] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gpumon_func
[ 429.287690] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_misc_func
[ 429.287696] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of amdgv_vfmgr_func
[ 429.287702] gim info libgv: [0:f:0:0][amdgv_vfmgr_init_pf_config:348] LARGE_BAR=true: FB Aperture Size=0x1000000000 (65536 MB)
[ 429.287708] gim info libgv: [0:f:0:0][amdgv_vfmgr_init_vfs_config:866] total vf fb size: 65344 MB
[ 429.287712] gim info libgv: [0:f:0:0][amdgv_vfmgr_init_vfs_config:867] vf fb starts at: 16 MB, vf fb size: 65344 MB
[ 429.287720] gim info libgv: [0:f:0:0][amdgv_vfmgr_set_pf_fb:138] PF FB size set to 16 MB
[ 429.287724] gim info libgv: [0:f:0:0][mi200_gpuiov_set_vf_fb:200] idx_vf = 0x0, fb_offset = 16 MB, fb_size = 65344 MB
[ 430.556866] gim info libgv: [0:b7:0:0][amdgv_misc_clear_vf_fb:198] VF0, fb_offset=0x1000000 fb_size_cleared=0xff3ff0000 pattern[0]
[ 430.556997] gim info:(gim_map_vf_dev_res:144) Map region 0x2ad000000000 for length 68719476736
[ 430.557016] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_sched_func
[ 430.557018] gim info libgv: [0:b7:0:0][amdgv_sched_init_pf_state_early:756] Init PF: Start Engine Inits.
[ 430.557191] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_diag_data_func
[ 430.557194] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_live_migration_func
[ 430.557196] gim info libgv: [0:b7:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gfx_func
[ 430.557887] gim info libgv: [0:b7:0:0][amdgv_gfx_kiq_set_resources:334] kiq ring mec 2 pipe 1 q 0
[ 430.561131] gim info libgv: [0:b7:0:0][gfx_v9_4_2_do_sgprs_init:586] Init SGPRS Successfully
[ 430.562162] gim info libgv: [0:b7:0:0][gfx_v9_4_2_do_vgprs_init:643] Init VGPRS Successfully
[ 430.562322] gim info:(gim_init_thread_func:429) AMD GIM probed GPU(1) 0000:b7:00.0
[ 430.601028] gim info libgv: [0:f:0:0][amdgv_misc_clear_vf_fb:198] VF0, fb_offset=0x1000000 fb_size_cleared=0xff3ff0000 pattern[0]
[ 430.601320] gim info:(gim_map_vf_dev_res:144) Map region 0x21d000000000 for length 68719476736
[ 430.601368] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_sched_func
[ 430.601374] gim info libgv: [0:f:0:0][amdgv_sched_init_pf_state_early:756] Init PF: Start Engine Inits.
[ 430.601579] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_diag_data_func
[ 430.601583] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_live_migration_func
[ 430.601586] gim info libgv: [0:f:0:0][amdgv_device_func_hw_init:1407] start hw_init of mi200_gfx_func
[ 430.602724] gim info libgv: [0:f:0:0][amdgv_gfx_kiq_set_resources:334] kiq ring mec 2 pipe 1 q 0
[ 430.606001] gim info libgv: [0:f:0:0][gfx_v9_4_2_do_sgprs_init:586] Init SGPRS Successfully
[ 430.607041] gim info libgv: [0:f:0:0][gfx_v9_4_2_do_vgprs_init:643] Init VGPRS Successfully
[ 430.607276] gim info:(gim_init_thread_func:429) AMD GIM probed GPU(0) 0000:0f:00.0
[ 430.609146] gim info:(gim_init:750) AMD GIM is Running
[ 431.620748] VFIO - User Level meta-driver version: 0.3