Host Crash when re-running vDPA device creation script after interruption

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I am reporting an issue where the host system crashes when re-running
a script that creates a vDPA device after interrupting its previous
execution. I am attaching the script for your analysis, as I am unsure
of the exact step causing the crash.

# uname -r
6.16.0-rc2
# sh vdpa-setup.sh  0000:b5:00.1 1
interrupted by pressing Ctrl+C
# sh vdpa-setup.sh  0000:b5:00.1 1
Then the host creatshed, please check the crash dump in attachment.

Best Regards, wenli
[    0.000000] Linux version 6.16.0-rc2 (root@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx) (gcc (GCC) 11.5.0 20240719 (Red Hat 11.5.0-5), GNU ld version 2.35.2-63.el9) #1 SMP PREEMPT_DYNAMIC Wed Jun 18 04:33:51 EDT 2025
[    0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/vmlinuz-6.16.0-rc2 root=/dev/mapper/rhel_dell--per760--18-root ro intel_iommu=on iommu=pt mitigations=off crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M resume=/dev/mapper/rhel_dell--per760--18-swap rd.lvm.lv=rhel_dell-per760-18/root rd.lvm.lv=rhel_dell-per760-18/swap console=ttyS0,115200n81
[    0.000000] x86/tme: not enabled by BIOS
[    0.000000] x86/CPU: Running old microcode
[    0.000000] x86/split lock detection: #AC: crashing the kernel on kernel split_locks and warning on user-space split_locks
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000044dc0fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000044dc1000-0x000000004cdc9fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000004cdca000-0x000000004e041fff] usable
[    0.000000] BIOS-e820: [mem 0x000000004e042000-0x0000000050841fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000050842000-0x00000000641fdfff] usable
[    0.000000] BIOS-e820: [mem 0x00000000641fe000-0x0000000074dfefff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000074dff000-0x00000000771fefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000771ff000-0x00000000777fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000777ff000-0x00000000777fffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000077800000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fc800000-0x00000000fe7fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec80000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000807fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] SMBIOS 3.3 present.
[    0.000000] DMI: Dell Inc. PowerEdge R760/0024FG, BIOS 2.1.5 03/14/2024
[    0.000000] DMI: Memory slots populated: 8/32
[    0.000000] tsc: Detected 2000.000 MHz processor
[    0.000474] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000476] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000484] last_pfn = 0x8080000 max_arch_pfn = 0x10000000000
[    0.000488] total RAM covered: 1046528M
[    0.000589] Found optimal setting for mtrr clean up
[    0.000589]  gran_size: 64K 	chunk_size: 64K 	num_reg: 9  	lose cover RAM: 0G
[    0.000593] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs
[    0.000594] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.001103] e820: update [mem 0x80000000-0xffffffff] usable ==> reserved
[    0.001105] x2apic: enabled by BIOS, switching to x2apic ops
[    0.001107] last_pfn = 0x77800 max_arch_pfn = 0x10000000000
[    0.007276] Using GB pages for direct mapping
[    0.007513] RAMDISK: [mem 0x22c90000-0x2d63ffff]
[    0.007515] ACPI: Early table checksum verification disabled
[    0.007517] ACPI: RSDP 0x00000000000FE320 000024 (v02 DELL  )
[    0.007521] ACPI: XSDT 0x00000000777FD0E8 0000C4 (v01 DELL   PE_SC3   00000000      01000013)
[    0.007526] ACPI: FACP 0x00000000777F7000 000114 (v06 DELL   PE_SC3   00000000 INTL 20091013)
[    0.007530] ACPI: DSDT 0x00000000776F6000 0FBF8E (v02 DELL   PE_SC3   00000003 INTL 20091013)
[    0.007532] ACPI: FACS 0x000000007653C000 000040
[    0.007534] ACPI: SSDT 0x00000000777FB000 0012BE (v02 INTEL  RAS_ACPI 00000001 INTL 20210331)
[    0.007537] ACPI: SSDT 0x00000000777FA000 00076E (v02 INTEL  ADDRXLAT 00000001 INTL 20210331)
[    0.007539] ACPI: BERT 0x00000000777F9000 000030 (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.007541] ACPI: ERST 0x00000000777F8000 000230 (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.007543] ACPI: HPET 0x00000000777F6000 000038 (v01 DELL   PE_SC3   00000001 INTL 20091013)
[    0.007545] ACPI: MCFG 0x00000000777F5000 00003C (v01 DELL   PE_SC3   00000001 INTL 20091013)
[    0.007547] ACPI: MIGT 0x00000000777F4000 000040 (v01 DELL   PE_SC3   00000000 INTL 20091013)
[    0.007549] ACPI: MSCT 0x00000000777F3000 000090 (v01 DELL   PE_SC3   00000001 INTL 20091013)
[    0.007551] ACPI: WSMT 0x00000000777F2000 000028 (v01 DELL   PE_SC3   00000000 INTL 20091013)
[    0.007553] ACPI: APIC 0x00000000776F5000 0001DE (v05 DELL   PE_SC3   10182021 INTL 20091013)
[    0.007556] ACPI: SRAT 0x00000000776ED000 007830 (v03 DELL   PE_SC3   00000002      01000013)
[    0.007558] ACPI: SLIT 0x00000000776EC000 000030 (v01 DELL   PE_SC3   00000002      01000013)
[    0.007560] ACPI: HMAT 0x00000000776EB000 000158 (v02 DELL   PE_SC3   00000002      01000013)
[    0.007562] ACPI: OEM4 0x0000000077563000 187A51 (v02 INTEL  CPU  CST 00003000 INTL 20210331)
[    0.007564] ACPI: SSDT 0x00000000774F9000 069895 (v02 INTEL  SSDT  PM 00004000 INTL 20210331)
[    0.007566] ACPI: SSDT 0x00000000774F8000 000A1F (v02 DELL   PE_SC3   00000000 INTL 20091013)
[    0.007568] ACPI: HEST 0x00000000774F7000 00017C (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.007570] ACPI: SSDT 0x00000000774F6000 000DCC (v02 DELL   PE_SC3   00000002 DELL 00000001)
[    0.007573] ACPI: DMAR 0x00000000774F5000 0003E2 (v01 DELL   PE_SC3   00000001 INTL 20091013)
[    0.007574] ACPI: Reserving FACP table memory at [mem 0x777f7000-0x777f7113]
[    0.007575] ACPI: Reserving DSDT table memory at [mem 0x776f6000-0x777f1f8d]
[    0.007576] ACPI: Reserving FACS table memory at [mem 0x7653c000-0x7653c03f]
[    0.007577] ACPI: Reserving SSDT table memory at [mem 0x777fb000-0x777fc2bd]
[    0.007577] ACPI: Reserving SSDT table memory at [mem 0x777fa000-0x777fa76d]
[    0.007578] ACPI: Reserving BERT table memory at [mem 0x777f9000-0x777f902f]
[    0.007578] ACPI: Reserving ERST table memory at [mem 0x777f8000-0x777f822f]
[    0.007579] ACPI: Reserving HPET table memory at [mem 0x777f6000-0x777f6037]
[    0.007580] ACPI: Reserving MCFG table memory at [mem 0x777f5000-0x777f503b]
[    0.007580] ACPI: Reserving MIGT table memory at [mem 0x777f4000-0x777f403f]
[    0.007581] ACPI: Reserving MSCT table memory at [mem 0x777f3000-0x777f308f]
[    0.007581] ACPI: Reserving WSMT table memory at [mem 0x777f2000-0x777f2027]
[    0.007582] ACPI: Reserving APIC table memory at [mem 0x776f5000-0x776f51dd]
[    0.007582] ACPI: Reserving SRAT table memory at [mem 0x776ed000-0x776f482f]
[    0.007583] ACPI: Reserving SLIT table memory at [mem 0x776ec000-0x776ec02f]
[    0.007583] ACPI: Reserving HMAT table memory at [mem 0x776eb000-0x776eb157]
[    0.007584] ACPI: Reserving OEM4 table memory at [mem 0x77563000-0x776eaa50]
[    0.007584] ACPI: Reserving SSDT table memory at [mem 0x774f9000-0x77562894]
[    0.007585] ACPI: Reserving SSDT table memory at [mem 0x774f8000-0x774f8a1e]
[    0.007586] ACPI: Reserving HEST table memory at [mem 0x774f7000-0x774f717b]
[    0.007586] ACPI: Reserving SSDT table memory at [mem 0x774f6000-0x774f6dcb]
[    0.007587] ACPI: Reserving DMAR table memory at [mem 0x774f5000-0x774f53e1]
[    0.007641] APIC: Switched APIC routing to: cluster x2apic
[    0.007696] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.007698] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x407fffffff]
[    0.007699] ACPI: SRAT: Node 1 PXM 1 [mem 0x4080000000-0x807fffffff]
[    0.007710] NUMA: Initialized distance table, cnt=2
[    0.007713] NUMA: Node 0 [mem 0x00001000-0x7fffffff] + [mem 0x100000000-0x407fffffff] -> [mem 0x00001000-0x407fffffff]
[    0.007721] NODE_DATA(0) allocated [mem 0x407ffd5280-0x407fffffff]
[    0.007740] NODE_DATA(1) allocated [mem 0x807ffd4280-0x807fffefff]
[    0.007878] crashkernel reserved: 0x0000000002000000 - 0x0000000022000000 (512 MB)
[    0.008548] Zone ranges:
[    0.008549]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.008551]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.008552]   Normal   [mem 0x0000000100000000-0x000000807fffffff]
[    0.008553]   Device   empty
[    0.008554] Movable zone start for each node
[    0.008557] Early memory node ranges
[    0.008557]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.008558]   node   0: [mem 0x0000000000100000-0x0000000044dc0fff]
[    0.008559]   node   0: [mem 0x000000004cdca000-0x000000004e041fff]
[    0.008560]   node   0: [mem 0x0000000050842000-0x00000000641fdfff]
[    0.008561]   node   0: [mem 0x00000000777ff000-0x00000000777fffff]
[    0.008561]   node   0: [mem 0x0000000100000000-0x000000407fffffff]
[    0.008575]   node   1: [mem 0x0000004080000000-0x000000807fffffff]
[    0.008588] Initmem setup node 0 [mem 0x0000000000001000-0x000000407fffffff]
[    0.008591] Initmem setup node 1 [mem 0x0000004080000000-0x000000807fffffff]
[    0.008596] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.008621] On node 0, zone DMA: 100 pages in unavailable ranges
[    0.010572] On node 0, zone DMA32: 32777 pages in unavailable ranges
[    0.011117] On node 0, zone DMA32: 10240 pages in unavailable ranges
[    0.011431] On node 0, zone DMA32: 46593 pages in unavailable ranges
[    0.011704] On node 0, zone Normal: 2048 pages in unavailable ranges
[    0.012237] ACPI: PM-Timer IO Port: 0x508
[    0.012246] ACPI: X2APIC_NMI (uid[0xffffffff] high edge lint[0x1])
[    0.012248] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.012278] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-119
[    0.012281] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.012282] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.012286] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.012287] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.012290] TSC deadline timer available
[    0.012294] CPU topo: Max. logical packages:   2
[    0.012295] CPU topo: Max. logical dies:       2
[    0.012295] CPU topo: Max. dies per package:   1
[    0.012298] CPU topo: Max. threads per core:   1
[    0.012299] CPU topo: Num. cores per package:    12
[    0.012299] CPU topo: Num. threads per package:  12
[    0.012300] CPU topo: Allowing 24 present CPUs plus 0 hotplug CPUs
[    0.012313] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.012314] PM: hibernation: Registered nosave memory: [mem 0x0009c000-0x000fffff]
[    0.012316] PM: hibernation: Registered nosave memory: [mem 0x44dc1000-0x4cdc9fff]
[    0.012317] PM: hibernation: Registered nosave memory: [mem 0x4e042000-0x50841fff]
[    0.012318] PM: hibernation: Registered nosave memory: [mem 0x641fe000-0x777fefff]
[    0.012320] PM: hibernation: Registered nosave memory: [mem 0x77800000-0xffffffff]
[    0.012322] [mem 0x90000000-0xfc7fffff] available for PCI devices
[    0.012323] Booting paravirtualized kernel on bare hardware
[    0.012325] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.017955] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:24 nr_cpu_ids:24 nr_node_ids:2
[    0.019322] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144
[    0.019328] pcpu-alloc: s212992 r8192 d28672 u262144 alloc=1*2097152
[    0.019330] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 -- -- -- -- 
[    0.019337] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 [1] 17 19 21 23 -- -- -- -- 
[    0.019356] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/vmlinuz-6.16.0-rc2 root=/dev/mapper/rhel_dell--per760--18-root ro intel_iommu=on iommu=pt mitigations=off crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M resume=/dev/mapper/rhel_dell--per760--18-swap rd.lvm.lv=rhel_dell-per760-18/root rd.lvm.lv=rhel_dell-per760-18/swap console=ttyS0,115200n81
[    0.019403] DMAR: IOMMU enabled
[    0.019484] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/vmlinuz-6.16.0-rc2", will be passed to user space.
[    0.019493] random: crng init done
[    0.019494] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes
[    0.019763] software IO TLB: area num 32.
[    0.032105] Fallback order for Node 0: 0 1 
[    0.032108] Fallback order for Node 1: 1 0 
[    0.032112] Built 2 zonelists, mobility grouping on.  Total pages: 134060433
[    0.032114] Policy zone: Normal
[    0.032390] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.096831] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=2
[    0.104920] ftrace: allocating 51189 entries in 200 pages
[    0.104922] ftrace: allocated 200 pages with 3 groups
[    0.105661] Dynamic Preempt: voluntary
[    0.105827] rcu: Preemptible hierarchical RCU implementation.
[    0.105828] rcu: 	RCU event tracing is enabled.
[    0.105828] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=24.
[    0.105830] 	Trampoline variant of Tasks RCU enabled.
[    0.105830] 	Rude variant of Tasks RCU enabled.
[    0.105831] 	Tracing variant of Tasks RCU enabled.
[    0.105831] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.105832] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=24
[    0.105861] RCU Tasks: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=24.
[    0.105865] RCU Tasks Rude: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=24.
[    0.105869] RCU Tasks Trace: Setting shift to 5 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=24.
[    0.108982] NR_IRQS: 524544, nr_irqs: 2248, preallocated irqs: 16
[    0.109242] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.109466] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[    0.114280] Console: colour VGA+ 80x25
[    0.114318] printk: legacy console [ttyS0] enabled
[    1.320887] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.332111] ACPI: Core revision 20250404
[    1.337331] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 76450417870 ns
[    1.346436] APIC: Switch to symmetric I/O mode setup
[    1.351418] DMAR: Host address width 46
[    1.355284] DMAR: DRHD base: 0x000000c97fc000 flags: 0x0
[    1.360616] DMAR: dmar0: reg_base_addr c97fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.369238] DMAR: DRHD base: 0x000000c9bfc000 flags: 0x0
[    1.374569] DMAR: dmar1: reg_base_addr c9bfc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.383189] DMAR: DRHD base: 0x000000d13fc000 flags: 0x0
[    1.388514] DMAR: dmar2: reg_base_addr d13fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.397143] DMAR: DRHD base: 0x000000d27fc000 flags: 0x0
[    1.402468] DMAR: dmar3: reg_base_addr d27fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.411108] DMAR: DRHD base: 0x000000faffc000 flags: 0x0
[    1.416440] DMAR: dmar4: reg_base_addr faffc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.425077] DMAR: DRHD base: 0x000000c93fc000 flags: 0x0
[    1.430417] DMAR: dmar5: reg_base_addr c93fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.439051] DMAR: DRHD base: 0x000000fb7fc000 flags: 0x0
[    1.444383] DMAR: dmar6: reg_base_addr fb7fc000 ver 6:0 cap 9ed008c40780466 ecap 3ef9ea6f050df
[    1.453012] DMAR: DRHD base: 0x00000095ffc000 flags: 0x0
[    1.458344] DMAR: dmar7: reg_base_addr 95ffc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.466974] DMAR: DRHD base: 0x000000963fc000 flags: 0x0
[    1.472298] DMAR: dmar8: reg_base_addr 963fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.480919] DMAR: DRHD base: 0x000000967fc000 flags: 0x0
[    1.486244] DMAR: dmar9: reg_base_addr 967fc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.494864] DMAR: DRHD base: 0x00000097bfc000 flags: 0x0
[    1.500196] DMAR: dmar10: reg_base_addr 97bfc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.508914] DMAR: DRHD base: 0x000000c7ffc000 flags: 0x0
[    1.514245] DMAR: dmar11: reg_base_addr c7ffc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.522956] DMAR: DRHD base: 0x000000c87fc000 flags: 0x0
[    1.528288] DMAR: dmar12: reg_base_addr c87fc000 ver 6:0 cap 9ed008c40780466 ecap 3ef9ea6f050df
[    1.536996] DMAR: DRHD base: 0x00000095bfc000 flags: 0x1
[    1.542328] DMAR: dmar13: reg_base_addr 95bfc000 ver 6:0 cap 9ed008c40780466 ecap 3ee9e86f050df
[    1.551034] DMAR: RMRR base: 0x00000044dc1000 end: 0x0000004cdc8fff
[    1.557312] DMAR: RMRR base: 0x000000706ee000 end: 0x00000070dedfff
[    1.563593] DMAR: RMRR base: 0x0000006fdab000 end: 0x0000006fdadfff
[    1.569878] DMAR: ATSR flags: 0x0
[    1.573214] DMAR: RHSA base: 0x00000095bfc000 proximity domain: 0x0
[    1.579496] DMAR: RHSA base: 0x00000095ffc000 proximity domain: 0x0
[    1.585773] DMAR: RHSA base: 0x000000963fc000 proximity domain: 0x0
[    1.592055] DMAR: RHSA base: 0x000000967fc000 proximity domain: 0x0
[    1.598329] DMAR: RHSA base: 0x00000097bfc000 proximity domain: 0x0
[    1.604604] DMAR: RHSA base: 0x000000c7ffc000 proximity domain: 0x0
[    1.610879] DMAR: RHSA base: 0x000000c87fc000 proximity domain: 0x0
[    1.617154] DMAR: RHSA base: 0x000000c97fc000 proximity domain: 0x1
[    1.623429] DMAR: RHSA base: 0x000000c9bfc000 proximity domain: 0x1
[    1.629706] DMAR: RHSA base: 0x000000d13fc000 proximity domain: 0x1
[    1.635989] DMAR: RHSA base: 0x000000d27fc000 proximity domain: 0x1
[    1.642273] DMAR: RHSA base: 0x000000faffc000 proximity domain: 0x1
[    1.648556] DMAR: RHSA base: 0x000000c93fc000 proximity domain: 0x1
[    1.654841] DMAR: RHSA base: 0x000000fb7fc000 proximity domain: 0x1
[    1.661122] DMAR: SATC flags: 0x0
[    1.664452] DMAR-IR: IOAPIC id 8 under DRHD base  0x95bfc000 IOMMU 13
[    1.670908] DMAR-IR: HPET id 0 under DRHD base 0x95bfc000
[    1.676324] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    1.688976] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    1.698517] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    1.709400] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x39a85c9bff6, max_idle_ns: 881590591483 ns
[    1.719936] Calibrating delay loop (skipped), value calculated using timer frequency.. 4000.00 BogoMIPS (lpj=2000000)
[    1.721008] x86/cpu: SGX disabled or unsupported by BIOS.
[    1.721942] CPU0: Thermal monitoring enabled (TM1)
[    1.722936] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    1.725089] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    1.725934] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    1.726938] process: using mwait in idle threads
[    1.727937] Speculative Store Bypass: Vulnerable
[    1.728958] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    1.729934] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    1.730934] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    1.731934] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    1.732934] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    1.733934] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    1.734934] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    1.735934] x86/fpu: Supporting XSAVE feature 0x400: 'PASID state'
[    1.736934] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'
[    1.737934] x86/fpu: Supporting XSAVE feature 0x20000: 'AMX Tile config'
[    1.738934] x86/fpu: Supporting XSAVE feature 0x40000: 'AMX Tile data'
[    1.739935] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    1.740934] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64
[    1.741934] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512
[    1.742934] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024
[    1.743934] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8
[    1.744934] x86/fpu: xstate_offset[10]: 2440, xstate_sizes[10]:    8
[    1.745934] x86/fpu: xstate_offset[11]: 2448, xstate_sizes[11]:   16
[    1.746934] x86/fpu: xstate_offset[17]: 2496, xstate_sizes[17]:   64
[    1.747934] x86/fpu: xstate_offset[18]: 2560, xstate_sizes[18]: 8192
[    1.748934] x86/fpu: Enabled xstate features 0x60ee7, context size is 10752 bytes, using 'compacted' format.
[    1.763515] Freeing SMP alternatives memory: 44K
[    1.763936] pid_max: default: 32768 minimum: 301
[    1.764991] LSM: initializing lsm=lockdown,capability,landlock,yama,selinux,bpf,ima,evm
[    1.765991] landlock: Up and running.
[    1.766934] Yama: becoming mindful.
[    1.767938] SELinux:  Initializing.
[    1.769190] LSM support for eBPF active
[    1.784074] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc hugepage)
[    1.791846] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[    1.792952] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[    1.794172] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[    1.797060] smpboot: CPU0: Intel(R) Xeon(R) Silver 4410Y (family: 0x6, model: 0x8f, stepping: 0x8)
[    1.798142] Performance Events: XSAVE Architectural LBR, PEBS fmt4+-baseline,  AnyThread deprecated, Sapphire Rapids events, 32-deep LBR, full-width counters, Intel PMU driver.
[    1.798935] ... version:                5
[    1.799934] ... bit width:              48
[    1.800934] ... generic registers:      8
[    1.801934] ... value mask:             0000ffffffffffff
[    1.802934] ... max period:             00007fffffffffff
[    1.803934] ... fixed-purpose events:   4
[    1.804934] ... event mask:             0001000f000000ff
[    1.806159] signal: max sigframe size: 11952
[    1.806948] Estimated ratio of average max frequency by base frequency (times 1024): 1536
[    1.807957] rcu: Hierarchical SRCU implementation.
[    1.808935] rcu: 	Max phase no-delay instances is 400.
[    1.809971] Timer migration: 3 hierarchy levels; 8 children per group; 2 crossnode level
[    1.811736] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    1.812136] smp: Bringing up secondary CPUs ...
[    1.813040] smpboot: x86: Booting SMP configuration:
[    1.813936] .... node  #1, CPUs:        #1
[    1.814935] .... node  #0, CPUs:    #2
[    1.815936] .... node  #1, CPUs:    #3
[    1.816939] .... node  #0, CPUs:    #4
[    1.817936] .... node  #1, CPUs:    #5
[    1.818937] .... node  #0, CPUs:    #6
[    1.819939] .... node  #1, CPUs:    #7
[    1.820935] .... node  #0, CPUs:    #8
[    1.821936] .... node  #1, CPUs:    #9
[    1.822940] .... node  #0, CPUs:   #10
[    1.823939] .... node  #1, CPUs:   #11
[    1.824935] .... node  #0, CPUs:   #12
[    1.825938] .... node  #1, CPUs:   #13
[    1.826936] .... node  #0, CPUs:   #14
[    1.827938] .... node  #1, CPUs:   #15
[    1.828936] .... node  #0, CPUs:   #16
[    1.829939] .... node  #1, CPUs:   #17
[    1.830935] .... node  #0, CPUs:   #18
[    1.831939] .... node  #1, CPUs:   #19
[    1.832936] .... node  #0, CPUs:   #20
[    1.833938] .... node  #1, CPUs:   #21
[    1.834935] .... node  #0, CPUs:   #22
[    1.835939] .... node  #1, CPUs:   #23
[    1.843992] smp: Brought up 2 nodes, 24 CPUs
[    1.845936] smpboot: Total of 24 processors activated (96000.00 BogoMIPS)
[    1.966955] node 1 deferred pages initialised in 119ms
[    1.967988] node 0 deferred pages initialised in 120ms
[    1.976964] Memory: 526783144K/536241732K available (15981K kernel code, 5786K rwdata, 8104K rodata, 4268K init, 6952K bss, 9207824K reserved, 0K cma-reserved)
[    1.997789] devtmpfs: initialized
[    1.997999] x86/mm: Memory block size: 2048MB
[    2.001221] ACPI: PM: Registering ACPI NVS region [mem 0x4e042000-0x50841fff] (41943040 bytes)
[    2.002302] ACPI: PM: Registering ACPI NVS region [mem 0x74dff000-0x771fefff] (37748736 bytes)
[    2.003311] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    2.003951] posixtimers hash table entries: 16384 (order: 6, 262144 bytes, vmalloc)
[    2.005023] futex hash table entries: 4096 (262144 bytes on 2 NUMA nodes, total 512 KiB, linear).
[    2.006046] pinctrl core: initialized pinctrl subsystem
[    2.007647] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    2.008150] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    2.008938] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    2.009937] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    2.010951] audit: initializing netlink subsys (disabled)
[    2.011947] audit: type=2000 audit(1751605494.357:1): state=initialized audit_enabled=0 res=1
[    2.012031] thermal_sys: Registered thermal governor 'fair_share'
[    2.012936] thermal_sys: Registered thermal governor 'step_wise'
[    2.013935] thermal_sys: Registered thermal governor 'user_space'
[    2.014941] cpuidle: using governor menu
[    2.017026] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.017936] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.019027] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff]
[    2.019949] PCI: Using configuration type 1 for base access
[    2.020944] PCI: Dell System detected, enabling pci=bfsort.
[    2.022007] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    2.023026] HugeTLB: allocation took 0ms with hugepage_allocation_threads=6
[    2.023950] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    2.024934] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[    2.025935] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    2.026934] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    2.028335] ACPI: Added _OSI(Module Device)
[    2.028935] ACPI: Added _OSI(Processor Device)
[    2.029937] ACPI: Added _OSI(Processor Aggregator Device)
[    2.112743] ACPI: 6 ACPI AML tables successfully acquired and loaded
[    2.119170] ACPI: Dynamic OEM Table Load:
[    2.261349] ACPI: Interpreter enabled
[    2.261960] ACPI: PM: (supports S0 S5)
[    2.262935] ACPI: Using IOAPIC for interrupt routing
[    2.269614] HEST: Table parsing has been initialized.
[    2.270039] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    2.270936] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.271934] PCI: Ignoring E820 reservations for host bridge windows
[    2.283359] ACPI: Enabled 1 GPEs in block 00 to 7F
[    2.344321] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-0b])
[    2.344937] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.356391] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    2.357072] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.357935] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.359321] PCI host bridge to bus 0000:00
[    2.359936] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    2.360934] pci_bus 0000:00: root bus resource [io  0x1000-0x3fff window]
[    2.361934] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.362935] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cffff window]
[    2.363935] pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window]
[    2.364934] pci_bus 0000:00: root bus resource [mem 0x90040000-0x95bfffff window]
[    2.365934] pci_bus 0000:00: root bus resource [mem 0x200000000000-0x20ffffffffff window]
[    2.366935] pci_bus 0000:00: root bus resource [bus 00-0b]
[    2.367949] pci 0000:00:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.369015] pci 0000:00:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.370003] pci 0000:00:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.371005] pci 0000:00:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.372084] pci 0000:00:0c.0: [8086:1bbc] type 01 class 0x060400 PCIe Root Port
[    2.372957] pci 0000:00:0c.0: BAR 0 [mem 0x20fffff20000-0x20fffff3ffff 64bit]
[    2.373937] pci 0000:00:0c.0: PCI bridge to [bus 01]
[    2.374948] pci 0000:00:0c.0:   bridge window [mem 0x95900000-0x959fffff 64bit pref]
[    2.375943] pci 0000:00:0c.0: enabling Extended Tags
[    2.377003] pci 0000:00:0c.0: PME# supported from D0 D3hot D3cold
[    2.377976] pci 0000:00:0c.0: PTM enabled (root), 2ns granularity
[    2.379340] pci 0000:00:0e.0: [8086:1bbe] type 01 class 0x060400 PCIe Root Port
[    2.379957] pci 0000:00:0e.0: BAR 0 [mem 0x20fffff00000-0x20fffff1ffff 64bit]
[    2.380936] pci 0000:00:0e.0: PCI bridge to [bus 02-03]
[    2.381939] pci 0000:00:0e.0:   bridge window [mem 0x95000000-0x958fffff]
[    2.382943] pci 0000:00:0e.0:   bridge window [mem 0x94000000-0x94ffffff 64bit pref]
[    2.383944] pci 0000:00:0e.0: enabling Extended Tags
[    2.385002] pci 0000:00:0e.0: PME# supported from D0 D3hot D3cold
[    2.385975] pci 0000:00:0e.0: PTM enabled (root), 2ns granularity
[    2.387321] pci 0000:00:14.0: [8086:1bcd] type 00 class 0x0c0330 conventional PCI endpoint
[    2.387975] pci 0000:00:14.0: BAR 0 [mem 0x95a40000-0x95a4ffff 64bit]
[    2.388978] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    2.390118] pci 0000:00:14.2: [8086:1bce] type 00 class 0x050000 conventional PCI endpoint
[    2.390983] pci 0000:00:14.2: BAR 0 [mem 0x20fffff40000-0x20fffff43fff 64bit]
[    2.391937] pci 0000:00:14.2: BAR 2 [mem 0x20fffff47000-0x20fffff47fff 64bit]
[    2.393030] pci 0000:00:14.4: [8086:1bfe] type 00 class 0x060000 PCIe Root Complex Integrated Endpoint
[    2.394109] pci 0000:00:15.0: [8086:1bff] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.394987] pci 0000:00:15.0: BAR 0 [mem 0x20fffff46000-0x20fffff463ff 64bit]
[    2.396084] pci 0000:00:16.0: [8086:1be0] type 00 class 0x078000 conventional PCI endpoint
[    2.396989] pci 0000:00:16.0: BAR 0 [mem 0x20fffff45000-0x20fffff45fff 64bit]
[    2.397985] pci 0000:00:16.0: PME# supported from D3hot
[    2.399024] pci 0000:00:18.0: [8086:1bf2] type 00 class 0x010601 conventional PCI endpoint
[    2.399974] pci 0000:00:18.0: BAR 0 [mem 0x95a52000-0x95a53fff]
[    2.400936] pci 0000:00:18.0: BAR 1 [mem 0x95a58000-0x95a580ff]
[    2.401936] pci 0000:00:18.0: BAR 2 [io  0x1068-0x106f]
[    2.402935] pci 0000:00:18.0: BAR 3 [io  0x1074-0x1077]
[    2.403936] pci 0000:00:18.0: BAR 4 [io  0x1040-0x105f]
[    2.404935] pci 0000:00:18.0: BAR 5 [mem 0x95a56000-0x95a567ff]
[    2.405969] pci 0000:00:18.0: PME# supported from D3hot
[    2.407221] pci 0000:00:19.0: [8086:1bd2] type 00 class 0x010601 conventional PCI endpoint
[    2.407974] pci 0000:00:19.0: BAR 0 [mem 0x95a50000-0x95a51fff]
[    2.408935] pci 0000:00:19.0: BAR 1 [mem 0x95a57000-0x95a570ff]
[    2.409936] pci 0000:00:19.0: BAR 2 [io  0x1060-0x1067]
[    2.410935] pci 0000:00:19.0: BAR 3 [io  0x1070-0x1073]
[    2.411936] pci 0000:00:19.0: BAR 4 [io  0x1020-0x103f]
[    2.412936] pci 0000:00:19.0: BAR 5 [mem 0x95a55000-0x95a557ff]
[    2.413969] pci 0000:00:19.0: PME# supported from D3hot
[    2.415213] pci 0000:00:1f.0: [8086:1b81] type 00 class 0x060100 conventional PCI endpoint
[    2.416090] pci 0000:00:1f.4: [8086:1bc9] type 00 class 0x0c0500 conventional PCI endpoint
[    2.416989] pci 0000:00:1f.4: BAR 0 [mem 0x20fffff44000-0x20fffff440ff 64bit]
[    2.417938] pci 0000:00:1f.4: BAR 4 [io  0x1000-0x101f]
[    2.419023] pci 0000:00:1f.5: [8086:1bca] type 00 class 0x0c8000 conventional PCI endpoint
[    2.419987] pci 0000:00:1f.5: BAR 0 [mem 0xfe010000-0xfe010fff]
[    2.420936] pci 0000:00:1f.5: BAR 1 [mem 0x92000000-0x93ffffff]
[    2.422069] pci 0000:01:00.0: [14e4:165f] type 00 class 0x020000 PCIe Endpoint
[    2.422992] pci 0000:01:00.0: BAR 0 [mem 0x95930000-0x9593ffff 64bit pref]
[    2.423938] pci 0000:01:00.0: BAR 2 [mem 0x95940000-0x9594ffff 64bit pref]
[    2.424937] pci 0000:01:00.0: BAR 4 [mem 0x95950000-0x9595ffff 64bit pref]
[    2.425936] pci 0000:01:00.0: ROM [mem 0xfffc0000-0xffffffff pref]
[    2.427040] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.428006] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x1 link at 0000:00:0c.0 (capable of 8.000 Gb/s with 5.0 GT/s PCIe x2 link)
[    2.429220] pci 0000:01:00.1: [14e4:165f] type 00 class 0x020000 PCIe Endpoint
[    2.429991] pci 0000:01:00.1: BAR 0 [mem 0x95900000-0x9590ffff 64bit pref]
[    2.430937] pci 0000:01:00.1: BAR 2 [mem 0x95910000-0x9591ffff 64bit pref]
[    2.431938] pci 0000:01:00.1: BAR 4 [mem 0x95920000-0x9592ffff 64bit pref]
[    2.432936] pci 0000:01:00.1: ROM [mem 0xfffc0000-0xffffffff pref]
[    2.434062] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.435259] pci 0000:00:0c.0: PCI bridge to [bus 01]
[    2.436011] pci 0000:02:00.0: [1556:be00] type 01 class 0x060400 PCIe to PCI/PCI-X bridge
[    2.436968] pci 0000:02:00.0: PCI bridge to [bus 03]
[    2.437944] pci 0000:02:00.0:   bridge window [mem 0x95000000-0x958fffff]
[    2.438947] pci 0000:02:00.0:   bridge window [mem 0x94000000-0x94ffffff 64bit pref]
[    2.440100] pci 0000:00:0e.0: PCI bridge to [bus 02-03]
[    2.440977] pci_bus 0000:03: extended config space not accessible
[    2.441964] pci 0000:03:00.0: [102b:0536] type 00 class 0x030000 conventional PCI endpoint
[    2.442992] pci 0000:03:00.0: BAR 0 [mem 0x94000000-0x94ffffff pref]
[    2.443936] pci 0000:03:00.0: BAR 1 [mem 0x95808000-0x9580bfff]
[    2.444936] pci 0000:03:00.0: BAR 2 [mem 0x95000000-0x957fffff]
[    2.445969] pci 0000:03:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    2.447059] pci 0000:02:00.0: PCI bridge to [bus 03]
[    2.447970] pci_bus 0000:00: on NUMA node 0
[    2.448302] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 0c-20])
[    2.448935] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.454017] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.455047] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.455934] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.457004] PCI host bridge to bus 0000:0c
[    2.457935] pci_bus 0000:0c: root bus resource [io  0x4000-0x5fff window]
[    2.458934] pci_bus 0000:0c: root bus resource [mem 0x95c00000-0x95ffffff window]
[    2.459935] pci_bus 0000:0c: root bus resource [mem 0x210000000000-0x21ffffffffff window]
[    2.460935] pci_bus 0000:0c: root bus resource [bus 0c-20]
[    2.461942] pci 0000:0c:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.463001] pci 0000:0c:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.463999] pci 0000:0c:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.465001] pci 0000:0c:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.466038] pci_bus 0000:0c: on NUMA node 0
[    2.466084] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 21-35])
[    2.466935] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.472032] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.473045] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.473934] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.475000] PCI host bridge to bus 0000:21
[    2.475935] pci_bus 0000:21: root bus resource [io  0x6000-0x6fff window]
[    2.476934] pci_bus 0000:21: root bus resource [mem 0x96000000-0x963fffff window]
[    2.477935] pci_bus 0000:21: root bus resource [mem 0x220000000000-0x22ffffffffff window]
[    2.478935] pci_bus 0000:21: root bus resource [bus 21-35]
[    2.479942] pci 0000:21:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.480998] pci 0000:21:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.481998] pci 0000:21:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.483000] pci 0000:21:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.484037] pci_bus 0000:21: on NUMA node 0
[    2.484081] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 36-48])
[    2.484935] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.490028] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.491043] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.491934] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.493000] PCI host bridge to bus 0000:36
[    2.493935] pci_bus 0000:36: root bus resource [io  0x7000-0x7fff window]
[    2.494934] pci_bus 0000:36: root bus resource [mem 0x96400000-0x967fffff window]
[    2.495934] pci_bus 0000:36: root bus resource [mem 0x230000000000-0x23ffffffffff window]
[    2.496935] pci_bus 0000:36: root bus resource [bus 36-48]
[    2.497942] pci 0000:36:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.498998] pci 0000:36:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.499998] pci 0000:36:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.501000] pci 0000:36:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.502038] pci_bus 0000:36: on NUMA node 0
[    2.502081] ACPI: PCI Root Bridge [PC04] (domain 0000 [bus 49-5f])
[    2.502935] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.508106] acpi PNP0A08:04: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.509043] acpi PNP0A08:04: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.509934] acpi PNP0A08:04: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.510998] PCI host bridge to bus 0000:49
[    2.511935] pci_bus 0000:49: root bus resource [io  0x8000-0x8fff window]
[    2.512934] pci_bus 0000:49: root bus resource [mem 0x96800000-0x97bfffff window]
[    2.513934] pci_bus 0000:49: root bus resource [mem 0x240000000000-0x24ffffffffff window]
[    2.514935] pci_bus 0000:49: root bus resource [bus 49-5f]
[    2.515941] pci 0000:49:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.516998] pci 0000:49:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.517998] pci 0000:49:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.518999] pci 0000:49:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.520039] pci 0000:49:01.0: [8086:352a] type 01 class 0x060400 PCIe Root Port
[    2.520949] pci 0000:49:01.0: BAR 0 [mem 0x24fffff60000-0x24fffff7ffff 64bit]
[    2.521936] pci 0000:49:01.0: PCI bridge to [bus 4a]
[    2.522937] pci 0000:49:01.0:   bridge window [mem 0x97400000-0x977fffff]
[    2.523945] pci 0000:49:01.0: enabling Extended Tags
[    2.524984] pci 0000:49:01.0: PME# supported from D0 D3hot D3cold
[    2.525963] pci 0000:49:01.0: PTM enabled (root), 2ns granularity
[    2.528640] pci 0000:49:03.0: [8086:352b] type 01 class 0x060400 PCIe Root Port
[    2.528949] pci 0000:49:03.0: BAR 0 [mem 0x24fffff40000-0x24fffff5ffff 64bit]
[    2.529936] pci 0000:49:03.0: PCI bridge to [bus 4b]
[    2.530937] pci 0000:49:03.0:   bridge window [mem 0x97000000-0x973fffff]
[    2.531945] pci 0000:49:03.0: enabling Extended Tags
[    2.532985] pci 0000:49:03.0: PME# supported from D0 D3hot D3cold
[    2.533963] pci 0000:49:03.0: PTM enabled (root), 2ns granularity
[    2.536549] pci 0000:49:05.0: [8086:352c] type 01 class 0x060400 PCIe Root Port
[    2.536953] pci 0000:49:05.0: BAR 0 [mem 0x24fffff20000-0x24fffff3ffff 64bit]
[    2.537936] pci 0000:49:05.0: PCI bridge to [bus 4c]
[    2.538938] pci 0000:49:05.0:   bridge window [mem 0x96c00000-0x96ffffff]
[    2.539945] pci 0000:49:05.0: enabling Extended Tags
[    2.541010] pci 0000:49:05.0: PME# supported from D0 D3hot D3cold
[    2.541961] pci 0000:49:05.0: PTM enabled (root), 2ns granularity
[    2.544568] pci 0000:49:07.0: [8086:352d] type 01 class 0x060400 PCIe Root Port
[    2.544948] pci 0000:49:07.0: BAR 0 [mem 0x24fffff00000-0x24fffff1ffff 64bit]
[    2.545936] pci 0000:49:07.0: PCI bridge to [bus 4d]
[    2.546939] pci 0000:49:07.0:   bridge window [mem 0x96800000-0x96bfffff]
[    2.547946] pci 0000:49:07.0: enabling Extended Tags
[    2.548988] pci 0000:49:07.0: PME# supported from D0 D3hot D3cold
[    2.549960] pci 0000:49:07.0: PTM enabled (root), 2ns granularity
[    2.552576] pci 0000:49:01.0: PCI bridge to [bus 4a]
[    2.552990] pci 0000:49:03.0: PCI bridge to [bus 4b]
[    2.553962] pci 0000:49:05.0: PCI bridge to [bus 4c]
[    2.554961] pci 0000:49:07.0: PCI bridge to [bus 4d]
[    2.555952] pci_bus 0000:49: on NUMA node 0
[    2.556005] ACPI: PCI Root Bridge [PC05] (domain 0000 [bus 60-74])
[    2.556936] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.562076] acpi PNP0A08:05: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.563048] acpi PNP0A08:05: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.563934] acpi PNP0A08:05: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.565004] PCI host bridge to bus 0000:60
[    2.565935] pci_bus 0000:60: root bus resource [io  0x9000-0x9fff window]
[    2.566934] pci_bus 0000:60: root bus resource [mem 0x97c00000-0xc7ffffff window]
[    2.567934] pci_bus 0000:60: root bus resource [mem 0x250000000000-0x25ffffffffff window]
[    2.568935] pci_bus 0000:60: root bus resource [bus 60-74]
[    2.569942] pci 0000:60:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.571002] pci 0000:60:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.571999] pci 0000:60:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.573003] pci 0000:60:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.574038] pci 0000:60:01.0: [8086:352a] type 01 class 0x060400 PCIe Root Port
[    2.574947] pci 0000:60:01.0: BAR 0 [mem 0x25ffff800000-0x25ffff81ffff 64bit]
[    2.575935] pci 0000:60:01.0: PCI bridge to [bus 61]
[    2.576942] pci 0000:60:01.0:   bridge window [mem 0x25fff6000000-0x25ffff7fffff 64bit pref]
[    2.577980] pci 0000:60:01.0: PME# supported from D0 D3hot D3cold
[    2.578959] pci 0000:60:01.0: PTM enabled (root), 2ns granularity
[    2.580715] pci 0000:61:00.0: [15b3:a2dc] type 00 class 0x020000 PCIe Endpoint
[    2.581205] pci 0000:61:00.0: BAR 0 [mem 0x25fff8000000-0x25fff9ffffff 64bit pref]
[    2.581947] pci 0000:61:00.0: BAR 2 [mem 0x25fffb000000-0x25fffb7fffff 64bit pref]
[    2.582950] pci 0000:61:00.0: ROM [mem 0xfff00000-0xffffffff pref]
[    2.585148] pci 0000:61:00.0: PME# supported from D3cold
[    2.586271] pci 0000:61:00.0: VF BAR 0 [mem 0x25fffd800000-0x25fffd9fffff 64bit pref]
[    2.586934] pci 0000:61:00.0: VF BAR 0 [mem 0x25fffd800000-0x25ffff7fffff 64bit pref]: contains BAR 0 for 16 VFs
[    2.589223] pci 0000:61:00.1: [15b3:a2dc] type 00 class 0x020000 PCIe Endpoint
[    2.590201] pci 0000:61:00.1: BAR 0 [mem 0x25fff6000000-0x25fff7ffffff 64bit pref]
[    2.590948] pci 0000:61:00.1: BAR 2 [mem 0x25fffa800000-0x25fffaffffff 64bit pref]
[    2.591951] pci 0000:61:00.1: ROM [mem 0xfff00000-0xffffffff pref]
[    2.593806] pci 0000:61:00.1: PME# supported from D3cold
[    2.594262] pci 0000:61:00.1: VF BAR 0 [mem 0x25fffb800000-0x25fffb9fffff 64bit pref]
[    2.594934] pci 0000:61:00.1: VF BAR 0 [mem 0x25fffb800000-0x25fffd7fffff 64bit pref]: contains BAR 0 for 16 VFs
[    2.596904] pci 0000:61:00.2: [15b3:c2d5] type 00 class 0x080100 PCIe Endpoint
[    2.597193] pci 0000:61:00.2: BAR 0 [mem 0x25fffa000000-0x25fffa7fffff 64bit pref]
[    2.598803] pci 0000:61:00.2: PME# supported from D3cold
[    2.599385] pci 0000:60:01.0: PCI bridge to [bus 61]
[    2.599943] pci_bus 0000:60: on NUMA node 0
[    2.600014] ACPI: PCI Root Bridge [DI08] (domain 0000 [bus 75-7d])
[    2.600935] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.606027] acpi PNP0A08:07: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.606985] acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.607936] acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.608989] PCI host bridge to bus 0000:75
[    2.609935] pci_bus 0000:75: root bus resource [mem 0xc8000000-0xc87fffff window]
[    2.610935] pci_bus 0000:75: root bus resource [mem 0x260000000000-0x26ffffffffff window]
[    2.611935] pci_bus 0000:75: root bus resource [bus 75-7d]
[    2.612942] pci 0000:75:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.614004] pci 0000:75:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.614999] pci 0000:75:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.616000] pci 0000:75:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.617032] pci 0000:75:01.0: [8086:0b25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.617954] pci 0000:75:01.0: BAR 0 [mem 0x26fffff20000-0x26fffff2ffff 64bit pref]
[    2.618935] pci 0000:75:01.0: BAR 2 [mem 0x26fffff00000-0x26fffff1ffff 64bit pref]
[    2.620026] pci 0000:75:03.0: [8086:09a6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.620957] pci 0000:75:03.0: BAR 0 [mem 0xc8000000-0xc80fffff]
[    2.621996] pci 0000:75:03.1: [8086:09a7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.622958] pci 0000:75:03.1: BAR 0 [mem 0xc8140000-0xc8141fff]
[    2.623935] pci 0000:75:03.1: BAR 1 [mem 0xc8100000-0xc813ffff]
[    2.625020] pci_bus 0000:75: on NUMA node 0
[    2.625574] ACPI: PCI Root Bridge [UB00] (domain 0000 [bus 7e])
[    2.625936] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.626986] acpi PNP0A03:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    2.628027] acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.628935] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.629991] PCI host bridge to bus 0000:7e
[    2.630935] pci_bus 0000:7e: root bus resource [bus 7e]
[    2.631941] pci 0000:7e:00.0: [8086:3250] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.633002] pci 0000:7e:00.1: [8086:3251] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.633989] pci 0000:7e:00.2: [8086:3252] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.635003] pci 0000:7e:00.3: [8086:0998] type 00 class 0x060000 PCIe Root Complex Integrated Endpoint
[    2.636011] pci 0000:7e:00.5: [8086:3255] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.636995] pci 0000:7e:01.0: [8086:3240] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.638023] pci 0000:7e:01.1: [8086:3241] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.639020] pci 0000:7e:01.2: [8086:3242] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.640032] pci 0000:7e:02.0: [8086:3240] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.641036] pci 0000:7e:02.1: [8086:3241] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.642033] pci 0000:7e:02.2: [8086:3242] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.643036] pci 0000:7e:05.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.644021] pci 0000:7e:05.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.645021] pci 0000:7e:05.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.646026] pci 0000:7e:06.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.647033] pci 0000:7e:06.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.648040] pci 0000:7e:06.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.649038] pci 0000:7e:07.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.650038] pci 0000:7e:07.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.651042] pci 0000:7e:07.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.652041] pci 0000:7e:0c.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.653027] pci 0000:7e:0d.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.654034] pci 0000:7e:0e.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.655038] pci 0000:7e:0f.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.656050] pci 0000:7e:1a.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.657024] pci 0000:7e:1b.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.658032] pci 0000:7e:1c.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.659039] pci 0000:7e:1d.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.660037] pci_bus 0000:7e: on NUMA node 0
[    2.660072] ACPI: PCI Root Bridge [UB01] (domain 0000 [bus 7f])
[    2.660935] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.661983] acpi PNP0A03:01: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    2.663026] acpi PNP0A03:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.663934] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.664986] PCI host bridge to bus 0000:7f
[    2.665935] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.666942] pci 0000:7f:00.0: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.668009] pci 0000:7f:00.1: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.669017] pci 0000:7f:00.2: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.670021] pci 0000:7f:00.3: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.671014] pci 0000:7f:00.4: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.672018] pci 0000:7f:00.5: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.673020] pci 0000:7f:00.6: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.674030] pci 0000:7f:00.7: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.675031] pci 0000:7f:01.0: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.676032] pci 0000:7f:01.1: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.677037] pci 0000:7f:01.2: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.678042] pci 0000:7f:01.3: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.679044] pci 0000:7f:01.4: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.680043] pci 0000:7f:01.5: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.681036] pci 0000:7f:01.6: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.682040] pci 0000:7f:01.7: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.683053] pci 0000:7f:0a.0: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.684021] pci 0000:7f:0a.1: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.685018] pci 0000:7f:0a.2: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.686021] pci 0000:7f:0a.3: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.687015] pci 0000:7f:0a.4: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.688019] pci 0000:7f:0a.5: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.689020] pci 0000:7f:0a.6: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.690031] pci 0000:7f:0a.7: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.691031] pci 0000:7f:0b.0: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.692020] pci 0000:7f:0b.1: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.693037] pci 0000:7f:0b.2: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.694045] pci 0000:7f:0b.3: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.695044] pci 0000:7f:0b.4: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.696044] pci 0000:7f:0b.5: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.697036] pci 0000:7f:0b.6: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.698042] pci 0000:7f:0b.7: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.699061] pci 0000:7f:1d.0: [8086:344f] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.700026] pci 0000:7f:1d.1: [8086:3457] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.701016] pci 0000:7f:1e.0: [8086:3258] type 00 class 0x088000 conventional PCI endpoint
[    2.701993] pci 0000:7f:1e.1: [8086:3259] type 00 class 0x088000 conventional PCI endpoint
[    2.702982] pci 0000:7f:1e.2: [8086:325a] type 00 class 0x088000 conventional PCI endpoint
[    2.703982] pci 0000:7f:1e.3: [8086:325b] type 00 class 0x088000 conventional PCI endpoint
[    2.704980] pci 0000:7f:1e.4: [8086:325c] type 00 class 0x088000 conventional PCI endpoint
[    2.705981] pci 0000:7f:1e.5: [8086:325d] type 00 class 0x088000 conventional PCI endpoint
[    2.706979] pci 0000:7f:1e.6: [8086:325e] type 00 class 0x088000 conventional PCI endpoint
[    2.707980] pci 0000:7f:1e.7: [8086:325f] type 00 class 0x088000 conventional PCI endpoint
[    2.708977] pci_bus 0000:7f: on NUMA node 0
[    2.709030] ACPI: PCI Root Bridge [PC11] (domain 0000 [bus 8a-9e])
[    2.709935] acpi PNP0A08:24: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.715038] acpi PNP0A08:24: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.716045] acpi PNP0A08:24: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.716934] acpi PNP0A08:24: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.718006] PCI host bridge to bus 0000:8a
[    2.718935] pci_bus 0000:8a: root bus resource [mem 0xc9400000-0xc97fffff window]
[    2.719934] pci_bus 0000:8a: root bus resource [mem 0x280000000000-0x28ffffffffff window]
[    2.720935] pci_bus 0000:8a: root bus resource [bus 8a-9e]
[    2.721943] pci 0000:8a:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.723005] pci 0000:8a:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.724004] pci 0000:8a:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.725008] pci 0000:8a:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.726050] pci_bus 0000:8a: on NUMA node 1
[    2.726092] ACPI: PCI Root Bridge [PC12] (domain 0000 [bus 9f-b3])
[    2.726935] acpi PNP0A08:25: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.732028] acpi PNP0A08:25: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.733043] acpi PNP0A08:25: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.733934] acpi PNP0A08:25: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.734999] PCI host bridge to bus 0000:9f
[    2.735937] pci_bus 0000:9f: root bus resource [mem 0xc9800000-0xc9bfffff window]
[    2.736935] pci_bus 0000:9f: root bus resource [mem 0x290000000000-0x29ffffffffff window]
[    2.737935] pci_bus 0000:9f: root bus resource [bus 9f-b3]
[    2.738942] pci 0000:9f:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.740005] pci 0000:9f:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.741004] pci 0000:9f:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.742006] pci 0000:9f:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.743049] pci_bus 0000:9f: on NUMA node 1
[    2.743094] ACPI: PCI Root Bridge [PC13] (domain 0000 [bus b4-c8])
[    2.743935] acpi PNP0A08:26: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.749041] acpi PNP0A08:26: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.750045] acpi PNP0A08:26: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.750935] acpi PNP0A08:26: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.752001] PCI host bridge to bus 0000:b4
[    2.752935] pci_bus 0000:b4: root bus resource [mem 0xc9c00000-0xd13fffff window]
[    2.753934] pci_bus 0000:b4: root bus resource [mem 0x2a0000000000-0x2affffffffff window]
[    2.754935] pci_bus 0000:b4: root bus resource [bus b4-c8]
[    2.755943] pci 0000:b4:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.757007] pci 0000:b4:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.758006] pci 0000:b4:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.759007] pci 0000:b4:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.760051] pci 0000:b4:01.0: [8086:352a] type 01 class 0x060400 PCIe Root Port
[    2.760949] pci 0000:b4:01.0: BAR 0 [mem 0x2afffff00000-0x2afffff1ffff 64bit]
[    2.761936] pci 0000:b4:01.0: PCI bridge to [bus b5]
[    2.762943] pci 0000:b4:01.0:   bridge window [mem 0xca000000-0xd0ffffff 64bit pref]
[    2.763989] pci 0000:b4:01.0: PME# supported from D0 D3hot D3cold
[    2.764963] pci 0000:b4:01.0: PTM enabled (root), 2ns granularity
[    2.766748] pci 0000:b5:00.0: [15b3:101d] type 00 class 0x020000 PCIe Endpoint
[    2.767236] pci 0000:b5:00.0: BAR 0 [mem 0xcc000000-0xcdffffff 64bit pref]
[    2.767965] pci 0000:b5:00.0: ROM [mem 0xfff00000-0xffffffff pref]
[    2.770218] pci 0000:b5:00.0: PME# supported from D3cold
[    2.771341] pci 0000:b5:00.0: VF BAR 0 [mem 0xcf800000-0xcf8fffff 64bit pref]
[    2.771934] pci 0000:b5:00.0: VF BAR 0 [mem 0xcf800000-0xd0ffffff 64bit pref]: contains BAR 0 for 24 VFs
[    2.774514] pci 0000:b5:00.1: [15b3:101d] type 00 class 0x020000 PCIe Endpoint
[    2.775232] pci 0000:b5:00.1: BAR 0 [mem 0xca000000-0xcbffffff 64bit pref]
[    2.775965] pci 0000:b5:00.1: ROM [mem 0xfff00000-0xffffffff pref]
[    2.777976] pci 0000:b5:00.1: PME# supported from D3cold
[    2.779338] pci 0000:b5:00.1: VF BAR 0 [mem 0xce000000-0xce0fffff 64bit pref]
[    2.779935] pci 0000:b5:00.1: VF BAR 0 [mem 0xce000000-0xcf7fffff 64bit pref]: contains BAR 0 for 24 VFs
[    2.782214] pci 0000:b4:01.0: PCI bridge to [bus b5]
[    2.782944] pci_bus 0000:b4: on NUMA node 1
[    2.782996] ACPI: PCI Root Bridge [PC14] (domain 0000 [bus c9-df])
[    2.783940] acpi PNP0A08:27: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.789103] acpi PNP0A08:27: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.790046] acpi PNP0A08:27: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.790934] acpi PNP0A08:27: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.792003] PCI host bridge to bus 0000:c9
[    2.792935] pci_bus 0000:c9: root bus resource [mem 0xd1400000-0xd27fffff window]
[    2.793935] pci_bus 0000:c9: root bus resource [mem 0x2b0000000000-0x2bffffffffff window]
[    2.794935] pci_bus 0000:c9: root bus resource [bus c9-df]
[    2.795943] pci 0000:c9:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.797006] pci 0000:c9:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.798008] pci 0000:c9:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.799007] pci 0000:c9:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.800054] pci 0000:c9:01.0: [8086:352a] type 01 class 0x060400 PCIe Root Port
[    2.800950] pci 0000:c9:01.0: BAR 0 [mem 0x2bfffff60000-0x2bfffff7ffff 64bit]
[    2.801936] pci 0000:c9:01.0: PCI bridge to [bus ca]
[    2.802938] pci 0000:c9:01.0:   bridge window [mem 0xd2000000-0xd23fffff]
[    2.803947] pci 0000:c9:01.0: enabling Extended Tags
[    2.804993] pci 0000:c9:01.0: PME# supported from D0 D3hot D3cold
[    2.805968] pci 0000:c9:01.0: PTM enabled (root), 2ns granularity
[    2.808696] pci 0000:c9:03.0: [8086:352b] type 01 class 0x060400 PCIe Root Port
[    2.808951] pci 0000:c9:03.0: BAR 0 [mem 0x2bfffff40000-0x2bfffff5ffff 64bit]
[    2.809936] pci 0000:c9:03.0: PCI bridge to [bus cb]
[    2.810937] pci 0000:c9:03.0:   bridge window [mem 0xd1c00000-0xd1ffffff]
[    2.811947] pci 0000:c9:03.0: enabling Extended Tags
[    2.812993] pci 0000:c9:03.0: PME# supported from D0 D3hot D3cold
[    2.813968] pci 0000:c9:03.0: PTM enabled (root), 2ns granularity
[    2.816637] pci 0000:c9:05.0: [8086:352c] type 01 class 0x060400 PCIe Root Port
[    2.816953] pci 0000:c9:05.0: BAR 0 [mem 0x2bfffff20000-0x2bfffff3ffff 64bit]
[    2.817937] pci 0000:c9:05.0: PCI bridge to [bus cc]
[    2.818939] pci 0000:c9:05.0:   bridge window [mem 0xd1800000-0xd1bfffff]
[    2.819947] pci 0000:c9:05.0: enabling Extended Tags
[    2.821011] pci 0000:c9:05.0: PME# supported from D0 D3hot D3cold
[    2.821968] pci 0000:c9:05.0: PTM enabled (root), 2ns granularity
[    2.824676] pci 0000:c9:07.0: [8086:352d] type 01 class 0x060400 PCIe Root Port
[    2.824952] pci 0000:c9:07.0: BAR 0 [mem 0x2bfffff00000-0x2bfffff1ffff 64bit]
[    2.825936] pci 0000:c9:07.0: PCI bridge to [bus cd]
[    2.826938] pci 0000:c9:07.0:   bridge window [mem 0xd1400000-0xd17fffff]
[    2.827947] pci 0000:c9:07.0: enabling Extended Tags
[    2.829018] pci 0000:c9:07.0: PME# supported from D0 D3hot D3cold
[    2.829970] pci 0000:c9:07.0: PTM enabled (root), 2ns granularity
[    2.832710] pci 0000:c9:01.0: PCI bridge to [bus ca]
[    2.832967] pci 0000:c9:03.0: PCI bridge to [bus cb]
[    2.833965] pci 0000:c9:05.0: PCI bridge to [bus cc]
[    2.834966] pci 0000:c9:07.0: PCI bridge to [bus cd]
[    2.835955] pci_bus 0000:c9: on NUMA node 1
[    2.836005] ACPI: PCI Root Bridge [PC15] (domain 0000 [bus e0-f1])
[    2.836936] acpi PNP0A08:28: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.842077] acpi PNP0A08:28: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.843048] acpi PNP0A08:28: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.843935] acpi PNP0A08:28: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.845003] PCI host bridge to bus 0000:e0
[    2.845935] pci_bus 0000:e0: root bus resource [io  0xa000-0xffff window]
[    2.846935] pci_bus 0000:e0: root bus resource [mem 0xd2800000-0xfaffffff window]
[    2.847939] pci_bus 0000:e0: root bus resource [mem 0x2c0000000000-0x2cffffffffff window]
[    2.848935] pci_bus 0000:e0: root bus resource [bus e0-f1]
[    2.849943] pci 0000:e0:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.851038] pci 0000:e0:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.852008] pci 0000:e0:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.853007] pci 0000:e0:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.854053] pci 0000:e0:05.0: [8086:352c] type 01 class 0x060400 PCIe Root Port
[    2.854949] pci 0000:e0:05.0: BAR 0 [mem 0x2cfffff00000-0x2cfffff1ffff 64bit]
[    2.855936] pci 0000:e0:05.0: PCI bridge to [bus e1]
[    2.856936] pci 0000:e0:05.0:   bridge window [io  0xa000-0xafff]
[    2.857936] pci 0000:e0:05.0:   bridge window [mem 0xd2a00000-0xd2afffff]
[    2.858940] pci 0000:e0:05.0:   bridge window [mem 0xd2800000-0xd29fffff 64bit pref]
[    2.859988] pci 0000:e0:05.0: PME# supported from D0 D3hot D3cold
[    2.860963] pci 0000:e0:05.0: PTM enabled (root), 2ns granularity
[    2.862551] pci 0000:e1:00.0: [1000:10e6] type 00 class 0x010400 PCIe Endpoint
[    2.862965] pci 0000:e1:00.0: BAR 0 [mem 0xd2800000-0xd28fffff 64bit pref]
[    2.863936] pci 0000:e1:00.0: BAR 2 [mem 0xd2900000-0xd29fffff 64bit pref]
[    2.864935] pci 0000:e1:00.0: BAR 4 [mem 0xd2a00000-0xd2afffff]
[    2.865935] pci 0000:e1:00.0: BAR 5 [io  0xa000-0xa0ff]
[    2.866935] pci 0000:e1:00.0: ROM [mem 0xfff00000-0xffffffff pref]
[    2.868206] pci 0000:e1:00.0: supports D1 D2
[    2.869030] pci 0000:e0:05.0: PCI bridge to [bus e1]
[    2.869944] pci_bus 0000:e0: on NUMA node 1
[    2.869992] ACPI: PCI Root Bridge [PC16] (domain 0000 [bus 80-89])
[    2.870936] acpi PNP0A08:29: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.876049] acpi PNP0A08:29: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.877047] acpi PNP0A08:29: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.877936] acpi PNP0A08:29: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.879003] PCI host bridge to bus 0000:80
[    2.879935] pci_bus 0000:80: root bus resource [mem 0xc9000000-0xc93fffff window]
[    2.880935] pci_bus 0000:80: root bus resource [mem 0x270000000000-0x27ffffffffff window]
[    2.881935] pci_bus 0000:80: root bus resource [bus 80-89]
[    2.882943] pci 0000:80:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.884008] pci 0000:80:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.885007] pci 0000:80:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.886008] pci 0000:80:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.887052] pci_bus 0000:80: on NUMA node 1
[    2.887102] ACPI: PCI Root Bridge [DI18] (domain 0000 [bus f2-fa])
[    2.887935] acpi PNP0A08:2a: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.892986] acpi PNP0A08:2a: _OSC: platform does not support [SHPCHotplug AER DPC]
[    2.893984] acpi PNP0A08:2a: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    2.894935] acpi PNP0A08:2a: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.895997] PCI host bridge to bus 0000:f2
[    2.896935] pci_bus 0000:f2: root bus resource [mem 0xfb000000-0xfb7fffff window]
[    2.897934] pci_bus 0000:f2: root bus resource [mem 0x2d0000000000-0x2dffffffffff window]
[    2.898935] pci_bus 0000:f2: root bus resource [bus f2-fa]
[    2.899942] pci 0000:f2:00.0: [8086:09a2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.901006] pci 0000:f2:00.1: [8086:09a4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.902005] pci 0000:f2:00.2: [8086:09a3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.903006] pci 0000:f2:00.4: [8086:0b23] type 00 class 0x080700 PCIe Root Complex Event Collector
[    2.904042] pci 0000:f2:01.0: [8086:0b25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.904957] pci 0000:f2:01.0: BAR 0 [mem 0x2dfffff20000-0x2dfffff2ffff 64bit pref]
[    2.905936] pci 0000:f2:01.0: BAR 2 [mem 0x2dfffff00000-0x2dfffff1ffff 64bit pref]
[    2.907036] pci 0000:f2:03.0: [8086:09a6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.907959] pci 0000:f2:03.0: BAR 0 [mem 0xfb000000-0xfb0fffff]
[    2.909000] pci 0000:f2:03.1: [8086:09a7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.909959] pci 0000:f2:03.1: BAR 0 [mem 0xfb140000-0xfb141fff]
[    2.910935] pci 0000:f2:03.1: BAR 1 [mem 0xfb100000-0xfb13ffff]
[    2.912032] pci_bus 0000:f2: on NUMA node 1
[    2.912587] ACPI: PCI Root Bridge [UB10] (domain 0000 [bus fe])
[    2.912935] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.913985] acpi PNP0A03:02: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    2.915027] acpi PNP0A03:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.915935] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.916991] PCI host bridge to bus 0000:fe
[    2.917935] pci_bus 0000:fe: root bus resource [bus fe]
[    2.918941] pci 0000:fe:00.0: [8086:3250] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.920010] pci 0000:fe:00.1: [8086:3251] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.920996] pci 0000:fe:00.2: [8086:3252] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.922013] pci 0000:fe:00.3: [8086:0998] type 00 class 0x060000 PCIe Root Complex Integrated Endpoint
[    2.923017] pci 0000:fe:00.5: [8086:3255] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.924002] pci 0000:fe:01.0: [8086:3240] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.925031] pci 0000:fe:01.1: [8086:3241] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.926027] pci 0000:fe:01.2: [8086:3242] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.927037] pci 0000:fe:02.0: [8086:3240] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.928043] pci 0000:fe:02.1: [8086:3241] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.929040] pci 0000:fe:02.2: [8086:3242] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.930043] pci 0000:fe:05.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.931027] pci 0000:fe:05.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.932027] pci 0000:fe:05.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.933032] pci 0000:fe:06.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.934040] pci 0000:fe:06.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.935040] pci 0000:fe:06.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.936044] pci 0000:fe:07.0: [8086:3245] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.937044] pci 0000:fe:07.1: [8086:3246] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.938045] pci 0000:fe:07.2: [8086:3247] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.939047] pci 0000:fe:0c.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.940031] pci 0000:fe:0d.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.941040] pci 0000:fe:0e.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.942045] pci 0000:fe:0f.0: [8086:324a] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.943055] pci 0000:fe:1a.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.944032] pci 0000:fe:1b.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.945039] pci 0000:fe:1c.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.946047] pci 0000:fe:1d.0: [8086:2880] type 00 class 0x110100 PCIe Root Complex Integrated Endpoint
[    2.947044] pci_bus 0000:fe: on NUMA node 1
[    2.947080] ACPI: PCI Root Bridge [UB11] (domain 0000 [bus ff])
[    2.947935] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    2.948983] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    2.950026] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    2.950934] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.951996] PCI host bridge to bus 0000:ff
[    2.952935] pci_bus 0000:ff: root bus resource [bus ff]
[    2.953943] pci 0000:ff:00.0: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.955013] pci 0000:ff:00.1: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.956018] pci 0000:ff:00.2: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.957034] pci 0000:ff:00.3: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.958026] pci 0000:ff:00.4: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.959036] pci 0000:ff:00.5: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.960040] pci 0000:ff:00.6: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.961041] pci 0000:ff:00.7: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.962040] pci 0000:ff:01.0: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.963036] pci 0000:ff:01.1: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.964032] pci 0000:ff:01.2: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.965043] pci 0000:ff:01.3: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.966048] pci 0000:ff:01.4: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.967043] pci 0000:ff:01.5: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.968051] pci 0000:ff:01.6: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.969048] pci 0000:ff:01.7: [8086:324c] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.970059] pci 0000:ff:0a.0: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.971028] pci 0000:ff:0a.1: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.972017] pci 0000:ff:0a.2: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.973030] pci 0000:ff:0a.3: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.974026] pci 0000:ff:0a.4: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.975039] pci 0000:ff:0a.5: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.976035] pci 0000:ff:0a.6: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.977041] pci 0000:ff:0a.7: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.978039] pci 0000:ff:0b.0: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.979024] pci 0000:ff:0b.1: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.980031] pci 0000:ff:0b.2: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.981043] pci 0000:ff:0b.3: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.982049] pci 0000:ff:0b.4: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.983044] pci 0000:ff:0b.5: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.984051] pci 0000:ff:0b.6: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.985047] pci 0000:ff:0b.7: [8086:324d] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.986068] pci 0000:ff:1d.0: [8086:344f] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.987034] pci 0000:ff:1d.1: [8086:3457] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint
[    2.988021] pci 0000:ff:1e.0: [8086:3258] type 00 class 0x088000 conventional PCI endpoint
[    2.988997] pci 0000:ff:1e.1: [8086:3259] type 00 class 0x088000 conventional PCI endpoint
[    2.989987] pci 0000:ff:1e.2: [8086:325a] type 00 class 0x088000 conventional PCI endpoint
[    2.990984] pci 0000:ff:1e.3: [8086:325b] type 00 class 0x088000 conventional PCI endpoint
[    2.991983] pci 0000:ff:1e.4: [8086:325c] type 00 class 0x088000 conventional PCI endpoint
[    2.992985] pci 0000:ff:1e.5: [8086:325d] type 00 class 0x088000 conventional PCI endpoint
[    2.993983] pci 0000:ff:1e.6: [8086:325e] type 00 class 0x088000 conventional PCI endpoint
[    2.994984] pci 0000:ff:1e.7: [8086:325f] type 00 class 0x088000 conventional PCI endpoint
[    2.995981] pci_bus 0000:ff: on NUMA node 1
[    2.997491] acpi/hmat: Memory Flags:0001 Processor Domain:0 Memory Domain:0
[    2.997935] acpi/hmat: Memory Flags:0001 Processor Domain:1 Memory Domain:1
[    2.999043] iommu: Default domain type: Passthrough (set via kernel command line)
[    3.000009] SCSI subsystem initialized
[    3.000955] ACPI: bus type USB registered
[    3.001945] usbcore: registered new interface driver usbfs
[    3.002939] usbcore: registered new interface driver hub
[    3.003952] usbcore: registered new device driver usb
[    3.004952] pps_core: LinuxPPS API ver. 1 registered
[    3.005935] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[    3.006936] PTP clock support registered
[    3.007978] EDAC MC: Ver: 3.0.0
[    3.009429] NetLabel: Initializing
[    3.009935] NetLabel:  domain hash size = 128
[    3.010935] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    3.011945] NetLabel:  unlabeled traffic allowed by default
[    3.012937] PCI: Using ACPI for IRQ routing
[    3.017287] PCI: pci_cache_line_size set to 64 bytes
[    3.017770] resource: Expanded resource Reserved due to conflict with PNP0003:00
[    3.017935] e820: reserve RAM buffer [mem 0x0009c000-0x0009ffff]
[    3.017936] e820: reserve RAM buffer [mem 0x44dc1000-0x47ffffff]
[    3.017937] e820: reserve RAM buffer [mem 0x4e042000-0x4fffffff]
[    3.017938] e820: reserve RAM buffer [mem 0x641fe000-0x67ffffff]
[    3.017939] e820: reserve RAM buffer [mem 0x77800000-0x77ffffff]
[    3.018057] pci 0000:03:00.0: vgaarb: setting as boot VGA device
[    3.018934] pci 0000:03:00.0: vgaarb: bridge control possible
[    3.018934] pci 0000:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    3.018959] vgaarb: loaded
[    3.020002] Monitor-Mwait will be used to enter C-1 state
[    3.020935] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    3.021935] hpet0: 8 comparators, 64-bit 25.000000 MHz counter
[    3.024998] clocksource: Switched to clocksource tsc-early
[    3.030628] VFS: Disk quotas dquot_6.6.0
[    3.034575] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.041535] pnp: PnP ACPI init
[    3.050437] system 00:01: [io  0x0500-0x05fe] has been reserved
[    3.056380] system 00:01: [io  0x0400-0x041f] has been reserved
[    3.062318] system 00:01: [io  0x0600-0x061f] has been reserved
[    3.068255] system 00:01: [io  0x0ca0-0x0ca1] has been reserved
[    3.074175] system 00:01: [io  0x0ca4-0x0ca6] has been reserved
[    3.080095] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[    3.086874] system 00:02: [io  0x0500-0x05fe] has been reserved
[    3.092809] system 00:02: [mem 0xfd000000-0xfd69ffff] could not be reserved
[    3.099769] system 00:02: [mem 0xfd6c0000-0xfd6cffff] has been reserved
[    3.106399] system 00:02: [mem 0xfd6f0000-0xfdffffff] has been reserved
[    3.113032] system 00:02: [mem 0xfe000000-0xfe01ffff] could not be reserved
[    3.120010] system 00:02: [mem 0xfe200000-0xfe7fffff] has been reserved
[    3.126639] system 00:02: [mem 0xff000000-0xffffffff] has been reserved
[    3.136587] pnp: PnP ACPI: found 6 devices
[    3.147073] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    3.155999] NET: Registered PF_INET protocol family
[    3.161188] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc hugepage)
[    3.172185] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    3.181186] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, vmalloc)
[    3.189048] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc hugepage)
[    3.198568] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc hugepage)
[    3.207118] TCP: Hash tables configured (established 524288 bind 65536)
[    3.214048] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, vmalloc)
[    3.221890] UDP hash table entries: 65536 (order: 10, 4194304 bytes, vmalloc hugepage)
[    3.230408] UDP-Lite hash table entries: 65536 (order: 10, 4194304 bytes, vmalloc hugepage)
[    3.239408] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    3.245087] NET: Registered PF_XDP protocol family
[    3.249900] pci 0000:01:00.0: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.259733] pci 0000:01:00.1: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.269558] pci 0000:61:00.0: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.279393] pci 0000:61:00.1: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.289234] pci 0000:b5:00.0: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.299066] pci 0000:b5:00.1: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.308884] pci 0000:e1:00.0: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    3.318718] pci 0000:00:0c.0: bridge window [mem 0x00100000-0x000fffff] to [bus 01] add_size 100000 add_align 100000
[    3.329252] pci 0000:00:0c.0: bridge window [mem 0x90100000-0x901fffff]: assigned
[    3.336769] pci 0000:01:00.0: ROM [mem 0x90100000-0x9013ffff pref]: assigned
[    3.343837] pci 0000:01:00.1: ROM [mem 0x90140000-0x9017ffff pref]: assigned
[    3.350912] pci 0000:00:0c.0: PCI bridge to [bus 01]
[    3.355914] pci 0000:00:0c.0:   bridge window [mem 0x90100000-0x901fffff]
[    3.362702] pci 0000:00:0c.0:   bridge window [mem 0x95900000-0x959fffff 64bit pref]
[    3.370476] pci 0000:02:00.0: PCI bridge to [bus 03]
[    3.375480] pci 0000:02:00.0:   bridge window [mem 0x95000000-0x958fffff]
[    3.382270] pci 0000:02:00.0:   bridge window [mem 0x94000000-0x94ffffff 64bit pref]
[    3.390014] pci 0000:00:0e.0: PCI bridge to [bus 02-03]
[    3.395246] pci 0000:00:0e.0:   bridge window [mem 0x95000000-0x958fffff]
[    3.402040] pci 0000:00:0e.0:   bridge window [mem 0x94000000-0x94ffffff 64bit pref]
[    3.409787] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    3.415983] pci_bus 0000:00: resource 5 [io  0x1000-0x3fff window]
[    3.422163] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    3.429034] pci_bus 0000:00: resource 7 [mem 0x000c8000-0x000cffff window]
[    3.435908] pci_bus 0000:00: resource 8 [mem 0xfe010000-0xfe010fff window]
[    3.442781] pci_bus 0000:00: resource 9 [mem 0x90040000-0x95bfffff window]
[    3.449654] pci_bus 0000:00: resource 10 [mem 0x200000000000-0x20ffffffffff window]
[    3.457309] pci_bus 0000:01: resource 1 [mem 0x90100000-0x901fffff]
[    3.463573] pci_bus 0000:01: resource 2 [mem 0x95900000-0x959fffff 64bit pref]
[    3.470794] pci_bus 0000:02: resource 1 [mem 0x95000000-0x958fffff]
[    3.477058] pci_bus 0000:02: resource 2 [mem 0x94000000-0x94ffffff 64bit pref]
[    3.484282] pci_bus 0000:03: resource 1 [mem 0x95000000-0x958fffff]
[    3.490561] pci_bus 0000:03: resource 2 [mem 0x94000000-0x94ffffff 64bit pref]
[    3.497837] pci_bus 0000:0c: resource 4 [io  0x4000-0x5fff window]
[    3.504030] pci_bus 0000:0c: resource 5 [mem 0x95c00000-0x95ffffff window]
[    3.510905] pci_bus 0000:0c: resource 6 [mem 0x210000000000-0x21ffffffffff window]
[    3.518500] pci_bus 0000:21: resource 4 [io  0x6000-0x6fff window]
[    3.524693] pci_bus 0000:21: resource 5 [mem 0x96000000-0x963fffff window]
[    3.531564] pci_bus 0000:21: resource 6 [mem 0x220000000000-0x22ffffffffff window]
[    3.539146] pci_bus 0000:36: resource 4 [io  0x7000-0x7fff window]
[    3.545348] pci_bus 0000:36: resource 5 [mem 0x96400000-0x967fffff window]
[    3.552236] pci_bus 0000:36: resource 6 [mem 0x230000000000-0x23ffffffffff window]
[    3.559814] pci 0000:49:01.0: bridge window [io  0x1000-0x0fff] to [bus 4a] add_size 1000
[    3.568003] pci 0000:49:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 4a] add_size 200000 add_align 100000
[    3.579486] pci 0000:49:03.0: bridge window [io  0x1000-0x0fff] to [bus 4b] add_size 1000
[    3.587658] pci 0000:49:03.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 4b] add_size 200000 add_align 100000
[    3.599144] pci 0000:49:05.0: bridge window [io  0x1000-0x0fff] to [bus 4c] add_size 1000
[    3.607335] pci 0000:49:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 4c] add_size 200000 add_align 100000
[    3.618818] pci 0000:49:07.0: bridge window [io  0x1000-0x0fff] to [bus 4d] add_size 1000
[    3.627007] pci 0000:49:07.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 4d] add_size 200000 add_align 100000
[    3.638496] pci 0000:49:01.0: bridge window [mem 0x240000000000-0x2400001fffff 64bit pref]: assigned
[    3.647634] pci 0000:49:03.0: bridge window [mem 0x240000200000-0x2400003fffff 64bit pref]: assigned
[    3.656761] pci 0000:49:05.0: bridge window [mem 0x240000400000-0x2400005fffff 64bit pref]: assigned
[    3.665889] pci 0000:49:07.0: bridge window [mem 0x240000600000-0x2400007fffff 64bit pref]: assigned
[    3.675021] pci 0000:49:01.0: bridge window [io  0x8000-0x8fff]: assigned
[    3.681808] pci 0000:49:03.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.689634] pci 0000:49:03.0: bridge window [io  size 0x1000]: failed to assign
[    3.696942] pci 0000:49:05.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.704769] pci 0000:49:05.0: bridge window [io  size 0x1000]: failed to assign
[    3.712097] pci 0000:49:07.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.719935] pci 0000:49:07.0: bridge window [io  size 0x1000]: failed to assign
[    3.727274] pci 0000:49:07.0: bridge window [io  0x8000-0x8fff]: assigned
[    3.734093] pci 0000:49:05.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.741936] pci 0000:49:05.0: bridge window [io  size 0x1000]: failed to assign
[    3.749254] pci 0000:49:03.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.757082] pci 0000:49:03.0: bridge window [io  size 0x1000]: failed to assign
[    3.764388] pci 0000:49:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    3.772214] pci 0000:49:01.0: bridge window [io  size 0x1000]: failed to assign
[    3.779540] pci 0000:49:01.0: PCI bridge to [bus 4a]
[    3.784525] pci 0000:49:01.0:   bridge window [mem 0x97400000-0x977fffff]
[    3.791326] pci 0000:49:01.0:   bridge window [mem 0x240000000000-0x2400001fffff 64bit pref]
[    3.799777] pci 0000:49:03.0: PCI bridge to [bus 4b]
[    3.804759] pci 0000:49:03.0:   bridge window [mem 0x97000000-0x973fffff]
[    3.811566] pci 0000:49:03.0:   bridge window [mem 0x240000200000-0x2400003fffff 64bit pref]
[    3.820017] pci 0000:49:05.0: PCI bridge to [bus 4c]
[    3.824996] pci 0000:49:05.0:   bridge window [mem 0x96c00000-0x96ffffff]
[    3.831803] pci 0000:49:05.0:   bridge window [mem 0x240000400000-0x2400005fffff 64bit pref]
[    3.840251] pci 0000:49:07.0: PCI bridge to [bus 4d]
[    3.845234] pci 0000:49:07.0:   bridge window [io  0x8000-0x8fff]
[    3.851328] pci 0000:49:07.0:   bridge window [mem 0x96800000-0x96bfffff]
[    3.858130] pci 0000:49:07.0:   bridge window [mem 0x240000600000-0x2400007fffff 64bit pref]
[    3.866585] pci_bus 0000:49: Some PCI device resources are unassigned, try booting with pci=realloc
[    3.875637] pci_bus 0000:49: resource 4 [io  0x8000-0x8fff window]
[    3.881815] pci_bus 0000:49: resource 5 [mem 0x96800000-0x97bfffff window]
[    3.888689] pci_bus 0000:49: resource 6 [mem 0x240000000000-0x24ffffffffff window]
[    3.896256] pci_bus 0000:4a: resource 1 [mem 0x97400000-0x977fffff]
[    3.902520] pci_bus 0000:4a: resource 2 [mem 0x240000000000-0x2400001fffff 64bit pref]
[    3.910435] pci_bus 0000:4b: resource 1 [mem 0x97000000-0x973fffff]
[    3.916720] pci_bus 0000:4b: resource 2 [mem 0x240000200000-0x2400003fffff 64bit pref]
[    3.924652] pci_bus 0000:4c: resource 1 [mem 0x96c00000-0x96ffffff]
[    3.930934] pci_bus 0000:4c: resource 2 [mem 0x240000400000-0x2400005fffff 64bit pref]
[    3.938847] pci_bus 0000:4d: resource 0 [io  0x8000-0x8fff]
[    3.944419] pci_bus 0000:4d: resource 1 [mem 0x96800000-0x96bfffff]
[    3.950701] pci_bus 0000:4d: resource 2 [mem 0x240000600000-0x2400007fffff 64bit pref]
[    3.958644] pci 0000:60:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 61] add_size 200000 add_align 100000
[    3.969176] pci 0000:60:01.0: bridge window [mem 0x97c00000-0x97dfffff]: assigned
[    3.976670] pci 0000:61:00.0: ROM [mem 0x97c00000-0x97cfffff pref]: assigned
[    3.983722] pci 0000:61:00.1: ROM [mem 0x97d00000-0x97dfffff pref]: assigned
[    3.990771] pci 0000:60:01.0: PCI bridge to [bus 61]
[    3.995737] pci 0000:60:01.0:   bridge window [mem 0x97c00000-0x97dfffff]
[    4.002538] pci 0000:60:01.0:   bridge window [mem 0x25fff6000000-0x25ffff7fffff 64bit pref]
[    4.010975] pci_bus 0000:60: resource 4 [io  0x9000-0x9fff window]
[    4.017167] pci_bus 0000:60: resource 5 [mem 0x97c00000-0xc7ffffff window]
[    4.024043] pci_bus 0000:60: resource 6 [mem 0x250000000000-0x25ffffffffff window]
[    4.031628] pci_bus 0000:61: resource 1 [mem 0x97c00000-0x97dfffff]
[    4.037909] pci_bus 0000:61: resource 2 [mem 0x25fff6000000-0x25ffff7fffff 64bit pref]
[    4.045836] pci_bus 0000:75: resource 4 [mem 0xc8000000-0xc87fffff window]
[    4.052730] pci_bus 0000:75: resource 5 [mem 0x260000000000-0x26ffffffffff window]
[    4.060354] pci_bus 0000:8a: resource 4 [mem 0xc9400000-0xc97fffff window]
[    4.067238] pci_bus 0000:8a: resource 5 [mem 0x280000000000-0x28ffffffffff window]
[    4.074815] pci_bus 0000:9f: resource 4 [mem 0xc9800000-0xc9bfffff window]
[    4.081700] pci_bus 0000:9f: resource 5 [mem 0x290000000000-0x29ffffffffff window]
[    4.089279] pci 0000:b4:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus b5] add_size 200000 add_align 100000
[    4.099811] pci 0000:b4:01.0: bridge window [mem 0xc9c00000-0xc9dfffff]: assigned
[    4.107306] pci 0000:b5:00.0: ROM [mem 0xc9c00000-0xc9cfffff pref]: assigned
[    4.114352] pci 0000:b5:00.1: ROM [mem 0xc9d00000-0xc9dfffff pref]: assigned
[    4.121398] pci 0000:b4:01.0: PCI bridge to [bus b5]
[    4.126367] pci 0000:b4:01.0:   bridge window [mem 0xc9c00000-0xc9dfffff]
[    4.133170] pci 0000:b4:01.0:   bridge window [mem 0xca000000-0xd0ffffff 64bit pref]
[    4.140928] pci_bus 0000:b4: resource 4 [mem 0xc9c00000-0xd13fffff window]
[    4.147817] pci_bus 0000:b4: resource 5 [mem 0x2a0000000000-0x2affffffffff window]
[    4.155399] pci_bus 0000:b5: resource 1 [mem 0xc9c00000-0xc9dfffff]
[    4.161669] pci_bus 0000:b5: resource 2 [mem 0xca000000-0xd0ffffff 64bit pref]
[    4.168932] pci 0000:c9:01.0: bridge window [io  0x1000-0x0fff] to [bus ca] add_size 1000
[    4.177124] pci 0000:c9:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus ca] add_size 200000 add_align 100000
[    4.188605] pci 0000:c9:03.0: bridge window [io  0x1000-0x0fff] to [bus cb] add_size 1000
[    4.196790] pci 0000:c9:03.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus cb] add_size 200000 add_align 100000
[    4.208258] pci 0000:c9:05.0: bridge window [io  0x1000-0x0fff] to [bus cc] add_size 1000
[    4.216447] pci 0000:c9:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus cc] add_size 200000 add_align 100000
[    4.227933] pci 0000:c9:07.0: bridge window [io  0x1000-0x0fff] to [bus cd] add_size 1000
[    4.236104] pci 0000:c9:07.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus cd] add_size 200000 add_align 100000
[    4.247580] pci 0000:c9:01.0: bridge window [mem 0x2b0000000000-0x2b00001fffff 64bit pref]: assigned
[    4.256723] pci 0000:c9:03.0: bridge window [mem 0x2b0000200000-0x2b00003fffff 64bit pref]: assigned
[    4.265866] pci 0000:c9:05.0: bridge window [mem 0x2b0000400000-0x2b00005fffff 64bit pref]: assigned
[    4.274995] pci 0000:c9:07.0: bridge window [mem 0x2b0000600000-0x2b00007fffff 64bit pref]: assigned
[    4.284119] pci 0000:c9:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.291947] pci 0000:c9:01.0: bridge window [io  size 0x1000]: failed to assign
[    4.299272] pci 0000:c9:03.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.307114] pci 0000:c9:03.0: bridge window [io  size 0x1000]: failed to assign
[    4.314421] pci 0000:c9:05.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.322245] pci 0000:c9:05.0: bridge window [io  size 0x1000]: failed to assign
[    4.329554] pci 0000:c9:07.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.337378] pci 0000:c9:07.0: bridge window [io  size 0x1000]: failed to assign
[    4.344688] pci 0000:c9:07.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.352533] pci 0000:c9:07.0: bridge window [io  size 0x1000]: failed to assign
[    4.359855] pci 0000:c9:05.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.367691] pci 0000:c9:05.0: bridge window [io  size 0x1000]: failed to assign
[    4.375003] pci 0000:c9:03.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.382832] pci 0000:c9:03.0: bridge window [io  size 0x1000]: failed to assign
[    4.390151] pci 0000:c9:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    4.397981] pci 0000:c9:01.0: bridge window [io  size 0x1000]: failed to assign
[    4.405295] pci 0000:c9:01.0: PCI bridge to [bus ca]
[    4.410285] pci 0000:c9:01.0:   bridge window [mem 0xd2000000-0xd23fffff]
[    4.417091] pci 0000:c9:01.0:   bridge window [mem 0x2b0000000000-0x2b00001fffff 64bit pref]
[    4.425542] pci 0000:c9:03.0: PCI bridge to [bus cb]
[    4.430525] pci 0000:c9:03.0:   bridge window [mem 0xd1c00000-0xd1ffffff]
[    4.437327] pci 0000:c9:03.0:   bridge window [mem 0x2b0000200000-0x2b00003fffff 64bit pref]
[    4.445762] pci 0000:c9:05.0: PCI bridge to [bus cc]
[    4.450747] pci 0000:c9:05.0:   bridge window [mem 0xd1800000-0xd1bfffff]
[    4.457550] pci 0000:c9:05.0:   bridge window [mem 0x2b0000400000-0x2b00005fffff 64bit pref]
[    4.466001] pci 0000:c9:07.0: PCI bridge to [bus cd]
[    4.470982] pci 0000:c9:07.0:   bridge window [mem 0xd1400000-0xd17fffff]
[    4.477785] pci 0000:c9:07.0:   bridge window [mem 0x2b0000600000-0x2b00007fffff 64bit pref]
[    4.486230] pci_bus 0000:c9: Some PCI device resources are unassigned, try booting with pci=realloc
[    4.495286] pci_bus 0000:c9: resource 4 [mem 0xd1400000-0xd27fffff window]
[    4.502170] pci_bus 0000:c9: resource 5 [mem 0x2b0000000000-0x2bffffffffff window]
[    4.509737] pci_bus 0000:ca: resource 1 [mem 0xd2000000-0xd23fffff]
[    4.516004] pci_bus 0000:ca: resource 2 [mem 0x2b0000000000-0x2b00001fffff 64bit pref]
[    4.523919] pci_bus 0000:cb: resource 1 [mem 0xd1c00000-0xd1ffffff]
[    4.530186] pci_bus 0000:cb: resource 2 [mem 0x2b0000200000-0x2b00003fffff 64bit pref]
[    4.538098] pci_bus 0000:cc: resource 1 [mem 0xd1800000-0xd1bfffff]
[    4.544364] pci_bus 0000:cc: resource 2 [mem 0x2b0000400000-0x2b00005fffff 64bit pref]
[    4.552276] pci_bus 0000:cd: resource 1 [mem 0xd1400000-0xd17fffff]
[    4.558544] pci_bus 0000:cd: resource 2 [mem 0x2b0000600000-0x2b00007fffff 64bit pref]
[    4.566484] pci 0000:e1:00.0: ROM [mem size 0x00100000 pref]: can't assign; no space
[    4.574240] pci 0000:e1:00.0: ROM [mem size 0x00100000 pref]: failed to assign
[    4.581461] pci 0000:e0:05.0: PCI bridge to [bus e1]
[    4.586442] pci 0000:e0:05.0:   bridge window [io  0xa000-0xafff]
[    4.592558] pci 0000:e0:05.0:   bridge window [mem 0xd2a00000-0xd2afffff]
[    4.599355] pci 0000:e0:05.0:   bridge window [mem 0xd2800000-0xd29fffff 64bit pref]
[    4.607119] pci_bus 0000:e0: Some PCI device resources are unassigned, try booting with pci=realloc
[    4.616170] pci_bus 0000:e0: resource 4 [io  0xa000-0xffff window]
[    4.622351] pci_bus 0000:e0: resource 5 [mem 0xd2800000-0xfaffffff window]
[    4.629239] pci_bus 0000:e0: resource 6 [mem 0x2c0000000000-0x2cffffffffff window]
[    4.636809] pci_bus 0000:e1: resource 0 [io  0xa000-0xafff]
[    4.642396] pci_bus 0000:e1: resource 1 [mem 0xd2a00000-0xd2afffff]
[    4.648681] pci_bus 0000:e1: resource 2 [mem 0xd2800000-0xd29fffff 64bit pref]
[    4.655940] pci_bus 0000:80: resource 4 [mem 0xc9000000-0xc93fffff window]
[    4.662836] pci_bus 0000:80: resource 5 [mem 0x270000000000-0x27ffffffffff window]
[    4.670429] pci_bus 0000:f2: resource 4 [mem 0xfb000000-0xfb7fffff window]
[    4.677318] pci_bus 0000:f2: resource 5 [mem 0x2d0000000000-0x2dffffffffff window]
[    4.686418] PCI: CLS 0 bytes, default 64
[    4.690464] Trying to unpack rootfs image as initramfs...
[    4.690519] DMAR: dmar12: Using Queued invalidation
[    4.700783] dmar12 SVM disabled, incompatible paging mode
[    4.706199] DMAR: dmar11: Using Queued invalidation
[    4.711093] DMAR: dmar10: Using Queued invalidation
[    4.715993] DMAR: dmar9: Using Queued invalidation
[    4.720802] DMAR: dmar8: Using Queued invalidation
[    4.725612] DMAR: dmar7: Using Queued invalidation
[    4.730413] DMAR: dmar6: Using Queued invalidation
[    4.735223] dmar6 SVM disabled, incompatible paging mode
[    4.740554] DMAR: dmar5: Using Queued invalidation
[    4.745365] DMAR: dmar4: Using Queued invalidation
[    4.750174] DMAR: dmar3: Using Queued invalidation
[    4.754984] DMAR: dmar2: Using Queued invalidation
[    4.759795] DMAR: dmar1: Using Queued invalidation
[    4.764606] DMAR: dmar0: Using Queued invalidation
[    4.769419] DMAR: dmar13: Using Queued invalidation
[    4.774721] pci 0000:75:00.4: Adding to iommu group 0
[    4.779854] pci 0000:75:01.0: Adding to iommu group 1
[    4.785081] pci 0000:60:00.4: Adding to iommu group 2
[    4.790184] pci 0000:60:01.0: Adding to iommu group 3
[    4.795303] pci 0000:61:00.0: Adding to iommu group 4
[    4.800418] pci 0000:61:00.1: Adding to iommu group 5
[    4.805531] pci 0000:61:00.2: Adding to iommu group 6
[    4.810722] pci 0000:49:00.4: Adding to iommu group 7
[    4.815824] pci 0000:49:01.0: Adding to iommu group 8
[    4.820929] pci 0000:49:03.0: Adding to iommu group 9
[    4.826032] pci 0000:49:05.0: Adding to iommu group 10
[    4.831224] pci 0000:49:07.0: Adding to iommu group 11
[    4.836703] pci 0000:36:00.4: Adding to iommu group 12
[    4.841987] pci 0000:21:00.4: Adding to iommu group 13
[    4.847268] pci 0000:0c:00.4: Adding to iommu group 14
[    4.852565] pci 0000:f2:00.4: Adding to iommu group 15
[    4.857764] pci 0000:f2:01.0: Adding to iommu group 16
[    4.863030] pci 0000:80:00.4: Adding to iommu group 17
[    4.868299] pci 0000:e0:00.4: Adding to iommu group 18
[    4.873481] pci 0000:e0:05.0: Adding to iommu group 19
[    4.878665] pci 0000:e1:00.0: Adding to iommu group 20
[    4.883927] pci 0000:c9:00.4: Adding to iommu group 21
[    4.889115] pci 0000:c9:01.0: Adding to iommu group 22
[    4.894297] pci 0000:c9:03.0: Adding to iommu group 23
[    4.899480] pci 0000:c9:05.0: Adding to iommu group 24
[    4.904666] pci 0000:c9:07.0: Adding to iommu group 25
[    4.909927] pci 0000:b4:00.4: Adding to iommu group 26
[    4.915108] pci 0000:b4:01.0: Adding to iommu group 27
[    4.920309] pci 0000:b5:00.0: Adding to iommu group 28
[    4.925508] pci 0000:b5:00.1: Adding to iommu group 29
[    4.930769] pci 0000:9f:00.4: Adding to iommu group 30
[    4.936034] pci 0000:8a:00.4: Adding to iommu group 31
[    4.941242] pci 0000:00:00.0: Adding to iommu group 32
[    4.946433] pci 0000:00:00.1: Adding to iommu group 33
[    4.951624] pci 0000:00:00.2: Adding to iommu group 34
[    4.956829] pci 0000:00:00.4: Adding to iommu group 35
[    4.962013] pci 0000:00:0c.0: Adding to iommu group 36
[    4.967196] pci 0000:00:0e.0: Adding to iommu group 37
[    4.972429] pci 0000:00:14.0: Adding to iommu group 38
[    4.977616] pci 0000:00:14.2: Adding to iommu group 38
[    4.982796] pci 0000:00:14.4: Adding to iommu group 39
[    4.987979] pci 0000:00:15.0: Adding to iommu group 40
[    4.993185] pci 0000:00:16.0: Adding to iommu group 41
[    4.998370] pci 0000:00:18.0: Adding to iommu group 42
[    5.003554] pci 0000:00:19.0: Adding to iommu group 43
[    5.008813] pci 0000:00:1f.0: Adding to iommu group 44
[    5.013996] pci 0000:00:1f.4: Adding to iommu group 44
[    5.019181] pci 0000:00:1f.5: Adding to iommu group 44
[    5.024430] pci 0000:01:00.0: Adding to iommu group 45
[    5.029635] pci 0000:01:00.1: Adding to iommu group 45
[    5.034830] pci 0000:02:00.0: Adding to iommu group 46
[    5.039990] pci 0000:03:00.0: Adding to iommu group 46
[    5.045173] pci 0000:0c:00.0: Adding to iommu group 47
[    5.050357] pci 0000:0c:00.1: Adding to iommu group 48
[    5.055537] pci 0000:0c:00.2: Adding to iommu group 49
[    5.060720] pci 0000:21:00.0: Adding to iommu group 50
[    5.065904] pci 0000:21:00.1: Adding to iommu group 51
[    5.071088] pci 0000:21:00.2: Adding to iommu group 52
[    5.076270] pci 0000:36:00.0: Adding to iommu group 53
[    5.081450] pci 0000:36:00.1: Adding to iommu group 54
[    5.086643] pci 0000:36:00.2: Adding to iommu group 55
[    5.091827] pci 0000:49:00.0: Adding to iommu group 56
[    5.097010] pci 0000:49:00.1: Adding to iommu group 57
[    5.102193] pci 0000:49:00.2: Adding to iommu group 58
[    5.107375] pci 0000:60:00.0: Adding to iommu group 59
[    5.112556] pci 0000:60:00.1: Adding to iommu group 60
[    5.117738] pci 0000:60:00.2: Adding to iommu group 61
[    5.122926] pci 0000:75:00.0: Adding to iommu group 62
[    5.128108] pci 0000:75:00.1: Adding to iommu group 63
[    5.133291] pci 0000:75:00.2: Adding to iommu group 64
[    5.138473] pci 0000:75:03.0: Adding to iommu group 65
[    5.143657] pci 0000:75:03.1: Adding to iommu group 66
[    5.148842] pci 0000:7e:00.0: Adding to iommu group 67
[    5.154030] pci 0000:7e:00.1: Adding to iommu group 68
[    5.159212] pci 0000:7e:00.2: Adding to iommu group 69
[    5.164397] pci 0000:7e:00.3: Adding to iommu group 70
[    5.169579] pci 0000:7e:00.5: Adding to iommu group 71
[    5.174762] pci 0000:7e:01.0: Adding to iommu group 72
[    5.179947] pci 0000:7e:01.1: Adding to iommu group 73
[    5.185223] pci 0000:7e:01.2: Adding to iommu group 74
[    5.190420] pci 0000:7e:02.0: Adding to iommu group 75
[    5.195610] pci 0000:7e:02.1: Adding to iommu group 76
[    5.200803] pci 0000:7e:02.2: Adding to iommu group 77
[    5.205994] pci 0000:7e:05.0: Adding to iommu group 78
[    5.211182] pci 0000:7e:05.1: Adding to iommu group 79
[    5.216366] pci 0000:7e:05.2: Adding to iommu group 80
[    5.221550] pci 0000:7e:06.0: Adding to iommu group 81
[    5.226741] pci 0000:7e:06.1: Adding to iommu group 82
[    5.231929] pci 0000:7e:06.2: Adding to iommu group 83
[    5.237114] pci 0000:7e:07.0: Adding to iommu group 84
[    5.242297] pci 0000:7e:07.1: Adding to iommu group 85
[    5.247479] pci 0000:7e:07.2: Adding to iommu group 86
[    5.252664] pci 0000:7e:0c.0: Adding to iommu group 87
[    5.257855] pci 0000:7e:0d.0: Adding to iommu group 88
[    5.263046] pci 0000:7e:0e.0: Adding to iommu group 89
[    5.268226] pci 0000:7e:0f.0: Adding to iommu group 90
[    5.273413] pci 0000:7e:1a.0: Adding to iommu group 91
[    5.278602] pci 0000:7e:1b.0: Adding to iommu group 92
[    5.283786] pci 0000:7e:1c.0: Adding to iommu group 93
[    5.288966] pci 0000:7e:1d.0: Adding to iommu group 94
[    5.294152] pci 0000:7f:00.0: Adding to iommu group 95
[    5.299333] pci 0000:7f:00.1: Adding to iommu group 96
[    5.304514] pci 0000:7f:00.2: Adding to iommu group 97
[    5.309698] pci 0000:7f:00.3: Adding to iommu group 98
[    5.314885] pci 0000:7f:00.4: Adding to iommu group 99
[    5.320073] pci 0000:7f:00.5: Adding to iommu group 100
[    5.325344] pci 0000:7f:00.6: Adding to iommu group 101
[    5.330617] pci 0000:7f:00.7: Adding to iommu group 102
[    5.335884] pci 0000:7f:01.0: Adding to iommu group 103
[    5.341161] pci 0000:7f:01.1: Adding to iommu group 104
[    5.346429] pci 0000:7f:01.2: Adding to iommu group 105
[    5.351701] pci 0000:7f:01.3: Adding to iommu group 106
[    5.356969] pci 0000:7f:01.4: Adding to iommu group 107
[    5.362237] pci 0000:7f:01.5: Adding to iommu group 108
[    5.367509] pci 0000:7f:01.6: Adding to iommu group 109
[    5.372806] pci 0000:7f:01.7: Adding to iommu group 110
[    5.378179] pci 0000:7f:0a.0: Adding to iommu group 111
[    5.383464] pci 0000:7f:0a.1: Adding to iommu group 112
[    5.388738] pci 0000:7f:0a.2: Adding to iommu group 113
[    5.394013] pci 0000:7f:0a.3: Adding to iommu group 114
[    5.399283] pci 0000:7f:0a.4: Adding to iommu group 115
[    5.404559] pci 0000:7f:0a.5: Adding to iommu group 116
[    5.409831] pci 0000:7f:0a.6: Adding to iommu group 117
[    5.415108] pci 0000:7f:0a.7: Adding to iommu group 118
[    5.420375] pci 0000:7f:0b.0: Adding to iommu group 119
[    5.425646] pci 0000:7f:0b.1: Adding to iommu group 120
[    5.430918] pci 0000:7f:0b.2: Adding to iommu group 121
[    5.436192] pci 0000:7f:0b.3: Adding to iommu group 122
[    5.441464] pci 0000:7f:0b.4: Adding to iommu group 123
[    5.446733] pci 0000:7f:0b.5: Adding to iommu group 124
[    5.452003] pci 0000:7f:0b.6: Adding to iommu group 125
[    5.457270] pci 0000:7f:0b.7: Adding to iommu group 126
[    5.462542] pci 0000:7f:1d.0: Adding to iommu group 127
[    5.467812] pci 0000:7f:1d.1: Adding to iommu group 128
[    5.473287] pci 0000:7f:1e.0: Adding to iommu group 129
[    5.478569] pci 0000:7f:1e.1: Adding to iommu group 129
[    5.483856] pci 0000:7f:1e.2: Adding to iommu group 129
[    5.489146] pci 0000:7f:1e.3: Adding to iommu group 129
[    5.494431] pci 0000:7f:1e.4: Adding to iommu group 129
[    5.499717] pci 0000:7f:1e.5: Adding to iommu group 129
[    5.505003] pci 0000:7f:1e.6: Adding to iommu group 129
[    5.510288] pci 0000:7f:1e.7: Adding to iommu group 129
[    5.515557] pci 0000:80:00.0: Adding to iommu group 130
[    5.520826] pci 0000:80:00.1: Adding to iommu group 131
[    5.526102] pci 0000:80:00.2: Adding to iommu group 132
[    5.531377] pci 0000:8a:00.0: Adding to iommu group 133
[    5.536654] pci 0000:8a:00.1: Adding to iommu group 134
[    5.541922] pci 0000:8a:00.2: Adding to iommu group 135
[    5.547194] pci 0000:9f:00.0: Adding to iommu group 136
[    5.552470] pci 0000:9f:00.1: Adding to iommu group 137
[    5.557738] pci 0000:9f:00.2: Adding to iommu group 138
[    5.563008] pci 0000:b4:00.0: Adding to iommu group 139
[    5.568278] pci 0000:b4:00.1: Adding to iommu group 140
[    5.573549] pci 0000:b4:00.2: Adding to iommu group 141
[    5.578822] pci 0000:c9:00.0: Adding to iommu group 142
[    5.584096] pci 0000:c9:00.1: Adding to iommu group 143
[    5.589365] pci 0000:c9:00.2: Adding to iommu group 144
[    5.594639] pci 0000:e0:00.0: Adding to iommu group 145
[    5.599912] pci 0000:e0:00.1: Adding to iommu group 146
[    5.605184] pci 0000:e0:00.2: Adding to iommu group 147
[    5.610461] pci 0000:f2:00.0: Adding to iommu group 148
[    5.615729] pci 0000:f2:00.1: Adding to iommu group 149
[    5.621001] pci 0000:f2:00.2: Adding to iommu group 150
[    5.626271] pci 0000:f2:03.0: Adding to iommu group 151
[    5.631546] pci 0000:f2:03.1: Adding to iommu group 152
[    5.636818] pci 0000:fe:00.0: Adding to iommu group 153
[    5.642084] pci 0000:fe:00.1: Adding to iommu group 154
[    5.647355] pci 0000:fe:00.2: Adding to iommu group 155
[    5.652628] pci 0000:fe:00.3: Adding to iommu group 156
[    5.657901] pci 0000:fe:00.5: Adding to iommu group 157
[    5.663178] pci 0000:fe:01.0: Adding to iommu group 158
[    5.668451] pci 0000:fe:01.1: Adding to iommu group 159
[    5.673720] pci 0000:fe:01.2: Adding to iommu group 160
[    5.678989] pci 0000:fe:02.0: Adding to iommu group 161
[    5.684259] pci 0000:fe:02.1: Adding to iommu group 162
[    5.689527] pci 0000:fe:02.2: Adding to iommu group 163
[    5.694798] pci 0000:fe:05.0: Adding to iommu group 164
[    5.700067] pci 0000:fe:05.1: Adding to iommu group 165
[    5.705337] pci 0000:fe:05.2: Adding to iommu group 166
[    5.710610] pci 0000:fe:06.0: Adding to iommu group 167
[    5.715886] pci 0000:fe:06.1: Adding to iommu group 168
[    5.721153] pci 0000:fe:06.2: Adding to iommu group 169
[    5.726425] pci 0000:fe:07.0: Adding to iommu group 170
[    5.731692] pci 0000:fe:07.1: Adding to iommu group 171
[    5.736963] pci 0000:fe:07.2: Adding to iommu group 172
[    5.742233] pci 0000:fe:0c.0: Adding to iommu group 173
[    5.747501] pci 0000:fe:0d.0: Adding to iommu group 174
[    5.752771] pci 0000:fe:0e.0: Adding to iommu group 175
[    5.758047] pci 0000:fe:0f.0: Adding to iommu group 176
[    5.763320] pci 0000:fe:1a.0: Adding to iommu group 177
[    5.768688] pci 0000:fe:1b.0: Adding to iommu group 178
[    5.773966] pci 0000:fe:1c.0: Adding to iommu group 179
[    5.779243] pci 0000:fe:1d.0: Adding to iommu group 180
[    5.784526] pci 0000:ff:00.0: Adding to iommu group 181
[    5.789798] pci 0000:ff:00.1: Adding to iommu group 182
[    5.795068] pci 0000:ff:00.2: Adding to iommu group 183
[    5.800336] pci 0000:ff:00.3: Adding to iommu group 184
[    5.805611] pci 0000:ff:00.4: Adding to iommu group 185
[    5.810896] pci 0000:ff:00.5: Adding to iommu group 186
[    5.816170] pci 0000:ff:00.6: Adding to iommu group 187
[    5.821444] pci 0000:ff:00.7: Adding to iommu group 188
[    5.826719] pci 0000:ff:01.0: Adding to iommu group 189
[    5.831989] pci 0000:ff:01.1: Adding to iommu group 190
[    5.837257] pci 0000:ff:01.2: Adding to iommu group 191
[    5.842530] pci 0000:ff:01.3: Adding to iommu group 192
[    5.847805] pci 0000:ff:01.4: Adding to iommu group 193
[    5.853074] pci 0000:ff:01.5: Adding to iommu group 194
[    5.858344] pci 0000:ff:01.6: Adding to iommu group 195
[    5.863616] pci 0000:ff:01.7: Adding to iommu group 196
[    5.868883] pci 0000:ff:0a.0: Adding to iommu group 197
[    5.874152] pci 0000:ff:0a.1: Adding to iommu group 198
[    5.879425] pci 0000:ff:0a.2: Adding to iommu group 199
[    5.884701] pci 0000:ff:0a.3: Adding to iommu group 200
[    5.889970] pci 0000:ff:0a.4: Adding to iommu group 201
[    5.895238] pci 0000:ff:0a.5: Adding to iommu group 202
[    5.900510] pci 0000:ff:0a.6: Adding to iommu group 203
[    5.905779] pci 0000:ff:0a.7: Adding to iommu group 204
[    5.911045] pci 0000:ff:0b.0: Adding to iommu group 205
[    5.916319] pci 0000:ff:0b.1: Adding to iommu group 206
[    5.921587] pci 0000:ff:0b.2: Adding to iommu group 207
[    5.926863] pci 0000:ff:0b.3: Adding to iommu group 208
[    5.932134] pci 0000:ff:0b.4: Adding to iommu group 209
[    5.937408] pci 0000:ff:0b.5: Adding to iommu group 210
[    5.942686] pci 0000:ff:0b.6: Adding to iommu group 211
[    5.947960] pci 0000:ff:0b.7: Adding to iommu group 212
[    5.953230] pci 0000:ff:1d.0: Adding to iommu group 213
[    5.958510] pci 0000:ff:1d.1: Adding to iommu group 214
[    5.964046] pci 0000:ff:1e.0: Adding to iommu group 215
[    5.969344] pci 0000:ff:1e.1: Adding to iommu group 215
[    5.974640] pci 0000:ff:1e.2: Adding to iommu group 215
[    5.979931] pci 0000:ff:1e.3: Adding to iommu group 215
[    5.985226] pci 0000:ff:1e.4: Adding to iommu group 215
[    5.990523] pci 0000:ff:1e.5: Adding to iommu group 215
[    5.995817] pci 0000:ff:1e.6: Adding to iommu group 215
[    6.001113] pci 0000:ff:1e.7: Adding to iommu group 215
[    6.006597] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    6.013053] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    6.019494] software IO TLB: mapped [mem 0x00000000601fe000-0x00000000641fe000] (64MB)
[    6.027434] ACPI: bus type thunderbolt registered
[    6.032291] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x39a85c9bff6, max_idle_ns: 881590591483 ns
[    6.042372] clocksource: Switched to clocksource tsc
[    6.050549] Initialise system trusted keyrings
[    6.055025] Key type blacklist registered
[    6.059166] workingset: timestamp_bits=36 max_order=27 bucket_order=0
[    6.066082] integrity: Platform Keyring initialized
[    6.070983] integrity: Machine keyring initialized
[    6.075881] cryptd: max_cpu_qlen set to 1000
[    6.087803] NET: Registered PF_ALG protocol family
[    6.092613] Key type asymmetric registered
[    6.096724] Asymmetric key parser 'x509' registered
[    6.101619] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246)
[    6.109080] io scheduler mq-deadline registered
[    6.113627] io scheduler kyber registered
[    6.117646] io scheduler bfq registered
[    6.121827] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[    6.129068] pcieport 0000:00:00.4: PME: Signaling with IRQ 136
[    6.135193] pcieport 0000:00:0c.0: PME: Signaling with IRQ 137
[    6.141335] pcieport 0000:00:0e.0: PME: Signaling with IRQ 138
[    6.147414] pcieport 0000:0c:00.4: PME: Signaling with IRQ 139
[    6.153403] pcieport 0000:21:00.4: PME: Signaling with IRQ 140
[    6.159387] pcieport 0000:36:00.4: PME: Signaling with IRQ 141
[    6.165391] pcieport 0000:49:00.4: PME: Signaling with IRQ 142
[    6.171385] pcieport 0000:49:01.0: PME: Signaling with IRQ 143
[    6.177250] pcieport 0000:49:01.0: pciehp: Slot #164 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.193272] pcieport 0000:49:03.0: PME: Signaling with IRQ 144
[    6.199131] pcieport 0000:49:03.0: pciehp: Slot #165 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.215132] pcieport 0000:49:05.0: PME: Signaling with IRQ 145
[    6.220999] pcieport 0000:49:05.0: pciehp: Slot #166 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.237005] pcieport 0000:49:07.0: PME: Signaling with IRQ 146
[    6.242863] pcieport 0000:49:07.0: pciehp: Slot #167 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.258869] pcieport 0000:60:00.4: PME: Signaling with IRQ 147
[    6.264863] pcieport 0000:60:01.0: PME: Signaling with IRQ 148
[    6.270853] pcieport 0000:75:00.4: PME: Signaling with IRQ 149
[    6.277015] pcieport 0000:80:00.4: PME: Signaling with IRQ 150
[    6.283023] pcieport 0000:8a:00.4: PME: Signaling with IRQ 151
[    6.289009] pcieport 0000:9f:00.4: PME: Signaling with IRQ 152
[    6.295004] pcieport 0000:b4:00.4: PME: Signaling with IRQ 153
[    6.300994] pcieport 0000:b4:01.0: PME: Signaling with IRQ 154
[    6.306994] pcieport 0000:c9:00.4: PME: Signaling with IRQ 155
[    6.312981] pcieport 0000:c9:01.0: PME: Signaling with IRQ 156
[    6.318857] pcieport 0000:c9:01.0: pciehp: Slot #160 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.334891] pcieport 0000:c9:03.0: PME: Signaling with IRQ 157
[    6.340760] pcieport 0000:c9:03.0: pciehp: Slot #161 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.356786] pcieport 0000:c9:05.0: PME: Signaling with IRQ 158
[    6.362650] pcieport 0000:c9:05.0: pciehp: Slot #162 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.378681] pcieport 0000:c9:07.0: PME: Signaling with IRQ 159
[    6.384544] pcieport 0000:c9:07.0: pciehp: Slot #163 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[    6.400562] pcieport 0000:e0:00.4: PME: Signaling with IRQ 160
[    6.406545] pcieport 0000:e0:05.0: PME: Signaling with IRQ 161
[    6.412543] pcieport 0000:f2:00.4: PME: Signaling with IRQ 162
[    6.419153] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    6.427581] ACPI: button: Power Button [PWRB]
[    6.432012] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    6.439477] ACPI: button: Power Button [PWRF]
[    6.445723] ERST: Error Record Serialization Table (ERST) support is initialized.
[    6.453243] pstore: Using crash dump compression: deflate
[    6.458659] pstore: Registered erst as persistent store backend
[    6.464774] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    6.471188] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    6.478644] 00:05: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    6.486769] Non-volatile memory driver v1.3
[    6.492436] rdac: device handler registered
[    6.496689] hp_sw: device handler registered
[    6.500982] emc: device handler registered
[    6.505161] alua: device handler registered
[    6.509852] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    6.515124] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 1
[    6.523677] xhci_hcd 0000:00:14.0: hcc params 0x20007fc1 hci version 0x120 quirks 0x0000000200009810
[    6.533245] xhci_hcd 0000:00:14.0: xHCI Host Controller
[    6.538504] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2
[    6.545909] xhci_hcd 0000:00:14.0: Host supports USB 3.1 Enhanced SuperSpeed
[    6.552997] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.16
[    6.561260] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.568494] usb usb1: Product: xHCI Host Controller
[    6.573390] usb usb1: Manufacturer: Linux 6.16.0-rc2 xhci-hcd
[    6.579136] usb usb1: SerialNumber: 0000:00:14.0
[    6.583881] hub 1-0:1.0: USB hub found
[    6.587681] hub 1-0:1.0: 16 ports detected
[    6.592834] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.16
[    6.601111] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    6.608329] usb usb2: Product: xHCI Host Controller
[    6.613225] usb usb2: Manufacturer: Linux 6.16.0-rc2 xhci-hcd
[    6.618972] usb usb2: SerialNumber: 0000:00:14.0
[    6.623667] hub 2-0:1.0: USB hub found
[    6.627473] hub 2-0:1.0: 10 ports detected
[    6.632346] usbcore: registered new interface driver usbserial_generic
[    6.638894] usbserial: USB Serial support registered for generic
[    6.644948] i8042: PNP: No PS/2 controller found.
[    6.649704] mousedev: PS/2 mouse device common for all mice
[    6.655397] rtc_cmos 00:00: RTC can wake from S4
[    6.660525] rtc_cmos 00:00: registered as rtc0
[    6.665069] rtc_cmos 00:00: setting system clock to 2025-07-04T05:05:05 UTC (1751605505)
[    6.673212] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram
[    6.680563] intel_pstate: Intel P-state driver initializing
[    6.687931] hid: raw HID events driver (C) Jiri Kosina
[    6.693134] usbcore: registered new interface driver usbhid
[    6.698725] usbhid: USB HID core driver
[    6.702689] drop_monitor: Initializing network drop monitor service
[    6.709058] Initializing XFRM netlink socket
[    6.713401] NET: Registered PF_INET6 protocol family
[    6.846614] usb 1-10: new high-speed USB device number 2 using xhci_hcd
[    6.975729] usb 1-10: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00
[    6.984008] usb 1-10: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    6.991793] hub 1-10:1.0: USB hub found
[    6.995682] hub 1-10:1.0: 4 ports detected
[    7.300728] Freeing initrd memory: 173760K
[    7.309792] Segment Routing with IPv6
[    7.313484] In-situ OAM (IOAM) with IPv6
[    7.317446] NET: Registered PF_PACKET protocol family
[    7.322568] mpls_gso: MPLS GSO support
[    7.329963] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    7.336423] microcode: Current revision: 0x2b000571
[    7.342338] resctrl: L3 allocation detected
[    7.346541] resctrl: L2 allocation detected
[    7.350745] resctrl: MB allocation detected
[    7.354945] resctrl: L3 monitoring detected
[    7.359177] IPI shorthand broadcast: enabled
[    7.364869] sched_clock: Marking stable (5819002388, 1545603318)->(12021325724, -4656720018)
[    7.373490] registered taskstats version 1
[    7.378363] Loading compiled-in X.509 certificates
[    7.383678] Loaded X.509 cert 'Build time autogenerated kernel key: 10447143752510b4b6504a5b372e243769a52152'
[    7.395698] Demotion targets for Node 0: null
[    7.400076] Demotion targets for Node 1: null
[    7.404456] page_owner is disabled
[    7.408069] Key type .fscrypt registered
[    7.412022] Key type fscrypt-provisioning registered
[    7.417049] Key type big_key registered
[    7.420909] Key type encrypted registered
[    7.424952] ima: No TPM chip found, activating TPM-bypass!
[    7.430457] Loading compiled-in module X.509 certificates
[    7.436280] Loaded X.509 cert 'Build time autogenerated kernel key: 10447143752510b4b6504a5b372e243769a52152'
[    7.446204] ima: Allocated hash algorithm: sha256
[    7.450938] ima: No architecture policies found
[    7.455495] evm: Initialising EVM extended attributes:
[    7.460651] evm: security.selinux
[    7.463984] evm: security.SMACK64 (disabled)
[    7.468275] evm: security.SMACK64EXEC (disabled)
[    7.472915] evm: security.SMACK64TRANSMUTE (disabled)
[    7.477984] evm: security.SMACK64MMAP (disabled)
[    7.482622] evm: security.apparmor (disabled)
[    7.486999] evm: security.ima
[    7.489988] evm: security.capability
[    7.493565] evm: HMAC attrs: 0x1
[    7.496835] Running certificate verification RSA selftest
[    7.502712] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db'
[    7.513554] Running certificate verification ECDSA selftest
[    7.522125] Loaded X.509 cert 'Certificate verification ECDSA self-testing key: 2900bcea1deb7bc8479a84a23d758efdfdd2b2d3'
[    7.534546] clk: Disabling unused clocks
[    7.538495] PM: genpd: Disabling unused power domains
[    7.551258] Freeing unused decrypted memory: 2028K
[    7.557056] Freeing unused kernel image (initmem) memory: 4268K
[    7.563025] Write protecting the kernel read-only data: 24576k
[    7.569195] Freeing unused kernel image (text/rodata gap) memory: 400K
[    7.575819] Freeing unused kernel image (rodata/data gap) memory: 88K
[    7.591120] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    7.597581] Run /init as init process
[    7.601261]   with arguments:
[    7.601263]     /init
[    7.601264]   with environment:
[    7.601264]     HOME=/
[    7.601265]     TERM=linux
[    7.601266]     BOOT_IMAGE=(hd0,msdos1)/vmlinuz-6.16.0-rc2
[    7.606726] systemd[1]: systemd 252-51.el9_6.1 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    7.639462] systemd[1]: Detected architecture x86-64.
[    7.644530] systemd[1]: Running in initrd.
[    7.658655] systemd[1]: Hostname set to <dell-per760-18.lab.eng.pek2.redhat.com>.
[    7.700618] usb 1-10.1: new high-speed USB device number 3 using xhci_hcd
[    7.717657] systemd[1]: Queued start job for default target Initrd Default Target.
[    7.734959] systemd[1]: Created slice Slice /system/systemd-hibernate-resume.
[    7.750673] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    7.768651] systemd[1]: Reached target Initrd /usr File System.
[    7.781648] systemd[1]: Reached target Path Units.
[    7.790745] usb 1-10.1: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00
[    7.800216] usb 1-10.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    7.800230] systemd[1]: Reached target Slice Units.
[    7.808219] hub 1-10.1:1.0: USB hub found
[    7.816568] hub 1-10.1:1.0: 4 ports detected
[    7.826648] systemd[1]: Reached target Swaps.
[    7.836643] systemd[1]: Reached target Timer Units.
[    7.847699] systemd[1]: Listening on D-Bus System Message Bus Socket.
[    7.861681] systemd[1]: Listening on Journal Socket (/dev/log).
[    7.874675] systemd[1]: Listening on Journal Socket.
[    7.884617] usb 1-10.2: new high-speed USB device number 4 using xhci_hcd
[    7.891990] systemd[1]: Listening on udev Control Socket.
[    7.904664] systemd[1]: Listening on udev Kernel Socket.
[    7.916636] systemd[1]: Reached target Socket Units.
[    7.937696] systemd[1]: Starting Create List of Static Device Nodes...
[    7.952569] systemd[1]: Starting Journal Service...
[    7.963714] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met.
[    7.973491] systemd[1]: Starting Apply Kernel Variables...
[    7.981686] usb 1-10.2: New USB device found, idVendor=413c, idProduct=0006, bcdDevice= 0.00
[    7.990257] usb 1-10.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    7.997655] usb 1-10.2: Product: DRAC 5 Virtual Keyboard and Mouse
[    8.005225] usb 1-10.2: Manufacturer: DELL
[    8.010197] usb 1-10.2: SerialNumber: DELL413C-1
[    8.015325] systemd[1]: Starting Create System Users...
[    8.026628] input: DELL DRAC 5 Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-10/1-10.2/1-10.2:1.0/0003:413C:0006.0001/input/input2
[    8.027170] systemd[1]: Starting Setup Virtual Console...
[    8.040537] hid-generic 0003:413C:0006.0001: input,hidraw0: USB HID v1.01 Mouse [DELL DRAC 5 Virtual Keyboard and Mouse] on usb-0000:00:14.0-10.2/input0
[    8.065874] input: DELL DRAC 5 Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-10/1-10.2/1-10.2:1.1/0003:413C:0006.0002/input/input3
[    8.066437] systemd[1]: Started Journal Service.
[    8.167663] hid-generic 0003:413C:0006.0002: input,hidraw1: USB HID v1.01 Keyboard [DELL DRAC 5 Virtual Keyboard and Mouse] on usb-0000:00:14.0-10.2/input1
[    8.244618] usb 1-10.4: new high-speed USB device number 5 using xhci_hcd
[    8.331925] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    8.344237] device-mapper: uevent: version 1.0.3
[    8.344258] usb 1-10.4: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00
[    8.348983] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@xxxxxxxxxxxxxxx
[    8.357308] usb 1-10.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    8.357991] hub 1-10.4:1.0: USB hub found
[    8.377662] hub 1-10.4:1.0: 4 ports detected
[    8.599402] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WMAA method block execution control method not found
[    8.610061] wmi_bus wmi_bus-PNP0C14:01: [Firmware Bug]: WQBC data block query control method not found
[    8.621617] megasas: 07.734.00.00-rc1
[    8.625595] megaraid_sas 0000:e1:00.0: BAR:0x0  BAR's base_addr(phys):0x00000000d2800000  mapped virt_addr:0x00000000d75a9c99
[    8.625602] megaraid_sas 0000:e1:00.0: FW now in Ready state
[    8.625613] megaraid_sas 0000:e1:00.0: 63 bit DMA mask and 63 bit consistent mask
[    8.625822] megaraid_sas 0000:e1:00.0: firmware supports msix	: (128)
[    8.631473] tg3 0000:01:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:cb:e1:c1:df:62
[    8.631478] tg3 0000:01:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    8.631480] tg3 0000:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    8.631482] tg3 0000:01:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    8.660529] tg3 0000:01:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:cb:e1:c1:df:63
[    8.668557] megaraid_sas 0000:e1:00.0: requested/available msix 32/32 poll_queue 0
[    8.677381] tg3 0000:01:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    8.684094] megaraid_sas 0000:e1:00.0: current msix/online cpus	: (32/24)
[    8.695384] tg3 0000:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    8.695388] tg3 0000:01:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    8.702974] megaraid_sas 0000:e1:00.0: RDPQ mode	: (enabled)
[    8.702978] megaraid_sas 0000:e1:00.0: Current firmware supports maximum commands: 1517	 LDIO threshold: 0
[    8.750648] libata version 3.00 loaded.
[    8.751073] megaraid_sas 0000:e1:00.0: Performance mode :Balanced (latency index = 8)
[    8.751581] idxd 0000:75:01.0: Intel(R) Accelerator Device (v100)
[    8.752129] tg3 0000:01:00.0 eno8303: renamed from eth0
[    8.758927] megaraid_sas 0000:e1:00.0: FW supports sync cache	: Yes
[    8.776565] megaraid_sas 0000:e1:00.0: megasas_disable_intr_fusion is called outbound_intr_mask:0x40000009
[    8.776694] tg3 0000:01:00.1 eno8403: renamed from eth1
[    8.777218] idxd 0000:f2:01.0: Intel(R) Accelerator Device (v100)
[    8.803543] ahci 0000:00:18.0: AHCI vers 0001.0301, 32 command slots, 6 Gbps, SATA mode
[    8.811551] ahci 0000:00:18.0: 4/4 ports implemented (port mask 0xf0)
[    8.818006] ahci 0000:00:18.0: flags: 64bit ncq sntf pm clo only pio slum part ems deso sadm sds 
[    8.836033] scsi host1: ahci
[    8.836200] scsi host2: ahci
[    8.836309] scsi host3: ahci
[    8.836413] scsi host4: ahci
[    8.836508] scsi host5: ahci
[    8.836611] scsi host6: ahci
[    8.836740] scsi host7: ahci
[    8.836870] scsi host8: ahci
[    8.836902] ata1: DUMMY
[    8.836903] ata2: DUMMY
[    8.836904] ata3: DUMMY
[    8.836904] ata4: DUMMY
[    8.836906] ata5: SATA max UDMA/133 abar m2048@0x95a56000 port 0x95a56300 irq 221 lpm-pol 0 ext
[    8.836908] ata6: SATA max UDMA/133 abar m2048@0x95a56000 port 0x95a56380 irq 221 lpm-pol 0 ext
[    8.836910] ata7: SATA max UDMA/133 abar m2048@0x95a56000 port 0x95a56400 irq 221 lpm-pol 0 ext
[    8.836911] ata8: SATA max UDMA/133 abar m2048@0x95a56000 port 0x95a56480 irq 221 lpm-pol 0 ext
[    8.837144] ahci 0000:00:19.0: AHCI vers 0001.0301, 32 command slots, 6 Gbps, SATA mode
[    8.837146] ahci 0000:00:19.0: 4/4 ports implemented (port mask 0xf)
[    8.837147] ahci 0000:00:19.0: flags: 64bit ncq sntf pm clo only pio slum part ems deso sadm sds 
[    8.843893] scsi host9: ahci
[    8.844007] scsi host10: ahci
[    8.844120] scsi host11: ahci
[    8.844223] scsi host12: ahci
[    8.844249] ata9: SATA max UDMA/133 abar m2048@0x95a55000 port 0x95a55100 irq 222 lpm-pol 0 ext
[    8.844251] ata10: SATA max UDMA/133 abar m2048@0x95a55000 port 0x95a55180 irq 222 lpm-pol 0 ext
[    8.844252] ata11: SATA max UDMA/133 abar m2048@0x95a55000 port 0x95a55200 irq 222 lpm-pol 0 ext
[    8.844253] ata12: SATA max UDMA/133 abar m2048@0x95a55000 port 0x95a55280 irq 222 lpm-pol 0 ext
[    8.930610] megaraid_sas 0000:e1:00.0: FW supports atomic descriptor	: Yes
[    9.019610] megaraid_sas 0000:e1:00.0: FW provided supportMaxExtLDs: 0	max_lds: 32
[    9.027199] megaraid_sas 0000:e1:00.0: controller type	: iMR(0MB)
[    9.033310] megaraid_sas 0000:e1:00.0: Online Controller Reset(OCR)	: Enabled
[    9.040460] megaraid_sas 0000:e1:00.0: Secure JBOD support	: No
[    9.046397] megaraid_sas 0000:e1:00.0: NVMe passthru support	: Yes
[    9.052596] megaraid_sas 0000:e1:00.0: FW provided TM TaskAbort/Reset timeout	: 6 secs/60 secs
[    9.061216] megaraid_sas 0000:e1:00.0: JBOD sequence map support	: Yes
[    9.067761] megaraid_sas 0000:e1:00.0: PCI Lane Margining support	: Yes
[    9.095702] megaraid_sas 0000:e1:00.0: NVME page size	: (4096)
[    9.101776] megaraid_sas 0000:e1:00.0: megasas_enable_intr_fusion is called outbound_intr_mask:0x40000000
[    9.111355] megaraid_sas 0000:e1:00.0: INIT adapter done
[    9.130441] megaraid_sas 0000:e1:00.0: Snap dump wait time	: 25
[    9.136374] megaraid_sas 0000:e1:00.0: pci id		: (0x1000)/(0x10e6)/(0x1028)/(0x2173)
[    9.140806] ata6: SATA link down (SStatus 0 SControl 300)
[    9.144135] megaraid_sas 0000:e1:00.0: unevenspan support	: yes
[    9.148847] ata9: SATA link down (SStatus 0 SControl 300)
[    9.148867] ata11: SATA link down (SStatus 0 SControl 300)
[    9.148892] ata12: SATA link down (SStatus 0 SControl 300)
[    9.148917] ata10: SATA link down (SStatus 0 SControl 300)
[    9.149564] ata5: SATA link down (SStatus 0 SControl 300)
[    9.155467] megaraid_sas 0000:e1:00.0: firmware crash dump	: no
[    9.160900] ata7: SATA link down (SStatus 0 SControl 300)
[    9.166372] megaraid_sas 0000:e1:00.0: JBOD sequence map	: enabled
[    9.171872] ata8: SATA link down (SStatus 0 SControl 300)
[    9.177405] megaraid_sas 0000:e1:00.0: Max firmware commands: 1516 shared with default hw_queues = 24 poll_queues 0
[    9.216177] scsi host0: Avago SAS based MegaRAID driver
[    9.231288] scsi 0:2:0:0: Direct-Access     DELL     PERC H355 Front  5.26 PQ: 0 ANSI: 5
[    9.388242] scsi 0:2:0:0: Attached scsi generic sg0 type 0
[    9.389512] mlx5_core 0000:61:00.0: PTM enabled, 2ns granularity
[    9.399794] mlx5_core 0000:61:00.0: firmware version: 32.45.1020
[    9.405837] mlx5_core 0000:61:00.0: 504.112 Gb/s available PCIe bandwidth (32.0 GT/s PCIe x16 link)
[    9.415829] sd 0:2:0:0: [sda] 1170997248 512-byte logical blocks: (600 GB/558 GiB)
[    9.423595] sd 0:2:0:0: [sda] Write Protect is off
[    9.428403] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    9.428491] sd 0:2:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA
[    9.438648] sd 0:2:0:0: [sda] Preferred minimum I/O size 65536 bytes
[    9.484982]  sda: sda1 sda2
[    9.487880] sd 0:2:0:0: [sda] Attached SCSI disk
[    9.749594] mlx5_core 0000:61:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 195312Mbps
[    9.758760] mlx5_core 0000:61:00.0: E-Switch: Total vports 50, per vport: max uc(128) max mc(2048)
[    9.768008] mlx5_core 0000:61:00.0: Flow counters bulk query buffer size increased, bulk_query_len(8)
[    9.779509] mlx5_core 0000:61:00.0: Port module event: module 0, Cable plugged
[    9.786835] mlx5_core 0000:61:00.0: mlx5_pcie_event:322:(pid 13): PCIe slot power capability was not advertised.
[    9.794690] mlx5_core 0000:61:00.0: mlx5e: IPSec ESP acceleration enabled
[    9.895742] mlx5_core 0000:61:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[    9.907270] mlx5_core 0000:61:00.1: firmware version: 32.45.1020
[    9.913317] mlx5_core 0000:61:00.1: 504.112 Gb/s available PCIe bandwidth (32.0 GT/s PCIe x16 link)
[   10.260550] mlx5_core 0000:61:00.1: Rate limit: 127 rates are supported, range: 0Mbps to 195312Mbps
[   10.269707] mlx5_core 0000:61:00.1: E-Switch: Total vports 50, per vport: max uc(128) max mc(2048)
[   10.278939] mlx5_core 0000:61:00.1: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   10.290552] mlx5_core 0000:61:00.1: Port module event: module 1, Cable plugged
[   10.297870] mlx5_core 0000:61:00.1: mlx5_pcie_event:322:(pid 12): PCIe slot power capability was not advertised.
[   10.315844] mlx5_core 0000:61:00.1: mlx5e: IPSec ESP acceleration enabled
[   10.416563] mlx5_core 0000:61:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   10.427904] mlx5_core 0000:b5:00.0: firmware version: 22.43.2566
[   10.433960] mlx5_core 0000:b5:00.0: 252.048 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x16 link)
[   10.802991] mlx5_core 0000:b5:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps
[   10.812036] mlx5_core 0000:b5:00.0: E-Switch: Total vports 26, per vport: max uc(128) max mc(2048)
[   10.821250] mlx5_core 0000:b5:00.0: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   10.833403] mlx5_core 0000:b5:00.0: Port module event: module 0, Cable plugged
[   10.840934] mlx5_core 0000:b5:00.0: mlx5_pcie_event:322:(pid 12): PCIe slot power capability was not advertised.
[   10.849140] mlx5_core 0000:b5:00.0: mlx5e: IPSec ESP acceleration enabled
[   10.973849] mlx5_core 0000:b5:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   10.985566] mlx5_core 0000:b5:00.1: firmware version: 22.43.2566
[   10.991631] mlx5_core 0000:b5:00.1: 252.048 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x16 link)
[   11.367751] mlx5_core 0000:b5:00.1: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps
[   11.376786] mlx5_core 0000:b5:00.1: E-Switch: Total vports 26, per vport: max uc(128) max mc(2048)
[   11.386008] mlx5_core 0000:b5:00.1: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   11.398929] mlx5_core 0000:b5:00.1: Port module event: module 1, Cable plugged
[   11.406415] mlx5_core 0000:b5:00.1: mlx5_pcie_event:322:(pid 614): PCIe slot power capability was not advertised.
[   11.414566] mlx5_core 0000:b5:00.1: mlx5e: IPSec ESP acceleration enabled
[   11.543552] mlx5_core 0000:b5:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   11.555346] mlx5_core 0000:61:00.0 ens1f0np0: renamed from eth0
[   11.561439] mlx5_core 0000:b5:00.0 ens7f0np0: renamed from eth2
[   11.567521] mlx5_core 0000:61:00.1 ens1f1np1: renamed from eth1
[   11.573722] mlx5_core 0000:b5:00.1 ens7f1np1: renamed from eth3
[   11.946602] PM: Image not found (code -22)
[   12.525382] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled
[   12.535467] XFS (dm-0): Mounting V5 Filesystem cf820c00-9f56-42b1-842f-dc5880903f25
[   12.651022] XFS (dm-0): Ending clean mount
[   13.145823] systemd-journald[313]: Received SIGTERM from PID 1 (systemd).
[   13.744126] SELinux: https://github.com/SELinuxProject/selinux-kernel/wiki/DEPRECATE-runtime-disable
[   13.753270] SELinux: Runtime disable is not supported, use selinux=0 on the kernel cmdline.
[   13.791383] systemd[1]: RTC configured in localtime, applying delta of -240 minutes to system time.
[   13.846751] systemd[1]: systemd 252-51.el9_6.1 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   13.879313] systemd[1]: Detected architecture x86-64.
[   13.971424] systemd-rc-local-generator[838]: /etc/rc.d/rc.local is not marked executable, skipping.
[   15.200672] systemd[1]: initrd-switch-root.service: Deactivated successfully.
[   15.207919] systemd[1]: Stopped Switch Root.
[   15.217958] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
[   15.227173] systemd[1]: Created slice Virtual Machine and Container Slice.
[   15.243961] systemd[1]: Created slice Slice /system/getty.
[   15.257911] systemd[1]: Created slice Slice /system/modprobe.
[   15.271896] systemd[1]: Created slice Slice /system/serial-getty.
[   15.285885] systemd[1]: Created slice Slice /system/sshd-keygen.
[   15.299826] systemd[1]: Created slice User and Session Slice.
[   15.312674] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   15.330653] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   15.346732] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   15.365648] systemd[1]: Reached target Local Encrypted Volumes.
[   15.378644] systemd[1]: Stopped target Switch Root.
[   15.389640] systemd[1]: Stopped target Initrd File Systems.
[   15.402635] systemd[1]: Stopped target Initrd Root File System.
[   15.415636] systemd[1]: Reached target Local Integrity Protected Volumes.
[   15.430644] systemd[1]: Reached target Host and Network Name Lookups.
[   15.444634] systemd[1]: Reached target Path Units.
[   15.455644] systemd[1]: Reached target Slice Units.
[   15.466642] systemd[1]: Reached target System Time Set.
[   15.478640] systemd[1]: Reached target Local Verity Protected Volumes.
[   15.493673] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[   15.512427] systemd[1]: Listening on LVM2 poll daemon socket.
[   15.553625] systemd[1]: Listening on RPCbind Server Activation Socket.
[   15.568675] systemd[1]: Reached target RPC Port Mapper.
[   15.581474] systemd[1]: Listening on Process Core Dump Socket.
[   15.594673] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   15.612736] systemd[1]: Listening on udev Control Socket.
[   15.625680] systemd[1]: Listening on udev Kernel Socket.
[   15.656683] systemd[1]: Activating swap /dev/mapper/rhel_dell--per760--18-swap...
[   15.673334] systemd[1]: Mounting Huge Pages File System...
[   15.676773] Adding 4194300k swap on /dev/mapper/rhel_dell--per760--18-swap.  Priority:-2 extents:1 across:4194300k 
[   15.705665] systemd[1]: Mounting POSIX Message Queue File System...
[   15.719278] systemd[1]: Mounting NFSD configuration filesystem...
[   15.733328] systemd[1]: Mounting Kernel Debug File System...
[   15.745295] systemd[1]: Mounting Kernel Trace File System...
[   15.756687] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[   15.770191] systemd[1]: iscsi-starter.service was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/var/lib/iscsi/nodes).
[   15.793709] systemd[1]: Starting Create List of Static Device Nodes...
[   15.808367] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
[   15.836694] systemd[1]: Starting Load Kernel Module configfs...
[   15.849258] systemd[1]: Starting Load Kernel Module drm...
[   15.861259] systemd[1]: Starting Load Kernel Module efi_pstore...
[   15.875291] systemd[1]: Starting Load Kernel Module fuse...
[   15.911704] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network...
[   15.928715] systemd[1]: systemd-fsck-root.service: Deactivated successfully.
[   15.935818] systemd[1]: Stopped File System Check on Root Device.
[   15.949699] systemd[1]: Stopped Journal Service.
[   15.973751] systemd[1]: Starting Journal Service...
[   16.055674] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met.
[   16.087798] ACPI: bus type drm_connector registered
[   16.088687] systemd[1]: Starting Generate network units from Kernel command line...
[   16.108656] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).
[   16.127879] systemd[1]: Starting Remount Root and Kernel File Systems...
[   16.142676] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met.
[   16.165703] systemd[1]: Starting Apply Kernel Variables...
[   16.177463] systemd[1]: Starting Coldplug All udev Devices...
[   16.191008] systemd[1]: Activated swap /dev/mapper/rhel_dell--per760--18-swap.
[   16.207162] systemd[1]: Mounted Huge Pages File System.
[   16.219679] systemd[1]: Mounted POSIX Message Queue File System.
[   16.232740] systemd[1]: Mounted Kernel Debug File System.
[   16.245671] systemd[1]: Mounted Kernel Trace File System.
[   16.259771] systemd[1]: Finished Create List of Static Device Nodes.
[   16.274804] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   16.281987] systemd[1]: Finished Load Kernel Module configfs.
[   16.294052] RPC: Registered named UNIX socket transport module.
[   16.299999] RPC: Registered udp transport module.
[   16.300194] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   16.304726] RPC: Registered tcp transport module.
[   16.311449] systemd[1]: Finished Load Kernel Module drm.
[   16.316083] RPC: Registered tcp-with-tls transport module.
[   16.326917] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   16.334190] fuse: init (API version 7.44)
[   16.344780] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[   16.352107] systemd[1]: Finished Load Kernel Module efi_pstore.
[   16.367305] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[   16.374142] systemd[1]: Finished Load Kernel Module fuse.
[   16.386731] systemd[1]: Started Journal Service.
[   16.565423] systemd-journald[872]: Received client request to flush runtime journal.
[   17.364184] IPMI message handler: version 39.2
[   17.422055] ipmi device interface
[   17.435480] ipmi_si: IPMI System Interface driver
[   17.440229] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS
[   17.446611] ipmi_platform: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
[   17.453942] ipmi_si: Adding SMBIOS-specified kcs state machine
[   17.459863] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI
[   17.465830] ipmi_si IPI0001:00: ipmi_platform: [io  0x0ca8] regsize 1 spacing 4 irq 10
[   17.473923] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI
[   17.482641] ipmi_si: Adding ACPI-specified kcs state machine
[   17.488476] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10
[   17.609632] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
[   17.640692] ipmi_si IPI0001:00: Using irq 10
[   17.667394] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
[   17.726300] ipmi_si IPI0001:00: IPMI kcs interface initialized
[   17.748811] ipmi_ssif: IPMI SSIF Interface driver
[   17.907899] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   17.974931] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
[   17.980946] power_meter ACPI000D:00: Found ACPI power meter.
[   17.982864] RAPL PMU: hw unit of domain package 2^-14 Joules
[   17.994242] RAPL PMU: hw unit of domain dram 2^-14 Joules
[   17.999659] RAPL PMU: hw unit of domain psys 2^-0 Joules
[   18.005583] i801_smbus 0000:00:1f.4: SPD Write Disable is set
[   18.011384] i801_smbus 0000:00:1f.4: SMBus using PCI interrupt
[   18.132860] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.4)
[   18.195065] input: PC Speaker as /devices/platform/pcspkr/input/input4
[   18.432077] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.438209] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.444320] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.450436] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.450439] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.450442] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.450444] i801_smbus 0000:00:1f.4: SMBus is busy, can't use it!
[   18.751204] MACsec IEEE 802.1AE
[   18.796987] iTCO_vendor_support: vendor-support=0
[   19.239172] iTCO_wdt iTCO_wdt: Found a Intel PCH TCO device (Version=6, TCOBASE=0x0400)
[   19.247288] iTCO_wdt iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   19.291962] mgag200 0000:03:00.0: vgaarb: deactivate vga console
[   19.304261] Console: switching to colour dummy device 80x25
[   19.315058] [drm] Initialized mgag200 1.0.0 for 0000:03:00.0 on minor 0
[   19.328371] fbcon: mgag200drmfb (fb0) is primary device
[   19.355632] XFS (sda1): Mounting V5 Filesystem e8d35188-06e4-4a88-8961-309294a37907
[   19.381661] Console: switching to colour frame buffer device 128x48
[   19.432611] mgag200 0000:03:00.0: [drm] fb0: mgag200drmfb frame buffer device
[   19.647713] EDAC i10nm: No hbm memory
[   19.647749] EDAC MC0: Giving out device to module i10nm_edac controller Intel_10nm Socket#0 IMC#0: DEV 0000:7e:0c.0 (INTERRUPT)
[   19.659259] EDAC MC1: Giving out device to module i10nm_edac controller Intel_10nm Socket#0 IMC#1: DEV 0000:7e:0d.0 (INTERRUPT)
[   19.670764] EDAC MC2: Giving out device to module i10nm_edac controller Intel_10nm Socket#0 IMC#2: DEV 0000:7e:0e.0 (INTERRUPT)
[   19.682271] EDAC MC3: Giving out device to module i10nm_edac controller Intel_10nm Socket#0 IMC#3: DEV 0000:7e:0f.0 (INTERRUPT)
[   19.693772] EDAC MC4: Giving out device to module i10nm_edac controller Intel_10nm Socket#1 IMC#0: DEV 0000:fe:0c.0 (INTERRUPT)
[   19.705275] EDAC MC5: Giving out device to module i10nm_edac controller Intel_10nm Socket#1 IMC#1: DEV 0000:fe:0d.0 (INTERRUPT)
[   19.716786] EDAC MC6: Giving out device to module i10nm_edac controller Intel_10nm Socket#1 IMC#2: DEV 0000:fe:0e.0 (INTERRUPT)
[   19.728294] EDAC MC7: Giving out device to module i10nm_edac controller Intel_10nm Socket#1 IMC#3: DEV 0000:fe:0f.0 (INTERRUPT)
[   19.739784] EDAC i10nm: v0.0.6
[   19.788596] XFS (sda1): Ending clean mount
[   19.809378] XFS (dm-2): Mounting V5 Filesystem c16f45b7-e342-46b4-8147-01ed06a4c0fc
[   19.953489] intel_rapl_common: Found RAPL domain package
[   19.958827] intel_rapl_common: Found RAPL domain dram
[   19.963901] intel_rapl_common: Found RAPL domain psys
[   19.969079] intel_rapl_common: Found RAPL domain package
[   19.974425] intel_rapl_common: Found RAPL domain dram
[   20.084980] XFS (dm-2): Ending clean mount
[   22.894339] mlx5_core 0000:61:00.0 ens1f0np0: Link up
[   22.901527] mlx5_core 0000:61:00.0 mlx5_0: Port: 1 Link ACTIVE
[   23.063904] mlx5_core 0000:61:00.1 ens1f1np1: Link up
[   23.071094] mlx5_core 0000:61:00.1 mlx5_1: Port: 1 Link ACTIVE
[   23.269460] mlx5_core 0000:b5:00.0 ens7f0np0: Link up
[   23.276896] mlx5_core 0000:b5:00.0 mlx5_2: Port: 1 Link ACTIVE
[   23.475460] mlx5_core 0000:b5:00.1 ens7f1np1: Link up
[   23.482902] mlx5_core 0000:b5:00.1 mlx5_3: Port: 1 Link ACTIVE
[   23.689896] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   26.068412] tg3 0000:01:00.0 eno8303: Link is up at 1000 Mbps, full duplex
[   26.075310] tg3 0000:01:00.0 eno8303: Flow control is on for TX and on for RX
[   26.082458] tg3 0000:01:00.0 eno8303: EEE is disabled
[   26.089133] switch: port 1(eno8303) entered blocking state
[   26.094644] switch: port 1(eno8303) entered disabled state
[   26.100168] tg3 0000:01:00.0 eno8303: entered allmulticast mode
[   26.106158] tg3 0000:01:00.0 eno8303: entered promiscuous mode
[   26.112072] switch: port 1(eno8303) entered blocking state
[   26.117572] switch: port 1(eno8303) entered forwarding state
[   29.600032] RPC: Registered rdma transport module.
[   29.604846] RPC: Registered rdma backchannel transport module.
[   29.760467] NFSD: Using nfsdcld client tracking operations.
[   29.766063] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[   31.007674] block dm-0: the capability attribute has been deprecated.
[   31.975947] PEFILE: Unsigned PE binary
[   60.928096] mlx5_core 0000:b5:00.1: E-Switch: Enable: mode(LEGACY), nvfs(1), necvfs(0), active vports(2)
[   61.041361] pci 0000:b5:03.2: [15b3:101e] type 00 class 0x020000 PCIe Endpoint
[   61.048676] pci 0000:b5:03.2: enabling Extended Tags
[   61.055000] pci 0000:b5:03.2: Adding to iommu group 216
[   61.061748] mlx5_core 0000:b5:03.2: enabling device (0000 -> 0002)
[   61.068024] mlx5_core 0000:b5:03.2: firmware version: 22.43.2566
[   61.279203] mlx5_core 0000:b5:03.2: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps
[   61.288174] mlx5_core 0000:b5:03.2: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   61.311016] mlx5_core 0000:b5:03.2: Assigned random MAC address be:df:31:49:0c:9e
[   61.474478] mlx5_core 0000:b5:03.2: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   61.479736] mlx5_core 0000:b5:03.2 ens7f1v0: renamed from eth0
[   61.606341] mlx5_core 0000:b5:03.2 ens7f1v0: Link up
[   62.541210] mlx5_core 0000:b5:00.1: E-Switch: Disable: mode(LEGACY), nvfs(1), necvfs(0), active vports(2)
[   63.879071] mlx5_core 0000:b5:00.1: E-Switch: Supported tc chains and prios offload
[   64.135249] workqueue: Failed to create a rescuer kthread for wq "mlx5e": -EINTR
[   64.153230] mlx5_core 0000:b5:00.1: mlx5e_netdev_init_profile:6269:(pid 2195): mlx5e_priv_init failed, err=-12
[   64.170659] mlx5_core 0000:b5:00.1 ens7f1np1: mlx5e_netdev_change_profile: new profile init failed, -12
[   64.180070] workqueue: Failed to create a rescuer kthread for wq "mlx5e": -EINTR
[   64.186234] mlx5_core 0000:b5:00.1: mlx5e_netdev_init_profile:6269:(pid 2195): mlx5e_priv_init failed, err=-12
[   64.203650] mlx5_core 0000:b5:00.1 ens7f1np1: mlx5e_netdev_change_profile: failed to rollback to orig profile, -12
[   64.364042] workqueue: Failed to create a rescuer kthread for wq "ib_mad1": -EINTR
[   64.365775] infiniband mlx5_3: Couldn't open port 1
[   64.379671] workqueue: Failed to create a rescuer kthread for wq "mkey_cache": -EINTR
[   64.379674] infiniband mlx5_3: mlx5_mkey_cache_init:957:(pid 2195): failed to create work queue
[   64.396241] infiniband mlx5_3: mlx5_ib_stage_post_ib_reg_umr_init:4494:(pid 2195): mr cache init failed -12
[   64.461329] mlx5_ib.rdma mlx5_core.rdma.3: probe with driver mlx5_ib.rdma failed with error -12
[   69.376570] openvswitch: Open vSwitch switching datapath
[   69.494969] ovs-system: entered promiscuous mode
[   69.548293] GACT probability on
[   69.552865] Timeout policy base is empty
[   69.642788] ens7f1np1_br: entered promiscuous mode
[   69.648901] mlx5_core 0000:b5:00.1 ens7f1np1: entered promiscuous mode
[   71.152553] mlx5_core 0000:b5:00.1 ens7f1np1: left promiscuous mode
[   71.158907] ens7f1np1_br: left promiscuous mode
[   71.183360] ovs-system: left promiscuous mode
[   72.225572] mlx5_core 0000:b5:00.1: E-Switch: Unload vfs: mode(LEGACY), nvfs(1), necvfs(0), active vports(0)
[   72.245348] mlx5_core 0000:b5:00.1: E-Switch: Disable: mode(LEGACY), nvfs(1), necvfs(0), active vports(0)
[   72.274097] mlx5_core 0000:b5:00.1: E-Switch: Enable: mode(LEGACY), nvfs(1), necvfs(0), active vports(2)
[   72.385530] pci 0000:b5:03.2: [15b3:101e] type 00 class 0x020000 PCIe Endpoint
[   72.392853] pci 0000:b5:03.2: enabling Extended Tags
[   72.399166] pci 0000:b5:03.2: Adding to iommu group 216
[   72.405823] mlx5_core 0000:b5:03.2: enabling device (0000 -> 0002)
[   72.412107] mlx5_core 0000:b5:03.2: firmware version: 22.43.2566
[   72.622543] mlx5_core 0000:b5:03.2: Rate limit: 127 rates are supported, range: 0Mbps to 97656Mbps
[   72.631522] mlx5_core 0000:b5:03.2: Flow counters bulk query buffer size increased, bulk_query_len(8)
[   72.654385] mlx5_core 0000:b5:03.2: Assigned random MAC address 3a:9e:3e:aa:8c:2d
[   72.817643] mlx5_core 0000:b5:03.2: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0 enhanced)
[   72.820848] mlx5_core 0000:b5:03.2 ens7f1v0: renamed from eth0
[   72.949405] mlx5_core 0000:b5:03.2 ens7f1v0: Link up
[   73.874384] mlx5_core 0000:b5:00.1: E-Switch: Disable: mode(LEGACY), nvfs(1), necvfs(0), active vports(2)
[   74.065976] mlx5_core 0000:b5:00.1: E-Switch: Supported tc chains and prios offload
[   74.091105] BUG: kernel NULL pointer dereference, address: 0000000000000038
[   74.098084] #PF: supervisor read access in kernel mode
[   74.103221] #PF: error_code(0x0000) - not-present page
[   74.108361] PGD 11b665067 P4D 0 
[   74.111595] Oops: Oops: 0000 [#1] SMP NOPTI
[   74.115782] CPU: 18 UID: 0 PID: 2454 Comm: devlink Kdump: loaded Tainted: G S                  6.16.0-rc2 #1 PREEMPT(voluntary) 
[   74.127351] Tainted: [S]=CPU_OUT_OF_SPEC
[   74.131278] Hardware name: Dell Inc. PowerEdge R760/0024FG, BIOS 2.1.5 03/14/2024
[   74.138756] RIP: 0010:mlx5e_detach_netdev+0x38/0x90 [mlx5_core]
[   74.144834] Code: 4f 00 00 f0 80 4f 78 02 48 8b bf e8 07 00 00 48 85 ff 74 16 48 8b 73 78 48 d1 ee 83 e6 01 83 f6 01 40 0f b6 f6 e8 c8 3f 00 00 <48> 8b 45 38 48 85 c0 74 08 48 89 df ff d0 0f 1f 00 48 8b bb f0 07
[   74.163578] RSP: 0018:ff50023d4f9c7860 EFLAGS: 00010246
[   74.168806] RAX: 0000000000000000 RBX: ff37e32bc2a80a40 RCX: 0000000000000000
[   74.175937] RDX: ff37e32b8baa6800 RSI: ffffffffc093fe20 RDI: 0000000000000000
[   74.183070] RBP: 0000000000000000 R08: 0000000000000001 R09: ff37e32b8baa6800
[   74.190205] R10: ff50023d4f9c78b8 R11: 00000000ffffffff R12: ffffffffc093fe20
[   74.197338] R13: ff37e32b8baa6800 R14: ff37e32bc2a80000 R15: 0000000000000000
[   74.204471] FS:  00007f79ee7a3740(0000) GS:ff37e32ae974b000(0000) knlGS:0000000000000000
[   74.212556] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   74.218304] CR2: 0000000000000038 CR3: 000000011b67b001 CR4: 0000000000773ef0
[   74.225436] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[   74.232569] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[   74.239703] PKRU: 55555554
[   74.242413] Call Trace:
[   74.244866]  <TASK>
[   74.246973]  mlx5e_netdev_change_profile+0x41/0x100 [mlx5_core]
[   74.253006]  mlx5e_vport_rep_load+0xa3/0xd0 [mlx5_core]
[   74.258364]  mlx5_esw_offloads_rep_load+0x75/0xf0 [mlx5_core]
[   74.264237]  esw_offloads_enable+0x2de/0x3b0 [mlx5_core]
[   74.269672]  mlx5_eswitch_enable_locked+0x1c5/0x3b0 [mlx5_core]
[   74.275714]  ? mlx5_rescan_drivers_locked.part.0+0x11c/0x1b0 [mlx5_core]
[   74.282507]  ? mlx5_rsc_dump_create+0x2d/0x90 [mlx5_core]
[   74.288011]  esw_offloads_start+0x42/0x1c0 [mlx5_core]
[   74.293272]  ? mlx5_fs_egress_acls_cleanup+0x45/0x60 [mlx5_core]
[   74.299373]  mlx5_devlink_eswitch_mode_set+0xd2/0x220 [mlx5_core]
[   74.305587]  devlink_nl_eswitch_set_doit+0x68/0xf0
[   74.310397]  genl_family_rcv_msg_doit+0xd8/0x130
[   74.315035]  genl_family_rcv_msg+0x14b/0x220
[   74.319306]  ? __pfx_devlink_nl_pre_doit+0x10/0x10
[   74.324099]  ? __pfx_devlink_nl_eswitch_set_doit+0x10/0x10
[   74.329586]  ? __pfx_devlink_nl_post_doit+0x10/0x10
[   74.334467]  genl_rcv_msg+0x47/0xa0
[   74.337957]  ? __pfx_genl_rcv_msg+0x10/0x10
[   74.342146]  netlink_rcv_skb+0x53/0x100
[   74.345984]  genl_rcv+0x24/0x40
[   74.349129]  netlink_unicast+0x27b/0x3b0
[   74.353057]  netlink_sendmsg+0x1f7/0x430
[   74.356982]  __sys_sendto+0x1fa/0x210
[   74.360667]  ? do_pte_missing+0x14a/0x3e0
[   74.364697]  ? __handle_mm_fault+0x321/0x730
[   74.368971]  __x64_sys_sendto+0x20/0x30
[   74.372808]  do_syscall_64+0x7b/0x2c0
[   74.376485]  ? handle_mm_fault+0x1fb/0x2d0
[   74.380585]  ? do_user_addr_fault+0x20c/0x700
[   74.384943]  ? do_syscall_64+0x212/0x2c0
[   74.388868]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
[   74.393922] RIP: 0033:0x7f79ee50feca
[   74.397502] Code: d8 64 89 02 48 c7 c0 ff ff ff ff eb b8 0f 1f 00 f3 0f 1e fa 41 89 ca 64 8b 04 25 18 00 00 00 85 c0 75 15 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 7e c3 0f 1f 44 00 00 41 54 48 83 ec 30 44 89
[   74.416246] RSP: 002b:00007ffe7f9ed408 EFLAGS: 00000246 ORIG_RAX: 000000000000002c
[   74.423815] RAX: ffffffffffffffda RBX: 0000000000000006 RCX: 00007f79ee50feca
[   74.430947] RDX: 0000000000000038 RSI: 000055d99cc67490 RDI: 0000000000000003
[   74.438080] RBP: 0000000000000000 R08: 00007f79ee7b4200 R09: 000000000000000c
[   74.445213] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[   74.452344] R13: 000055d99cc672a0 R14: 000055d96e8ca70c R15: 000055d99cc67490
[   74.459480]  </TASK>
[   74.461672] Modules linked in: cls_matchall nfnetlink_cttimeout nfnetlink act_gact cls_flower sch_ingress openvswitch nf_conncount nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 mlx5_vdpa vringh vhost_vdpa vhost vhost_iotlb vdpa rpcrdma rdma_cm iw_cm ib_cm bridge stp llc rfkill intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_ifs i10nm_edac skx_edac_common nfit libnvdimm x86_pkg_temp_thermal mgag200 mlx5_ib iTCO_wdt intel_powerclamp i2c_algo_bit coretemp drm_client_lib kvm_intel ib_uverbs drm_shmem_helper dax_hmem iTCO_vendor_support cxl_acpi kvm cxl_port macsec pmt_telemetry platform_profile ib_core pmt_class pcspkr joydev dcdbas cxl_core irqbypass drm_kms_helper i2c_i801 rapl acpi_power_meter i2c_ismt isst_if_mbox_pci mei_me intel_sdsi isst_if_mmio mei intel_vsec isst_if_common intel_cstate intel_uncore einj ipmi_ssif dell_smbios dell_wmi_descriptor wmi_bmof i2c_smbus acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler nfsd auth_rpcgss nfs_acl lockd grace fuse sunrpc drm xfs
[   74.461731]  sd_mod sg mlx5_core mlxfw iaa_crypto ahci tls libahci idxd psample libata megaraid_sas tg3 ghash_clmulni_intel idxd_bus pci_hyperv_intf wmi pinctrl_emmitsburg dm_mirror dm_region_hash dm_log dm_mod
[   74.570332] CR2: 0000000000000038
!/bin/bash
set -e

usage() {
    echo "$0 PCIADDR [NUM_VFs]"
    echo "  PCIADDR: The PCI address of the PF, e.g: 0000:40:00.0"
    echo "  NUM_VFS (defaul = 4): Number of VFs to configure"
    exit 1
}
error() {
    echo $@
    exit 1
}

gen_udev_script() {
    pf=$1
    switchid=$(ip -d link show ${pf} | sed -n 's/.* switchid \([^ ]*\).*/\1/p')
    [ -z ${switchid} ]  && error "cannot get switchid"
    cat <<EOF > /etc/udev/rules.d/82-net-setup-link-mlx.rules
SUBSYSTEM=="net", ACTION=="add", ATTR{phys_switch_id}=="${switchid}", ATTR{phys_port_name}!="", NAME="\$attr{phys_port_name}"
EOF

}

get_eswitch_mode() {
    echo "get_eswitch_mode "
    echo $(devlink dev eswitch show pci/$(get_pci_addr ${pf}) | cut -d ' ' -f 3)
}

set_eswitch_mode() {
    pf=$1
    mode=$2
    devlink dev eswitch set pci/$(get_pci_addr ${pf})  mode ${mode}
}
tc_offload() {
    pf=$1
    val=$(ethtool -k $pf | grep hw-tc-offload: | cut -d ':' -f 2 | tr -d '[:space:]')
    echo val
}

set_tc_offload() {
    pf=$1

echo "Enable hw-tc-offload  ${pf}"
    ethtool -K $pf hw-tc-offload on
}

get_pci_addr() {
    pf=$1
    vf=$2
    if [ -z $vf ]; then
            echo $(basename $(readlink /sys/class/net/${pf}/device))
    else
            echo $(basename $(readlink /sys/class/net/${pf}/device/virtfn${vf}))
    fi
}

# The the device name of the representor
get_representor() {
    pf=$1
    vfid=$2

    switchid=$(ip -d link show ${pf} | sed -n 's/.* switchid \([^ ]*\).*/\1/p')
    # FXME: The following code including pf0 is not portable
    #portname="pf0vf${vfid"
    portname="pf${pf: -1}vf${vfid}"
    for dev in $(ls -x /sys/class/net); do
            [[ -f /sys/class/net/${dev}/phys_port_name ]] || continue
            [[ -f /sys/class/net/${dev}/phys_switch_id ]] || continue
            phys_port_name=$(cat /sys/class/net/${dev}/phys_port_name 2> /dev/null || true)
            phys_switch_id=$(cat /sys/class/net/${dev}/phys_switch_id 2> /dev/null || true)
            if [ "${phys_port_name}" == "$portname" ] && [ "${phys_switch_id}" == "${switchid}" ]; then
                    echo "$dev"
                    return
            fi
    done
}

get_hardcoded_vlan() {
    vfid=$1
    let vlan_id=100+10*${vfid}
    echo ${vlan_id}
}

PCI_ADDR=$1
NUM_VFS=${2:-4}

[ -z ${PCI_ADDR} ] && usage

echo "Loading vDPA Kernel modules"
modprobe vdpa
modprobe vhost-vdpa
modprobe mlx5-vdpa

echo "Delete OVS Bridges:"
for br in `ovs-vsctl list-br`; do
    echo -n " $br"
    ovs-vsctl del-br $br
done
echo ""

echo "Creating VFs"
PF=$(ls -x /sys/bus/pci/devices/${PCI_ADDR}/net/)
    echo  "${PCI_ADDR}"
#echo 0 > /sys/class/net/${PF}/device/sriov_numvfs
echo 0 > /sys/bus/pci/devices/${PCI_ADDR}/sriov_numvfs
PF=$(ls -x /sys/bus/pci/devices/${PCI_ADDR}/net/)
echo $NUM_VFS > /sys/bus/pci/devices/${PCI_ADDR}/sriov_numvfs

num_vfs=$(cat /sys/class/net/${PF}/device/sriov_numvfs)
for i in $(seq 0 $(($num_vfs -1))); do
    echo "Unbinding VF ${i}"
    pci_addr=$(get_pci_addr ${PF} $i)
    echo $pci_addr >  /sys/bus/pci/drivers/mlx5_core/unbind
done

PF=$(ls -x  /sys/bus/pci/devices/${PCI_ADDR}/net/| awk '{print $1}')
set_eswitch_mode ${PF} switchdev
sleep 5

echo "Setting switchdev_mode ${PF}"
nmcli device set ${PF} managed no

echo "Setting switchdev_mode 2  ${PF}"
set_tc_offload ${PF}
for i in $(seq 0 $(($num_vfs -1))); do
    echo "Binding VF ${i}"
    pci_addr=$(get_pci_addr ${PF} $i)
    echo $pci_addr >  /sys/bus/pci/drivers/mlx5_core/bind
    echo "Waiting for vf ${i} dev to be available "
    sleep 3

    devname=$(ls -x /sys/class/net/${PF}/device/virtfn${i}/net)
    [ -z "$devname" ] && error "Cannot get VF network device"
    set_tc_offload ${devname}

    echo  "${devname}"
    nmcli device set ${devname} managed no
    macaddr=`printf "%02x\n" ${i}`
    vdpa dev add name vdpa${i} mgmtdev pci/$pci_addr  max_vqp 32
done


for i in $(seq 0 $(($num_vfs -1))); do
    devname=$(ls -x /sys/class/net/${PF}/device/virtfn${i}/net)
    rep=$(get_representor ${PF} $i)
    echo "Configuring ${devname} (rep: ${rep} )"
    set_tc_offload ${rep}
    nmcli device set ${rep} managed no
    ip link set ${rep} up
done

echo "Set PF link up"
ip link set ${PF} up

echo "Create OVS bridge"
br_name="${PF}_br"
ovs-vsctl add-br $br_name
ovs-vsctl add-port $br_name $PF

echo "Add ovs flows"
ovs-ofctl dump-flows $br_name

for i in $(seq 0 $(($num_vfs -1))); do
    rep=$(get_representor ${PF} $i)
    ovs-vsctl add-port $br_name $rep
done

echo "Set up OVS bridge up"
ip link set $br_name up

systemctl stop openvswitch
systemctl start openvswitch

echo "Enabling OVS HW Offload"
ovs-vsctl set Open_vSwitch . other_config:hw-offload="true"
#ovs-vsctl set Open_vSwitch . other_config:hw-offload="flase"

echo "(Re)Starting OpenvSwitch"
systemctl restart openvswitch.service

[Index of Archives]     [KVM Development]     [Libvirt Development]     [Libvirt Users]     [CentOS Virtualization]     [Netdev]     [Ethernet Bridging]     [Linux Wireless]     [Kernel Newbies]     [Security]     [Linux for Hams]     [Netfilter]     [Bugtraq]     [Yosemite Forum]     [MIPS Linux]     [ARM Linux]     [Linux RAID]     [Linux Admin]     [Samba]

  Powered by Linux