Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Linux version 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 (root@runner-oexrhijc-project-18194050-concurrent-0) (gcc (GCC) 11.3.1 20221121 (Red Hat 11.3.1-4), GNU ld version 2.35.2-24.el9) #1 SMP PREEMPT_RT Thu Dec 29 16:23:57 UTC 2022 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Command line: BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.14.0-226.rt14.227.1773_734386590.el9.x86_64 root=UUID=afd41ec7-fe9b-4587-90a0-fe87a3ae79df ro efi=runtime resume=UUID=6d8fff54-40cf-4e53-9de5-58ff0ac08839 console=ttyS0,115200n81 crashkernel=1G-4G:384M,4G-16G:512M,16G-64G:1G,64G-128G:2G,128G-:4G Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: signal: max sigframe size: 1776 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-provided physical RAM map: Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000000100000-0x000000006024afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006024b000-0x0000000060250fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000060251000-0x0000000060258fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000060259000-0x0000000060259fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006025a000-0x000000006101afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006101b000-0x000000006101efff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006101f000-0x000000006131bfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006131c000-0x000000006131ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000061320000-0x000000006a00ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a010000-0x000000006a010fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a011000-0x000000006a044fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a045000-0x000000006a045fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a046000-0x000000006a048fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a049000-0x000000006a052fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a053000-0x000000006a8e9fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a8ea000-0x000000006a8ebfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a8ec000-0x000000006a90ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a910000-0x000000006a910fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a911000-0x000000006a911fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a912000-0x000000006a912fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006a913000-0x000000006be73fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006be74000-0x000000006d49ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006d4a0000-0x000000006d4adfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006d4ae000-0x000000006d4aefff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006d4af000-0x000000006f86afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006f86b000-0x000000006f96bfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000006f96c000-0x0000000077d6bfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000077d6c000-0x0000000077d8bfff] ACPI NVS Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000077d8c000-0x0000000077dbbfff] ACPI data Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000077dbc000-0x0000000077dfdfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000077dfe000-0x0000000077dfefff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000077dff000-0x000000008fffffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000aa180000-0x00000000aa18ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000c5180000-0x00000000c518ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000e0280000-0x00000000e028ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000fd180000-0x00000000fd18ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000000fed80000-0x00000000fed80fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000100000000-0x000000087fefffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000087ff00000-0x000000087fffffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000000880000000-0x000000107f2fffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x000000107f300000-0x00000010903fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x0000020ba0000000-0x0000020bb03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000406c0000000-0x00000406d03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BIOS-e820: [mem 0x00000601e0000000-0x00000601f03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NX (Execute Disable) protection: active Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74474018-0x744b4257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74474018-0x744b4257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74433018-0x74473257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74433018-0x74473257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743f2018-0x74432257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743f2018-0x74432257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743b1018-0x743f1257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743b1018-0x743f1257] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743a8018-0x743b0057] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x743a8018-0x743b0057] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x7439d018-0x743a7857] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x7439d018-0x743a7857] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74370018-0x7439ca57] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74370018-0x7439ca57] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74343018-0x7436fa57] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x74343018-0x7436fa57] usable ==> usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: extended physical RAM map: Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000000f0000-0x00000000000fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000000100000-0x000000006024afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006024b000-0x0000000060250fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000060251000-0x0000000060258fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000060259000-0x0000000060259fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006025a000-0x000000006101afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006101b000-0x000000006101efff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006101f000-0x000000006131bfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006131c000-0x000000006131ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000061320000-0x000000006a00ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a010000-0x000000006a010fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a011000-0x000000006a044fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a045000-0x000000006a045fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a046000-0x000000006a048fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a049000-0x000000006a052fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a053000-0x000000006a8e9fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a8ea000-0x000000006a8ebfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a8ec000-0x000000006a90ffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a910000-0x000000006a910fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a911000-0x000000006a911fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a912000-0x000000006a912fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006a913000-0x000000006be73fff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006be74000-0x000000006d49ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006d4a0000-0x000000006d4adfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006d4ae000-0x000000006d4aefff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006d4af000-0x000000006f86afff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006f86b000-0x000000006f96bfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000006f96c000-0x0000000074343017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074343018-0x000000007436fa57] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000007436fa58-0x0000000074370017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074370018-0x000000007439ca57] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000007439ca58-0x000000007439d017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000007439d018-0x00000000743a7857] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743a7858-0x00000000743a8017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743a8018-0x00000000743b0057] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743b0058-0x00000000743b1017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743b1018-0x00000000743f1257] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743f1258-0x00000000743f2017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000743f2018-0x0000000074432257] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074432258-0x0000000074433017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074433018-0x0000000074473257] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074473258-0x0000000074474017] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000074474018-0x00000000744b4257] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000744b4258-0x0000000077d6bfff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000077d6c000-0x0000000077d8bfff] ACPI NVS Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000077d8c000-0x0000000077dbbfff] ACPI data Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000077dbc000-0x0000000077dfdfff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000077dfe000-0x0000000077dfefff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000077dff000-0x000000008fffffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000aa180000-0x00000000aa18ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000c5180000-0x00000000c518ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000e0280000-0x00000000e028ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000fd180000-0x00000000fd18ffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000000fed80000-0x00000000fed80fff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000100000000-0x000000087fefffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000087ff00000-0x000000087fffffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000000880000000-0x000000107f2fffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x000000107f300000-0x00000010903fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x0000020ba0000000-0x0000020bb03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000406c0000000-0x00000406d03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: reserve setup_data: [mem 0x00000601e0000000-0x00000601f03fffff] reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efi: EFI v2.60 by HPE Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efi: SMBIOS=0x6a912000 SMBIOS 3.0=0x6a910000 ACPI=0x77dbb000 ACPI 2.0=0x77dbb014 MEMATTR=0x61aa6018 MOKvar=0x6a010000 RNG=0x6be7ff98 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efi: seeding entropy pool Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: secureboot: Secure boot disabled Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SMBIOS 3.2.1 present. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMI: HPE ProLiant DL325 Gen10/ProLiant DL325 Gen10, BIOS A41 09/17/2019 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: tsc: Fast TSC calibration using PIT Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: tsc: Detected 2794.923 MHz processor Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: remove [mem 0x000a0000-0x000fffff] usable Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: last_pfn = 0x107f300 max_arch_pfn = 0x400000000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: last_pfn = 0x77dff max_arch_pfn = 0x400000000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Using GB pages for direct mapping Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: secureboot: Secure boot disabled Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAMDISK: [mem 0x744b6000-0x762fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Early table checksum verification disabled Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: RSDP 0x0000000077DBB014 000024 (v02 HPE ) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: XSDT 0x0000000077D9D188 0000F4 (v01 HPE Server 00000001 01000013) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: FACP 0x0000000077DA5000 00010C (v06 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: DSDT 0x0000000077D98000 003D2D (v02 HPE Server 00000002 HPE 00020000) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: FACS 0x0000000077D83000 000040 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: UEFI 0x0000000077D88000 000042 (v01 HPE Server 00000002 01000013) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: IVRS 0x0000000077DB9000 0001F0 (v02 HPE Server 00000001 AMD 00000000) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SSDT 0x0000000077DB2000 0069E4 (v01 HPE AmdTable 00000001 AMD 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SRAT 0x0000000077DB1000 0003A8 (v03 HPE Server 00000001 AMD 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SLIT 0x0000000077DB0000 00002D (v01 HPE Server 00000001 AMD 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: CRAT 0x0000000077DAD000 002CD0 (v01 HPE Server 00000001 AMD 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: CDIT 0x0000000077DAC000 000029 (v01 HPE Server 00000001 AMD 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: HEST 0x0000000077DAB000 0000E8 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: BERT 0x0000000077DAA000 000030 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: ERST 0x0000000077DA9000 000250 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: EINJ 0x0000000077DA8000 000150 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: FPDT 0x0000000077DA7000 000034 (v01 HPE Server 00000002 01000013) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: BGRT 0x0000000077DA6000 000038 (v01 HPE Server 00000002 1590 01000013) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: HPET 0x0000000077DA4000 000038 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: APIC 0x0000000077DA3000 00031C (v03 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: MCFG 0x0000000077DA2000 00003C (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SPMI 0x0000000077DA1000 000041 (v05 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: RASF 0x0000000077DA0000 000030 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SPCR 0x0000000077D9F000 000050 (v02 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: MSCT 0x0000000077D9E000 00004E (v02 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: WSMT 0x0000000077DBA000 000028 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCCT 0x0000000077D9C000 000030 (v01 HPE Server 00000001 1590 00000001) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SSDT 0x0000000077D94000 00333A (v02 HPE PCISSDT 00000002 HPE 00020000) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SSDT 0x0000000077D93000 0001C4 (v02 HPE TIMESSDT 00000002 HPE 00020000) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SSDT 0x0000000077D92000 0002F2 (v01 HPE pmab 00000001 INTL 20140828) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving FACP table memory at [mem 0x77da5000-0x77da510b] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving DSDT table memory at [mem 0x77d98000-0x77d9bd2c] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving FACS table memory at [mem 0x77d83000-0x77d8303f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving UEFI table memory at [mem 0x77d88000-0x77d88041] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving IVRS table memory at [mem 0x77db9000-0x77db91ef] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SSDT table memory at [mem 0x77db2000-0x77db89e3] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SRAT table memory at [mem 0x77db1000-0x77db13a7] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SLIT table memory at [mem 0x77db0000-0x77db002c] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving CRAT table memory at [mem 0x77dad000-0x77dafccf] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving CDIT table memory at [mem 0x77dac000-0x77dac028] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving HEST table memory at [mem 0x77dab000-0x77dab0e7] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving BERT table memory at [mem 0x77daa000-0x77daa02f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving ERST table memory at [mem 0x77da9000-0x77da924f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving EINJ table memory at [mem 0x77da8000-0x77da814f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving FPDT table memory at [mem 0x77da7000-0x77da7033] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving BGRT table memory at [mem 0x77da6000-0x77da6037] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving HPET table memory at [mem 0x77da4000-0x77da4037] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving APIC table memory at [mem 0x77da3000-0x77da331b] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving MCFG table memory at [mem 0x77da2000-0x77da203b] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SPMI table memory at [mem 0x77da1000-0x77da1040] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving RASF table memory at [mem 0x77da0000-0x77da002f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SPCR table memory at [mem 0x77d9f000-0x77d9f04f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving MSCT table memory at [mem 0x77d9e000-0x77d9e04d] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving WSMT table memory at [mem 0x77dba000-0x77dba027] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving PCCT table memory at [mem 0x77d9c000-0x77d9c02f] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SSDT table memory at [mem 0x77d94000-0x77d97339] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SSDT table memory at [mem 0x77d93000-0x77d931c3] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Reserving SSDT table memory at [mem 0x77d92000-0x77d922f1] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x01 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x02 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x03 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x04 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x05 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x08 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x09 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x0a -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x0b -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x0c -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x0d -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x10 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x11 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x12 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x13 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x14 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x15 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x18 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x19 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x1a -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x1b -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x1c -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x1d -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x20 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x21 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x22 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x23 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x24 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x25 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x28 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x29 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x2a -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x2b -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x2c -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x2d -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x30 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x31 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x32 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x33 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x34 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x35 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x38 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x39 -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x3a -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x3b -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x3c -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SRAT: PXM 0 -> APIC 0x3d -> Node 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x000c0000-0x7fffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x107fffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NUMA: Initialized distance table, cnt=1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x000c0000-0x7fffffff] -> [mem 0x00000000-0x7fffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x107f2fffff] -> [mem 0x00000000-0x107f2fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NODE_DATA(0) allocated [mem 0x107f2d4000-0x107f2fefff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Reserving 1024MB of memory at 496MB for crashkernel (System RAM: 65367MB) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Zone ranges: Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMA [mem 0x0000000000001000-0x0000000000ffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Normal [mem 0x0000000100000000-0x000000107f2fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Device empty Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Movable zone start for each node Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Early memory node ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000000001000-0x000000000009ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000000100000-0x000000006024afff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000060251000-0x0000000060258fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006025a000-0x000000006101afff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006101f000-0x000000006131bfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000061320000-0x000000006a00ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a011000-0x000000006a044fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a046000-0x000000006a048fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a053000-0x000000006a8e9fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a8ec000-0x000000006a90ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a911000-0x000000006a911fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006a913000-0x000000006be73fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006d4a0000-0x000000006d4adfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006d4af000-0x000000006f86afff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x000000006f96c000-0x0000000077d6bfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000077dfe000-0x0000000077dfefff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000100000000-0x000000087fefffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0: [mem 0x0000000880000000-0x000000107f2fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Initmem setup node 0 [mem 0x0000000000001000-0x000000107f2fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA: 96 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 6 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 4 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 4 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 10 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 2 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 5676 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 1 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 257 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone DMA32: 146 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone Normal: 513 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone Normal: 256 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: On node 0, zone Normal: 3328 pages in unavailable ranges Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PM-Timer IO Port: 0x408 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IOAPIC[0]: apic_id 128, version 33, address 0xfec00000, GSI 0-23 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IOAPIC[1]: apic_id 129, version 33, address 0xe0280000, GSI 24-55 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IOAPIC[2]: apic_id 130, version 33, address 0xc5180000, GSI 56-87 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IOAPIC[3]: apic_id 131, version 33, address 0xaa180000, GSI 88-119 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IOAPIC[4]: apic_id 132, version 33, address 0xfd180000, GSI 120-151 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Using ACPI (MADT) for SMP configuration information Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: HPET id: 0x10228201 base: 0xfed00000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: update [mem 0x60163000-0x60193fff] usable ==> reserved Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: SPCR: console: uart,mmio,0x0,115200 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot: Allowing 48 CPUs, 0 hotplug CPUs Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x60163000-0x60193fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6024b000-0x60250fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x60259000-0x60259fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6101b000-0x6101efff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6131c000-0x6131ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a010000-0x6a010fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a045000-0x6a045fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a049000-0x6a052fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a8ea000-0x6a8ebfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a910000-0x6a910fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6a912000-0x6a912fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6be74000-0x6d49ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6d4ae000-0x6d4aefff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x6f86b000-0x6f96bfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74343000-0x74343fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x7436f000-0x7436ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74370000-0x74370fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x7439c000-0x7439cfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x7439d000-0x7439dfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743a7000-0x743a7fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743a8000-0x743a8fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743b0000-0x743b0fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743b1000-0x743b1fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743f1000-0x743f1fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x743f2000-0x743f2fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74432000-0x74432fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74433000-0x74433fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74473000-0x74473fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x74474000-0x74474fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x744b4000-0x744b4fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x77d6c000-0x77d8bfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x77d8c000-0x77dbbfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x77dbc000-0x77dfdfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x77dff000-0x8fffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x90000000-0xaa17ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xaa180000-0xaa18ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xaa190000-0xc517ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xc5180000-0xc518ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xc5190000-0xe027ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xe0280000-0xe028ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xe0290000-0xfd17ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xfd180000-0xfd18ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xfd190000-0xfed7ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xfed80000-0xfed80fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0xfed81000-0xffffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: hibernation: Registered nosave memory: [mem 0x87ff00000-0x87fffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: [mem 0xe0290000-0xfd17ffff] available for PCI devices Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Booting paravirtualized kernel on bare hardware Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: setup_percpu: NR_CPUS:8192 nr_cpumask_bits:48 nr_cpu_ids:48 nr_node_ids:1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcpu-alloc: s188416 r8192 d28672 u262144 alloc=1*2097152 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcpu-alloc: [0] 16 17 18 19 20 21 22 23 [0] 24 25 26 27 28 29 30 31 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcpu-alloc: [0] 32 33 34 35 36 37 38 39 [0] 40 41 42 43 44 45 46 47 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Fallback order for Node 0: 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Built 1 zonelists, mobility grouping on. Total pages: 16472507 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Policy zone: Normal Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Kernel command line: BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.14.0-226.rt14.227.1773_734386590.el9.x86_64 root=UUID=afd41ec7-fe9b-4587-90a0-fe87a3ae79df ro efi=runtime resume=UUID=6d8fff54-40cf-4e53-9de5-58ff0ac08839 console=ttyS0,115200n81 crashkernel=1G-4G:384M,4G-16G:512M,16G-64G:1G,64G-128G:2G,128G-:4G Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Unknown kernel command line parameters "BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.14.0-226.rt14.227.1773_734386590.el9.x86_64", will be passed to user space. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: mem auto-init: stack:off, heap alloc:off, heap free:off Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: software IO TLB: area num 64. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Memory: 555296K/66936572K available (14342K kernel code, 5611K rwdata, 10032K rodata, 2776K init, 5456K bss, 2718372K reserved, 0K cma-reserved) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: random: get_random_u64 called from kmem_cache_open+0x20/0x2b0 with crng_init=0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=48, Nodes=1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ftrace: allocating 44222 entries in 173 pages Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ftrace: allocated 173 pages with 5 groups Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: Preemptible hierarchical RCU implementation. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=48. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: RCU priority boosting: priority 1 delay 500 ms. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: RCU_SOFTIRQ processing moved to rcuc kthreads. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: No expedited grace period (rcu_normal_after_boot). Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Trampoline variant of Tasks RCU enabled. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Rude variant of Tasks RCU enabled. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Tracing variant of Tasks RCU enabled. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=48 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NR_IRQS: 524544, nr_irqs: 2984, preallocated irqs: 16 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: srcu_init: Setting srcu_struct sizes based on contention. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: random: crng init done (trusting CPU's manufacturer) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Console: colour dummy device 80x25 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: printk: console [ttyS0] enabled Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Core revision 20211217 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: APIC: Switch to symmetric I/O mode setup Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Using global IVHD EFR:0x58f77ef22294ade, EFR2:0x0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Switched APIC routing to physical flat. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x284984a4e3c, max_idle_ns: 440795227399 ns Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5589.84 BogoMIPS (lpj=2794923) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pid_max: default: 49152 minimum: 384 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: LSM: Security Framework initializing Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Yama: becoming mindful. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: Initializing. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: LSM support for eBPF active Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/cpu: User Mode Instruction Prevention (UMIP) activated Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: LVT offset 2 assigned for vector 0xf4 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Last level dTLB entries: 4KB 2048, 2MB 2048, 4MB 1024, 1GB 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Mitigation: Retpolines Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Enabling Speculation Barrier for firmware calls Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RETBleed: Mitigation: untrained return thunk Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Selecting STIBP always-on mode to complement retbleed mitigation Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : User space: Mitigation: STIBP always-on protection Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing SMP alternatives memory: 36K Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot: CPU0: AMD EPYC 7402P 24-Core Processor (family: 0x17, model: 0x31, stepping: 0x0) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cblist_init_generic: Setting adjustable number of callback queues. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cblist_init_generic: Setting shift to 6 and lim to 1. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cblist_init_generic: Setting shift to 6 and lim to 1. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cblist_init_generic: Setting shift to 6 and lim to 1. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Performance Events: Fam17h+ core perfctr, AMD PMU driver. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... version: 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... bit width: 48 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... generic registers: 6 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... value mask: 0000ffffffffffff Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... max period: 00007fffffffffff Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... fixed-purpose events: 0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ... event mask: 000000000000003f Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: Hierarchical SRCU implementation. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu: Max phase no-delay instances is 400. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: printk: console [ttyS0] printing thread started Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smp: Bringing up secondary CPUs ... Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86: Booting SMP configuration: Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23 #24 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Spectre V2 : Update user space SMT mitigation: STIBP always-on Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35 #36 #37 #38 #39 #40 #41 #42 #43 #44 #45 #46 #47 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smp: Brought up 1 node, 48 CPUs Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot: Max logical packages: 1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot: Total of 48 processors activated (268312.60 BogoMIPS) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: node 0 deferred pages initialised in 134ms Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: devtmpfs: initialized Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/mm: Memory block size: 2048MB Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PM: Registering ACPI NVS region [mem 0x77d6c000-0x77d8bfff] (131072 bytes) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex hash table entries: 16384 (order: 8, 1048576 bytes, linear) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pinctrl core: initialized pinctrl subsystem Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_NETLINK/PF_ROUTE protocol family Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: audit: initializing netlink subsys (disabled) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: audit: type=2000 audit(1672318052.679:1): state=initialized audit_enabled=0 res=1 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: thermal_sys: Registered thermal governor 'fair_share' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: thermal_sys: Registered thermal governor 'step_wise' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: thermal_sys: Registered thermal governor 'user_space' Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpuidle: using governor menu Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Invalid PCCT: 0 PCC subspaces Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HugeTLB: can optimize 4095 vmemmap pages for hugepages-1048576kB Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: Using configuration type 1 for base access Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HugeTLB: can optimize 7 vmemmap pages for hugepages-2048kB Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cryptd: max_cpu_qlen set to 1000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Module Device) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Processor Device) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(3.0 _SCP Extensions) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Processor Aggregator Device) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Linux-Dell-Video) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: 5 ACPI AML tables successfully acquired and loaded Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Interpreter enabled Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PM: (supports S0 S5) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Using IOAPIC for interrupt routing Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HEST: Table parsing has been initialized. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: Using E820 reservations for host bridge windows Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: Enabled 2 GPEs in block 00 to 1F Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI Root Bridge [PC00] (domain 0000 [bus c0-ff]) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI host bridge to bus 0000:c0 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [io 0x03b0-0x03bb window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [io 0x03c0-0x03df window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [mem 0x000a0000-0x000bffff window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [io 0xa000-0xffff window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [mem 0xc6000000-0xdfffffff window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [mem 0x10a0200000-0x20b9fffffff window] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: root bus resource [bus c0-ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:00.0: [1022:1480] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:00.2: [1022:1481] type 00 class 0x080600 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: [1022:1483] type 01 class 0x060400 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:02.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:04.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:05.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: enabling Extended Tags Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: enabling Extended Tags Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: [8086:1521] type 00 class 0x020000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: reg 0x10: [mem 0xce100000-0xce1fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: reg 0x1c: [mem 0xce20c000-0xce20ffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: reg 0x184: [mem 0x10a02e0000-0x10a02e3fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: VF(n) BAR0 space: [mem 0x10a02e0000-0x10a02fffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: reg 0x190: [mem 0x10a02c0000-0x10a02c3fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: VF(n) BAR3 space: [mem 0x10a02c0000-0x10a02dffff 64bit pref] (contains BAR3 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: [8086:1521] type 00 class 0x020000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: reg 0x10: [mem 0xce000000-0xce0fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: reg 0x1c: [mem 0xce208000-0xce20bfff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: reg 0x184: [mem 0x10a02a0000-0x10a02a3fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: VF(n) BAR0 space: [mem 0x10a02a0000-0x10a02bffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: reg 0x190: [mem 0x10a0280000-0x10a0283fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: VF(n) BAR3 space: [mem 0x10a0280000-0x10a029ffff 64bit pref] (contains BAR3 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: [8086:1521] type 00 class 0x020000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: reg 0x10: [mem 0xcdf00000-0xcdffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: reg 0x1c: [mem 0xce204000-0xce207fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: reg 0x184: [mem 0x10a0260000-0x10a0263fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: VF(n) BAR0 space: [mem 0x10a0260000-0x10a027ffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: reg 0x190: [mem 0x10a0240000-0x10a0243fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: VF(n) BAR3 space: [mem 0x10a0240000-0x10a025ffff 64bit pref] (contains BAR3 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: [8086:1521] type 00 class 0x020000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: reg 0x10: [mem 0xcde00000-0xcdefffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: reg 0x1c: [mem 0xce200000-0xce203fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: PME# supported from D0 D3hot D3cold Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: reg 0x184: [mem 0x10a0220000-0x10a0223fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: VF(n) BAR0 space: [mem 0x10a0220000-0x10a023ffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: reg 0x190: [mem 0x10a0200000-0x10a0203fff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: VF(n) BAR3 space: [mem 0x10a0200000-0x10a021ffff 64bit pref] (contains BAR3 for 8 VFs) Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: PCI bridge to [bus c5] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: bridge window [mem 0xcde00000-0xce2fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: bridge window [mem 0x10a0200000-0x10a02fffff 64bit pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: [103c:3306] type 00 class 0x088000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: reg 0x10: [io 0xa200-0xa2ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: reg 0x14: [mem 0xcdba6000-0xcdba63ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: reg 0x18: [io 0xa100-0xa1ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: reg 0x1c: [mem 0xc8000000-0xcbffffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: reg 0x20: [mem 0xcd800000-0xcd9fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: [102b:0538] type 00 class 0x030000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: reg 0x10: [mem 0xcc000000-0xccffffff pref] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: reg 0x14: [mem 0xcdba0000-0xcdba3fff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: reg 0x18: [mem 0xcd000000-0xcd7fffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: BAR 0: assigned to efifb Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: [103c:3307] type 00 class 0x088000 Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x10: [io 0xa000-0xa0ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x14: [mem 0xcdba5000-0xcdba50ff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x18: [mem 0xcda00000-0xcdafffff] Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x1c: [mem 0xcdb00000-0xcdb7ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x20: [mem 0xcdb90000-0xcdb97fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x24: [mem 0xcdb80000-0xcdb8ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: reg 0x30: [mem 0x00000000-0x0000ffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.4: [103c:22f6] type 00 class 0x0c0320 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.4: reg 0x10: [mem 0xcdba4000-0xcdba40ff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: PCI bridge to [bus c1] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: bridge window [io 0xa000-0xafff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: bridge window [mem 0xc6000000-0xcdbfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.1: PCI bridge to [bus c4] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.0: [1022:148a] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.2: reg 0x18: [mem 0xcdd00000-0xcdd7ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.2: reg 0x24: [mem 0xcdd80000-0xcdd81fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: PCI bridge to [bus c2] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: bridge window [mem 0xcdd00000-0xcddfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.0: [1022:1485] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.2: reg 0x18: [mem 0xcdc00000-0xcdc7ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.2: reg 0x24: [mem 0xcdc80000-0xcdc81fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: PCI bridge to [bus c3] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: bridge window [mem 0xcdc00000-0xcdcfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: on NUMA node 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 80-bf]) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER LTR DPC] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI host bridge to bus 0000:80 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: root bus resource [io 0x7000-0x9fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: root bus resource [mem 0xab000000-0xc4ffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: root bus resource [mem 0x20bc0200000-0x406bfffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: root bus resource [bus 80-bf] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:00.0: [1022:1480] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:00.2: [1022:1481] type 00 class 0x080600 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:02.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:04.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:05.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: PCI bridge to [bus 83] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.1: PCI bridge to [bus 84] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.0: [1022:148a] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.2: reg 0x18: [mem 0xab100000-0xab17ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.2: reg 0x24: [mem 0xab180000-0xab181fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: PCI bridge to [bus 82] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: bridge window [mem 0xab100000-0xab1fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.0: [1022:1485] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.2: reg 0x18: [mem 0xab000000-0xab07ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.2: reg 0x24: [mem 0xab080000-0xab081fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: PCI bridge to [bus 81] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: bridge window [mem 0xab000000-0xab0fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: on NUMA node 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 40-7f]) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug AER LTR DPC] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI host bridge to bus 0000:40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: root bus resource [io 0x4000-0x6fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: root bus resource [mem 0x90000000-0xa9ffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: root bus resource [mem 0x406e0200000-0x601dfffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: root bus resource [bus 40-7f] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:00.0: [1022:1480] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:00.2: [1022:1481] type 00 class 0x080600 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:02.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:04.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:05.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.1: PCI bridge to [bus 43] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: [14e4:16d7] type 00 class 0x020000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x10: [mem 0x90600000-0x9060ffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x18: [mem 0x90400000-0x904fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x20: [mem 0x90620000-0x90621fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x1e4: [mem 0x406e1260000-0x406e1263fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: VF(n) BAR0 space: [mem 0x406e1260000-0x406e127ffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x1ec: [mem 0x406e0a00000-0x406e0afffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: VF(n) BAR2 space: [mem 0x406e0a00000-0x406e11fffff 64bit pref] (contains BAR2 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: reg 0x1f4: [mem 0x406e1240000-0x406e1243fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: VF(n) BAR4 space: [mem 0x406e1240000-0x406e125ffff 64bit pref] (contains BAR4 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: [14e4:16d7] type 00 class 0x020000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x10: [mem 0x90610000-0x9061ffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x18: [mem 0x90500000-0x905fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x20: [mem 0x90622000-0x90623fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x30: [mem 0x00000000-0x0007ffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x1e4: [mem 0x406e1220000-0x406e1223fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: VF(n) BAR0 space: [mem 0x406e1220000-0x406e123ffff 64bit pref] (contains BAR0 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x1ec: [mem 0x406e0200000-0x406e02fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: VF(n) BAR2 space: [mem 0x406e0200000-0x406e09fffff 64bit pref] (contains BAR2 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: reg 0x1f4: [mem 0x406e1200000-0x406e1203fff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: VF(n) BAR4 space: [mem 0x406e1200000-0x406e121ffff 64bit pref] (contains BAR4 for 8 VFs) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: PCI bridge to [bus 44] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: bridge window [mem 0x90400000-0x906fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: bridge window [mem 0x406e0200000-0x406e12fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: PCI bridge to [bus 45] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.0: [1022:148a] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.2: reg 0x18: [mem 0x90300000-0x9037ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.2: reg 0x24: [mem 0x90380000-0x90381fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: PCI bridge to [bus 41] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: bridge window [mem 0x90300000-0x903fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.0: [1022:1485] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.1: [1022:1486] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.1: reg 0x18: [mem 0x90100000-0x901fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.1: reg 0x24: [mem 0x90282000-0x90283fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.2: reg 0x18: [mem 0x90200000-0x9027ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.2: reg 0x24: [mem 0x90280000-0x90281fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: [1022:148c] type 00 class 0x0c0330 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: reg 0x10: [mem 0x90000000-0x900fffff 64bit] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: PCI bridge to [bus 42] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: bridge window [mem 0x90000000-0x902fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: on NUMA node 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 00-3f]) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI host bridge to bus 0000:00 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [io 0x0000-0x03af window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [io 0x0d00-0x3fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [mem 0xe1000000-0xfcffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [mem 0x60200200000-0x7fcffffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: root bus resource [bus 00-3f] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:00.0: [1022:1480] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:00.2: [1022:1481] type 00 class 0x080600 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:02.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.1: [1022:1483] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:04.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:05.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.0: [1022:1482] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: [1022:1484] type 01 class 0x060400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:14.3: [1022:790e] type 00 class 0x060100 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.0: [1022:1490] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.1: [1022:1491] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.2: [1022:1492] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.3: [1022:1493] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.4: [1022:1494] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.5: [1022:1495] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.6: [1022:1496] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.7: [1022:1497] type 00 class 0x060000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.1: PCI bridge to [bus 04] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.1: PCI bridge to [bus 03] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.0: [1022:148a] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.2: reg 0x18: [mem 0xe1200000-0xe127ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.2: reg 0x24: [mem 0xe1280000-0xe1281fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: PCI bridge to [bus 01] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: bridge window [mem 0xe1200000-0xe12fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.0: [1022:1485] type 00 class 0x130000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.0: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.2: [1022:1498] type 00 class 0x108000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.2: reg 0x18: [mem 0xe1100000-0xe117ffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.2: reg 0x24: [mem 0xe1180000-0xe1181fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.2: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: [1022:148c] type 00 class 0x0c0330 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: reg 0x10: [mem 0xe1000000-0xe10fffff 64bit] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: enabling Extended Tags Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: PME# supported from D0 D3hot D3cold Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: PCI bridge to [bus 02] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: bridge window [mem 0xe1000000-0xe11fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: on NUMA node 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKA configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKB configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKC configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKD configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKE configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKF configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKG configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: PCI: Interrupt link LNKH configured for IRQ 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: iommu: Default domain type: Translated Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: iommu: DMA domain TLB invalidation policy: lazy mode Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SCSI subsystem initialized Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: bus type USB registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver usbfs Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver hub Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new device driver usb Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pps_core: LinuxPPS API ver. 1 registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PTP clock support registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: EDAC MC: Ver: 3.0.0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Registered efivars operations Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NetLabel: Initializing Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NetLabel: domain hash size = 128 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NetLabel: unlabeled traffic allowed by default Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: Using ACPI for IRQ routing Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: pci_cache_line_size set to 64 bytes Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x60163000-0x63ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6024b000-0x63ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x60259000-0x63ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6101b000-0x63ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6131c000-0x63ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a010000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a045000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a049000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a8ea000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a910000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6a912000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6be74000-0x6bffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6d4ae000-0x6fffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x6f86b000-0x6fffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x74343018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x74370018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x7439d018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x743a8018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x743b1018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x743f2018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x74433018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x74474018-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x77d6c000-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x77dff000-0x77ffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x87ff00000-0x87fffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: e820: reserve RAM buffer [mem 0x107f300000-0x107fffffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: vgaarb: setting as boot VGA device Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: vgaarb: bridge control possible Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vgaarb: loaded Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpet0: 3 comparators, 32-bit 14.318180 MHz counter Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: Switched to clocksource tsc-early Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: VFS: Disk quotas dquot_6.6.0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pnp: PnP ACPI init Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0400-0x049f] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0b00-0x0b0f] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0b20-0x0b3f] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0c00-0x0c01] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0c14-0x0c15] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [io 0x0cd0-0x0cdf] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfec10000-0xfec10fff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfed80000-0xfed80fff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfed81d00-0xfed81dff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfed81e00-0xfed81eff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfedc0000-0xfedc1fff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfedc4000-0xfeddffff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: system 00:01: [mem 0xff000000-0xffffffff] has been reserved Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pnp: PnP ACPI: found 4 devices Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_INET protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: tcp_listen_portaddr_hash hash table entries: 32768 (order: 8, 1310720 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: TCP bind hash table entries: 65536 (order: 9, 2621440 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: TCP: Hash tables configured (established 524288 bind 65536) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: MPTCP token hash table entries: 65536 (order: 9, 3670016 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: UDP hash table entries: 32768 (order: 9, 3145728 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: UDP-Lite hash table entries: 32768 (order: 9, 3145728 bytes, linear) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_UNIX/PF_LOCAL protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_XDP protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: BAR 6: assigned [mem 0xce280000-0xce2fffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: BAR 6: no space for [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: BAR 6: failed to assign [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: BAR 6: no space for [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: BAR 6: failed to assign [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: BAR 6: no space for [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: BAR 6: failed to assign [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: PCI bridge to [bus c5] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: bridge window [mem 0xcde00000-0xce2fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: bridge window [mem 0x10a0200000-0x10a02fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: BAR 6: assigned [mem 0xc6000000-0xc600ffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: PCI bridge to [bus c1] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: bridge window [io 0xa000-0xafff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: bridge window [mem 0xc6000000-0xcdbfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.1: PCI bridge to [bus c4] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: PCI bridge to [bus c2] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: bridge window [mem 0xcdd00000-0xcddfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: PCI bridge to [bus c3] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: bridge window [mem 0xcdc00000-0xcdcfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 4 [io 0x03b0-0x03bb window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 5 [io 0x03c0-0x03df window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 6 [mem 0x000a0000-0x000bffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 7 [io 0xa000-0xffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 8 [mem 0xc6000000-0xdfffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c0: resource 9 [mem 0x10a0200000-0x20b9fffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c5: resource 1 [mem 0xcde00000-0xce2fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c5: resource 2 [mem 0x10a0200000-0x10a02fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c1: resource 0 [io 0xa000-0xafff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c1: resource 1 [mem 0xc6000000-0xcdbfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c2: resource 1 [mem 0xcdd00000-0xcddfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:c3: resource 1 [mem 0xcdc00000-0xcdcfffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [io 0x1000-0x0fff] to [bus 83] add_size 1000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 83] add_size 200000 add_align 100000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [mem 0x00100000-0x000fffff] to [bus 83] add_size 200000 add_align 100000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: BAR 14: assigned [mem 0xab200000-0xab3fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: BAR 15: assigned [mem 0x20bc0200000-0x20bc03fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: BAR 13: assigned [io 0x7000-0x7fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: PCI bridge to [bus 83] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [io 0x7000-0x7fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [mem 0xab200000-0xab3fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: bridge window [mem 0x20bc0200000-0x20bc03fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.1: PCI bridge to [bus 84] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: PCI bridge to [bus 82] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: bridge window [mem 0xab100000-0xab1fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: PCI bridge to [bus 81] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: bridge window [mem 0xab000000-0xab0fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: resource 4 [io 0x7000-0x9fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: resource 5 [mem 0xab000000-0xc4ffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:80: resource 6 [mem 0x20bc0200000-0x406bfffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:83: resource 0 [io 0x7000-0x7fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:83: resource 1 [mem 0xab200000-0xab3fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:83: resource 2 [mem 0x20bc0200000-0x20bc03fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:82: resource 1 [mem 0xab100000-0xab1fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:81: resource 1 [mem 0xab000000-0xab0fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [io 0x1000-0x0fff] to [bus 45] add_size 1000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 45] add_size 200000 add_align 100000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [mem 0x00100000-0x000fffff] to [bus 45] add_size 200000 add_align 100000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: BAR 14: assigned [mem 0x90700000-0x908fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: BAR 15: assigned [mem 0x406e1300000-0x406e14fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: BAR 13: assigned [io 0x4000-0x4fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.1: PCI bridge to [bus 43] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: BAR 6: assigned [mem 0x90680000-0x906fffff pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: BAR 6: no space for [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: BAR 6: failed to assign [mem size 0x00080000 pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: PCI bridge to [bus 44] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: bridge window [mem 0x90400000-0x906fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: bridge window [mem 0x406e0200000-0x406e12fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: PCI bridge to [bus 45] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [io 0x4000-0x4fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [mem 0x90700000-0x908fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: bridge window [mem 0x406e1300000-0x406e14fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: PCI bridge to [bus 41] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: bridge window [mem 0x90300000-0x903fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: PCI bridge to [bus 42] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: bridge window [mem 0x90000000-0x902fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: resource 4 [io 0x4000-0x6fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: resource 5 [mem 0x90000000-0xa9ffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:40: resource 6 [mem 0x406e0200000-0x601dfffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:44: resource 1 [mem 0x90400000-0x906fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:44: resource 2 [mem 0x406e0200000-0x406e12fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:45: resource 0 [io 0x4000-0x4fff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:45: resource 1 [mem 0x90700000-0x908fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:45: resource 2 [mem 0x406e1300000-0x406e14fffff 64bit pref] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:41: resource 1 [mem 0x90300000-0x903fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:42: resource 1 [mem 0x90000000-0x902fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.1: PCI bridge to [bus 04] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.1: PCI bridge to [bus 03] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: PCI bridge to [bus 01] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: bridge window [mem 0xe1200000-0xe12fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: PCI bridge to [bus 02] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: bridge window [mem 0xe1000000-0xe11fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: resource 4 [io 0x0000-0x03af window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: resource 5 [io 0x03e0-0x0cf7 window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: resource 6 [io 0x0d00-0x3fff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: resource 7 [mem 0xe1000000-0xfcffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:00: resource 8 [mem 0x60200200000-0x7fcffffffff window] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:01: resource 1 [mem 0xe1200000-0xe12fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci_bus 0000:02: resource 1 [mem 0xe1000000-0xe11fffff] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: enabling device (0140 -> 0142) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: enabling device (0140 -> 0142) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI: CLS 64 bytes, default 64 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:00.2: AMD-Vi: IOMMU performance counters supported Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:00.2: AMD-Vi: IOMMU performance counters supported Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Trying to unpack rootfs image as initramfs... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:00.2: AMD-Vi: IOMMU performance counters supported Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.0: Adding to iommu group 0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.1: Adding to iommu group 1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:01.5: Adding to iommu group 2 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:02.0: Adding to iommu group 3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.0: Adding to iommu group 4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:03.1: Adding to iommu group 5 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:04.0: Adding to iommu group 6 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:05.0: Adding to iommu group 7 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.0: Adding to iommu group 8 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:07.1: Adding to iommu group 9 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.0: Adding to iommu group 10 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:08.1: Adding to iommu group 11 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.0: Adding to iommu group 12 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.1: Adding to iommu group 13 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.2: Adding to iommu group 14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c5:00.3: Adding to iommu group 15 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.0: Adding to iommu group 16 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.1: Adding to iommu group 16 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.2: Adding to iommu group 16 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c1:00.4: Adding to iommu group 16 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.0: Adding to iommu group 17 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c2:00.2: Adding to iommu group 18 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.0: Adding to iommu group 19 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c3:00.2: Adding to iommu group 20 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.0: Adding to iommu group 21 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:01.1: Adding to iommu group 22 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:02.0: Adding to iommu group 23 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.0: Adding to iommu group 24 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:03.1: Adding to iommu group 25 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:04.0: Adding to iommu group 26 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:05.0: Adding to iommu group 27 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.0: Adding to iommu group 28 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:07.1: Adding to iommu group 29 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.0: Adding to iommu group 30 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:08.1: Adding to iommu group 31 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.0: Adding to iommu group 32 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:82:00.2: Adding to iommu group 33 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.0: Adding to iommu group 34 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:81:00.2: Adding to iommu group 35 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.0: Adding to iommu group 36 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.1: Adding to iommu group 37 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:01.2: Adding to iommu group 38 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:02.0: Adding to iommu group 39 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.0: Adding to iommu group 40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:03.1: Adding to iommu group 41 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:04.0: Adding to iommu group 42 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:05.0: Adding to iommu group 43 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.0: Adding to iommu group 44 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:07.1: Adding to iommu group 45 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.0: Adding to iommu group 46 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:08.1: Adding to iommu group 47 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.0: Adding to iommu group 48 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:44:00.1: Adding to iommu group 49 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.0: Adding to iommu group 50 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:41:00.2: Adding to iommu group 51 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.0: Adding to iommu group 52 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.1: Adding to iommu group 53 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.2: Adding to iommu group 54 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:42:00.3: Adding to iommu group 55 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.0: Adding to iommu group 56 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:01.1: Adding to iommu group 57 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:02.0: Adding to iommu group 58 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.0: Adding to iommu group 59 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:03.1: Adding to iommu group 60 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:04.0: Adding to iommu group 61 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:05.0: Adding to iommu group 62 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.0: Adding to iommu group 63 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:07.1: Adding to iommu group 64 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.0: Adding to iommu group 65 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:08.1: Adding to iommu group 66 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:14.0: Adding to iommu group 67 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:14.3: Adding to iommu group 67 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.0: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.1: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.2: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.3: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.4: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.5: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.6: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:18.7: Adding to iommu group 68 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.0: Adding to iommu group 69 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:01:00.2: Adding to iommu group 70 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.0: Adding to iommu group 71 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.2: Adding to iommu group 72 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:02:00.3: Adding to iommu group 73 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:c0:00.2: AMD-Vi: Found IOMMU cap 0x40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Extended features (0x58f77ef22294ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:80:00.2: AMD-Vi: Found IOMMU cap 0x40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Extended features (0x58f77ef22294ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:40:00.2: AMD-Vi: Found IOMMU cap 0x40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Extended features (0x58f77ef22294ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Extended features (0x58f77ef22294ade, 0x0): PPR X2APIC NX GT IA GA PC GA_vAPIC Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Interrupt remapping enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: X2APIC enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AMD-Vi: Virtual APIC enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: software IO TLB: mapped [mem 0x000000001b000000-0x000000001f000000] (64MB) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: bus type thunderbolt registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: LVT offset 0 assigned for vector 0x400 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: perf: AMD IBS detected (0x000003ff) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: amd_uncore: 4 amd_df counters detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: amd_uncore: 6 amd_l3 counters detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: perf/amd_iommu: Detected AMD IOMMU #1 (2 banks, 4 counters/bank). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: perf/amd_iommu: Detected AMD IOMMU #2 (2 banks, 4 counters/bank). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: perf/amd_iommu: Detected AMD IOMMU #3 (2 banks, 4 counters/bank). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Initialise system trusted keyrings Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type blacklist registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: workingset: timestamp_bits=36 max_order=24 bucket_order=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: zbud: loaded Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Platform Keyring initialized Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_ALG protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xor: automatically using best checksumming function avx Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type asymmetric registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Asymmetric key parser 'x509' registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Running certificate verification selftests Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: io scheduler mq-deadline registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: io scheduler kyber registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: io scheduler bfq registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: atomic64_test: passed for x86-64 platform with CX8 and with SSE Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:c0:01.1: PME: Signaling with IRQ 30 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:c0:01.5: PME: Signaling with IRQ 31 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:c0:03.1: PME: Signaling with IRQ 32 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:c0:07.1: PME: Signaling with IRQ 34 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:c0:08.1: PME: Signaling with IRQ 36 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:80:01.1: PME: Signaling with IRQ 37 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:80:01.1: pciehp: Slot #0 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+ Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:80:03.1: PME: Signaling with IRQ 38 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:80:07.1: PME: Signaling with IRQ 40 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:80:08.1: PME: Signaling with IRQ 42 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:01.1: PME: Signaling with IRQ 43 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:01.2: PME: Signaling with IRQ 44 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:03.1: PME: Signaling with IRQ 45 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:03.1: pciehp: Slot #35 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl+ IbPresDis- LLActRep+ Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:07.1: PME: Signaling with IRQ 47 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:40:08.1: PME: Signaling with IRQ 48 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:00:01.1: PME: Signaling with IRQ 49 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:00:03.1: PME: Signaling with IRQ 50 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:00:07.1: PME: Signaling with IRQ 52 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pcieport 0000:00:08.1: PME: Signaling with IRQ 53 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: button: Power Button [PWRB] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: button: Power Button [PWRF] Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Monitor-Mwait will be used to enter C-1 state Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C000: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C002: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C004: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C006: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C008: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00A: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00C: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00E: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C010: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C012: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C014: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C016: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C018: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01A: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01C: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01E: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C020: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C022: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C024: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C026: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C028: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02A: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02C: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02E: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C001: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C003: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C005: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C007: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C009: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00B: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00D: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C00F: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C011: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C013: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C015: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C017: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C019: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01B: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01D: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C01F: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C021: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C023: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C025: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C027: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C029: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02B: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02D: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: \_SB_.SCK0.C02F: Found 2 idle states Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ERST: Error Record Serialization Table (ERST) support is initialized. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pstore: Registered erst as persistent store backend Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: EDAC MC0: Giving out device to module ghes_edac.c controller ghes_edac: DEV ghes (INTERRUPT) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 00:02: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Non-volatile memory driver v1.3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rdac: device handler registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hp_sw: device handler registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: emc: device handler registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: alua: device handler registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: libphy: Fixed MDIO Bus: probed Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci-pci: EHCI PCI platform driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci-pci 0000:c1:00.4: EHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci-pci 0000:c1:00.4: new USB bus registered, assigned bus number 1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci-pci 0000:c1:00.4: irq 55, io mem 0xcdba4000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ehci-pci 0000:c1:00.4: USB 2.0 started, EHCI 1.00 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb1: Product: EHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb1: Manufacturer: Linux 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 ehci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb1: SerialNumber: 0000:c1:00.4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 1-0:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 1-0:1.0: 8 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ohci-pci: OHCI PCI platform driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: uhci_hcd: USB Universal Host Controller Interface driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: new USB bus registered, assigned bus number 2 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000000000410 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: new USB bus registered, assigned bus number 3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:42:00.3: Host supports USB 3.1 Enhanced SuperSpeed Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb2: Product: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb2: Manufacturer: Linux 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 xhci-hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb2: SerialNumber: 0000:42:00.3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 2-0:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 2-0:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: We don't know the algorithms for LPM for this host, disabling LPM. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: Product: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: Manufacturer: Linux 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 xhci-hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb3: SerialNumber: 0000:42:00.3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 3-0:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 3-0:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000000000410 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 5 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xhci_hcd 0000:02:00.3: Host supports USB 3.1 Enhanced SuperSpeed Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb4: Product: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb4: Manufacturer: Linux 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 xhci-hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb4: SerialNumber: 0000:02:00.3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-0:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-0:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: We don't know the algorithms for LPM for this host, disabling LPM. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: Product: xHCI Host Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: Manufacturer: Linux 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 xhci-hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb usb5: SerialNumber: 0000:02:00.3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 5-0:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 5-0:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver usbserial_generic Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbserial: USB Serial support registered for generic Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: i8042: PNP: No PS/2 controller found. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: i8042: Probing ports directly. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1: new high-speed USB device number 2 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2: new high-speed USB device number 2 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1: New USB device found, idVendor=0424, idProduct=2744, bcdDevice= 2.21 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1: Product: USB2744 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2: New USB device found, idVendor=0424, idProduct=2744, bcdDevice= 2.21 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2: Product: USB2744 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing initrd memory: 31016K Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 2-1:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 2-1:1.0: 3 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-2:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-2:1.0: 5 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 5-2: new SuperSpeed USB device number 2 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 3-1: new SuperSpeed USB device number 2 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 5-2: New USB device found, idVendor=0424, idProduct=5744, bcdDevice= 2.21 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 5-2: New USB device strings: Mfr=2, Product=3, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 5-2: Product: USB5744 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 5-2: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 3-1: New USB device found, idVendor=0424, idProduct=5744, bcdDevice= 2.21 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 3-1: New USB device strings: Mfr=2, Product=3, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 3-1: Product: USB5744 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 3-1: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: i8042: Can't read CTR while initializing i8042 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: i8042: probe of i8042 failed with error -5 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: mousedev: PS/2 mouse device common for all mice Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rtc_cmos 00:00: RTC can wake from S4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rtc_cmos 00:00: registered as rtc0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rtc_cmos 00:00: setting system clock to 2022-12-29T12:47:36 UTC (1672318056) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efifb: probing for efifb Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efifb: framebuffer at 0xcc000000, using 3072k, total 3072k Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efifb: mode is 1024x768x32, linelength=4096, pages=1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efifb: scrolling: redraw Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 3-1:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 3-1:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 5-2:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 5-2:1.0: 4 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb: port power management may be unreliable Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Console: switching to colour frame buffer device 128x48 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: fb0: EFI VGA frame buffer device Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: EFI Variables Facility v0.08 2004-May-17 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hid: raw HID events driver (C) Jiri Kosina Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver usbhid Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbhid: USB HID core driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: drop_monitor: Initializing network drop monitor service Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Initializing XFRM netlink socket Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_INET6 protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Segment Routing with IPv6 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NET: Registered PF_PACKET protocol family Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: mpls_gso: MPLS GSO support Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU0: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU1: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU2: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU3: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU4: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU5: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU6: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU7: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU8: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU9: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU10: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU11: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU12: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU13: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU14: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU15: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU16: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU17: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU18: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU19: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU20: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU21: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU22: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU23: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU24: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU25: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU26: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU27: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU28: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU29: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU30: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU31: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU32: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU33: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU34: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU35: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU36: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU37: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU38: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU39: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU40: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU41: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU42: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU43: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU44: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU45: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU46: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU47: patch_level=0x08301025 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: Microcode Update Driver: v2.2. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: resctrl: L3 allocation detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: resctrl: L3DATA allocation detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: resctrl: L3CODE allocation detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: resctrl: MB allocation detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: resctrl: L3 monitoring detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IPI shorthand broadcast: enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AVX2 version of gcm_enc/dec engaged. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: AES CTR mode by8 optimization enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sched_clock: Marking stable (1906550833, 2971277860)->(4929415848, -51587155) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: registered taskstats version 1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loading compiled-in X.509 certificates Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: cab4030e640344675adda70d91cd7d5ef36076c2' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: zswap: loaded using pool lzo/zbud Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: page_owner is disabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pstore: Using crash dump compression: deflate Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type big_key registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type encrypted registered Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'Hewlett Packard Enterprise Company: HPE UEFI Secure Boot 2016 DB Key: a068bfe686eec826df935e3bb1cd36f1c2772560' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'Hewlett-Packard Company: HP UEFI Secure Boot 2013 DB key: 1d7cf2c2b92673f69c8ee1ec7063967ab9b62bec' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'Microsoft Corporation UEFI CA 2011: 13adbf4309bd82709c8cd54f316ed522988a1bd4' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'Microsoft Windows Production PCA 2011: a92902398e16c49778cd90f99e4f9ae17c55af53' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'SUSE Linux Enterprise Secure Boot Signkey: 3fb077b6cebc6ff2522e1c148c57c777c788e3e7' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'VMware, Inc.: 4ad8ba0472073d28127706ddc6ccb9050441bbc7' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:db Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'VMware, Inc.: VMware Secure Boot Signing: 04597f3e1ffb240bba0ff0f05d5eb05f3e15f6d7' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: integrity: Loaded X.509 cert 'CentOS Secure Boot CA 2: 70007f99209c126be14774eaec7b6d9631f34dca' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ima: No TPM chip found, activating TPM-bypass! Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loading compiled-in module X.509 certificates Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: cab4030e640344675adda70d91cd7d5ef36076c2' Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ima: Allocated hash algorithm: sha256 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ima: No architecture policies found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: Initialising EVM extended attributes: Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.selinux Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.SMACK64 (disabled) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.SMACK64EXEC (disabled) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.SMACK64TRANSMUTE (disabled) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.SMACK64MMAP (disabled) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.apparmor (disabled) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.ima Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: security.capability Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: evm: HMAC attrs: 0x1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1.3: new high-speed USB device number 3 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: tsc: Refined TSC clocksource calibration: 2794.750 MHz Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2848e100549, max_idle_ns: 440795215505 ns Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: clocksource: Switched to clocksource tsc Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.1: new high-speed USB device number 3 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1.3: New USB device found, idVendor=0424, idProduct=2740, bcdDevice= 2.00 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1.3: Product: Hub Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 2-1.3: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.1: New USB device found, idVendor=0424, idProduct=2660, bcdDevice= 8.01 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-2.1:1.0: USB hub found Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hub 4-2.1:1.0: 2 ports detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing unused decrypted memory: 2036K Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing unused kernel image (initmem) memory: 2776K Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Write protecting the kernel read-only data: 26624k Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing unused kernel image (text/rodata gap) memory: 2040K Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Freeing unused kernel image (rodata/data gap) memory: 208K Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: new high-speed USB device number 4 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: x86/mm: Checked W+X mappings: passed, no W+X pages found. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Run /init as init process Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: with arguments: Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: /init Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: with environment: Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: HOME=/ Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: TERM=linux Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.14.0-226.rt14.227.1773_734386590.el9.x86_64 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: New USB device found, idVendor=0bda, idProduct=0177, bcdDevice=77.11 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: Product: USB2.0-CRW Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: Manufacturer: Generic Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.3: SerialNumber: 20121112761000000 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.5: new high-speed USB device number 5 using xhci_hcd Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.5: New USB device found, idVendor=0424, idProduct=2740, bcdDevice= 2.00 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.5: New USB device strings: Mfr=1, Product=2, SerialNumber=0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.5: Product: Hub Controller Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb 4-2.5: Manufacturer: Microchip Tech Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ERST: [Firmware Warn]: too many record IDs! Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd 252-2.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Detected architecture x86-64. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Running in initrd. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Hostname set to . Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Queued start job for default target Initrd Default Target. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/systemd-hibernate-resume. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Initrd /usr File System. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Path Units. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Slice Units. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Swaps. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Timer Units. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on D-Bus System Message Bus Socket. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Journal Socket (/dev/log). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Journal Socket. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on udev Control Socket. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on udev Kernel Socket. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Socket Units. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create List of Static Device Nodes... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Journal Service... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Modules... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create System Users... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Setup Virtual Console... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create List of Static Device Nodes. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Modules. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Apply Kernel Variables... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create System Users. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Apply Kernel Variables. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Setup Virtual Console. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[771]: Journal started Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[771]: Runtime Journal (/run/log/journal/372bb20d02144cb6b0d7d8f292c77c4f) is 8.0M, max 1.2G, 1.2G free. Dec 29 07:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[772]: Module 'msr' is built in Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-sysusers[773]: Creating group 'nobody' with GID 65534. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-sysusers[773]: Creating group 'users' with GID 100. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-sysusers[773]: Creating group 'dbus' with GID 81. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-sysusers[773]: Creating user 'dbus' (System Message Bus) with UID 81 and GID 81. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Journal Service. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut ask for additional cmdline parameters was skipped because no trigger condition checks were met. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting dracut cmdline hook... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create Static Device Nodes in /dev... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut-cmdline[786]: dracut-9 dracut-057-13.git20220816.el9 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create Volatile Files and Directories... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut-cmdline[786]: Using kernel command line parameters: BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.14.0-226.rt14.227.1773_734386590.el9.x86_64 root=UUID=afd41ec7-fe9b-4587-90a0-fe87a3ae79df ro efi=runtime resume=UUID=6d8fff54-40cf-4e53-9de5-58ff0ac08839 console=ttyS0,115200n81 crashkernel=1G-4G:384M,4G-16G:512M,16G-64G:1G,64G-128G:2G,128G-:4G Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create Static Device Nodes in /dev. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create Volatile Files and Directories. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished dracut cmdline hook. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting dracut pre-udev hook... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished dracut pre-udev hook. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Rule-based Manager for Device Events and Files... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-udevd[873]: Using default interface naming scheme 'rhel-9.0'. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Rule-based Manager for Device Events and Files. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut pre-trigger hook was skipped because no trigger condition checks were met. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Coldplug All udev Devices... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Coldplug All udev Devices. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nm-initrd.service was skipped because of an unmet condition check (ConditionPathExists=/run/NetworkManager/initrd/neednet). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Network. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nm-wait-online-initrd.service was skipped because of an unmet condition check (ConditionPathExists=/run/NetworkManager/initrd/neednet). Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting dracut initqueue hook... Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sp5100_tco: SP5100/SB800 TCO WatchDog Timer Driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sp5100-tco sp5100-tco: Using 0xfeb00000 for watchdog MMIO address Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sp5100-tco sp5100-tco: initialized. heartbeat=60 sec (nowayout=0) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dca service started, version 1.12.1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpwdt 0000:c1:00.0: HPE Watchdog Timer Driver: NMI decoding initialized Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpwdt 0000:c1:00.0: HPE Watchdog Timer Driver: Version: 2.0.4 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpwdt 0000:c1:00.0: timeout: 30 seconds (nowayout=0) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpwdt 0000:c1:00.0: pretimeout: on. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hpwdt 0000:c1:00.0: kdumptimeout: -1. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver usb-storage Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ccp 0000:42:00.1: enabling device (0140 -> 0142) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ccp 0000:42:00.1: no command queues available Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ccp 0000:42:00.1: SEV: memory encryption not enabled by BIOS Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ccp 0000:42:00.1: psp enabled Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver uas Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ums-realtek 4-2.3:1.0: USB Mass Storage device detected Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: scsi host0: usb-storage 4-2.3:1.0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usbcore: registered new interface driver ums-realtek Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb: Intel(R) Gigabit Ethernet Network Driver Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb: Copyright (c) 2007-2014 Intel Corporation. Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 eth0: Broadcom BCM57414 NetXtreme-E 10Gb/25Gb Ethernet found at mem 90600000, node addr 00:0a:f7:97:b1:62 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0: 63.008 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x8 link) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.1 eth1: Broadcom BCM57414 NetXtreme-E 10Gb/25Gb Ethernet found at mem 90610000, node addr 00:0a:f7:97:b1:63 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.1: 63.008 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x8 link) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.1 ens2f1np1: renamed from eth1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 ens2f0np0: renamed from eth0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0: added PHC on eth0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0: Intel(R) Gigabit Ethernet Network Connection Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 48:df:37:ad:f6:f0 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0: eth0: PBA No: G41713-017 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1: added PHC on eth1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1: Intel(R) Gigabit Ethernet Network Connection Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 48:df:37:ad:f6:f1 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1: eth1: PBA No: G41713-017 Dec 29 07:47:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2: added PHC on eth2 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2: Intel(R) Gigabit Ethernet Network Connection Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 48:df:37:ad:f6:f2 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2: eth2: PBA No: G41713-017 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3: added PHC on eth3 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3: Intel(R) Gigabit Ethernet Network Connection Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 48:df:37:ad:f6:f3 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3: eth3: PBA No: G41713-017 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2 eno7: renamed from eth2 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0 eno5: renamed from eth0 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3 eno8: renamed from eth3 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1 eno6: renamed from eth1 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: scsi 0:0:0:0: Direct-Access Generic- SD/MMC/MS PRO 1.00 PQ: 0 ANSI: 4 Dec 29 07:47:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: scsi 0:0:0:0: Attached scsi generic sg0 type 0 Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sd 0:0:0:0: [sda] 249737216 512-byte logical blocks: (128 GB/119 GiB) Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sd 0:0:0:0: [sda] Write Protect is off Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sd 0:0:0:0: [sda] Mode Sense: 2f 00 00 00 Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sda: sda1 sda2 sda3 sda4 sda5 sda6 Dec 29 07:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sd 0:0:0:0: [sda] Attached SCSI removable disk Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Found device SD_MMC_MS_PRO 5. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Resume from hibernation using device /dev/disk/by-uuid/6d8fff54-40cf-4e53-9de5-58ff0ac08839... Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-hibernate-resume[1086]: Could not resume from '/dev/disk/by-uuid/6d8fff54-40cf-4e53-9de5-58ff0ac08839' (8:5). Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PM: Image not found (code -22) Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Found device SD_MMC_MS_PRO 6. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hibernate-resume@dev-disk-by\x2duuid-6d8fff54\x2d40cf\x2d4e53\x2d9de5\x2d58ff0ac08839.service: Deactivated successfully. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Resume from hibernation using device /dev/disk/by-uuid/6d8fff54-40cf-4e53-9de5-58ff0ac08839. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished dracut initqueue hook. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Initrd Root Device. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Preparation for Local File Systems. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Local File Systems. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Preparation for Remote File Systems. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Remote File Systems. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target System Initialization. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Basic System. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut pre-mount hook was skipped because no trigger condition checks were met. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting File System Check on /dev/disk/by-uuid/afd41ec7-fe9b-4587-90a0-fe87a3ae79df... Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-fsck[1094]: /usr/sbin/fsck.xfs: XFS file system. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished File System Check on /dev/disk/by-uuid/afd41ec7-fe9b-4587-90a0-fe87a3ae79df. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting /sysroot... Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda6): Mounting V5 Filesystem Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda6): Ending clean mount Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted /sysroot. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Initrd Root File System. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Mountpoints Configured in the Real Root... Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: initrd-parse-etc.service: Deactivated successfully. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Mountpoints Configured in the Real Root. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Initrd File Systems. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Initrd Default Target. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut mount hook was skipped because no trigger condition checks were met. Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting dracut pre-pivot and cleanup hook... Dec 29 07:47:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished dracut pre-pivot and cleanup hook. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Cleaning Up and Shutting Down Daemons... Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Network. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Timer Units. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dbus.socket: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Closed D-Bus System Message Bus Socket. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut-pre-pivot.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped dracut pre-pivot and cleanup hook. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Initrd Default Target. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Basic System. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Initrd Root Device. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Initrd /usr File System. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Path Units. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-ask-password-console.path: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Remote File Systems. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Preparation for Remote File Systems. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Slice Units. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Socket Units. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target System Initialization. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Local File Systems. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Preparation for Local File Systems. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Swaps. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut-initqueue.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped dracut initqueue hook. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-sysctl.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Apply Kernel Variables. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-modules-load.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Load Kernel Modules. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Create Volatile Files and Directories. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-udev-trigger.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Coldplug All udev Devices. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping Rule-based Manager for Device Events and Files... Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Setup Virtual Console. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup.service.mount: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-credentials-systemd\x2dsysctl.service.mount: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: initrd-cleanup.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Cleaning Up and Shutting Down Daemons. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-udevd.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Rule-based Manager for Device Events and Files. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-udevd.service: Consumed 3.360s CPU time. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-udevd-control.socket: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Closed udev Control Socket. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-udevd-kernel.socket: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Closed udev Kernel Socket. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut-pre-udev.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped dracut pre-udev hook. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dracut-cmdline.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped dracut cmdline hook. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Cleanup udev Database... Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Create Static Device Nodes in /dev. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: kmod-static-nodes.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Create List of Static Device Nodes. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-sysusers.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Create System Users. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dsetup\x2ddev.service.mount: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-credentials-systemd\x2dsysusers.service.mount: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Cleanup udev Database. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Switch Root. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Switch Root... Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Switching root. Dec 29 07:47:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[771]: Journal stopped Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[771]: Received SIGTERM from PID 1 (systemd). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability network_peer_controls=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability open_perms=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability extended_socket_class=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability always_check_network=0 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability cgroup_seclabel=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability nnp_nosuid_transition=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: SELinux: policy capability genfs_seclabel_symlinks=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: audit: type=1403 audit(1672318067.330:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Successfully loaded SELinux policy in 332.689ms. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: RTC configured in localtime, applying delta of -300 minutes to system time. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 73.423ms. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd 252-2.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Detected architecture x86-64. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[1156]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: initrd-switch-root.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Switch Root. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/getty. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/modprobe. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/serial-getty. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/sshd-keygen. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/systemd-fsck. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice User and Session Slice. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Dispatch Password Requests to Console Directory Watch. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Forward Password Requests to Wall Directory Watch. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Local Encrypted Volumes. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Switch Root. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Initrd File Systems. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target Initrd Root File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Local Integrity Protected Volumes. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Path Units. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Slice Units. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target System Time Set. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Local Verity Protected Volumes. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: multipathd control socket was skipped because of an unmet condition check (ConditionPathExists=/etc/multipath.conf). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on RPCbind Server Activation Socket. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target RPC Port Mapper. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Process Core Dump Socket. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on initctl Compatibility Named Pipe. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on udev Control Socket. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on udev Kernel Socket. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting Huge Pages File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting POSIX Message Queue File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting Kernel Debug File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting Kernel Trace File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create List of Static Device Nodes... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Module configfs... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Module drm... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Module fuse... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-fsck-root.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped File System Check on Root Device. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Journal Service. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: fuse: init (API version 7.36) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Journal Service... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Modules... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Generate network units from Kernel command line... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ACPI: bus type drm_connector registered Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[1182]: Journal started Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[1182]: Runtime Journal (/run/log/journal/372bb20d02144cb6b0d7d8f292c77c4f) is 8.0M, max 1.2G, 1.2G free. Dec 29 12:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Queued start job for default target Multi-User System. Dec 29 12:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-journald.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1183]: Module 'msr' is built in Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Remount Root and Kernel File Systems... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Coldplug All udev Devices... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Journal Service. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted Huge Pages File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted POSIX Message Queue File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted Kernel Debug File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted Kernel Trace File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create List of Static Device Nodes. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: modprobe@configfs.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Module configfs. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: modprobe@drm.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Module drm. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: modprobe@fuse.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Module fuse. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Modules. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Generate network units from Kernel command line. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Remount Root and Kernel File Systems. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Preparation for Network. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting FUSE Control File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting Kernel Configuration File System... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Special handling of early boot iSCSI sessions was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/class/iscsi_session). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Flush Journal to Persistent Storage... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load/Save Random Seed... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[1182]: Runtime Journal (/run/log/journal/372bb20d02144cb6b0d7d8f292c77c4f) is 8.0M, max 1.2G, 1.2G free. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-journald[1182]: Received client request to flush runtime journal. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Apply Kernel Variables... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Create System Users was skipped because no trigger condition checks were met. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create Static Device Nodes in /dev... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted FUSE Control File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted Kernel Configuration File System. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Flush Journal to Persistent Storage. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load/Save Random Seed. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Apply Kernel Variables. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Coldplug All udev Devices. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: First Boot Complete was skipped because of an unmet condition check (ConditionFirstBoot=yes). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Wait for udev To Complete Device Initialization... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com udevadm[1201]: systemd-udev-settle.service is deprecated. Please fix multipathd.service not to pull it in. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create Static Device Nodes in /dev. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Rule-based Manager for Device Events and Files... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-udevd[1202]: Using default interface naming scheme 'rhel-9.0'. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Rule-based Manager for Device Events and Files. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load Kernel Module configfs... Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: modprobe@configfs.service: Deactivated successfully. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load Kernel Module configfs. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: power_meter ACPI000D:00: Found ACPI power meter. Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: power_meter ACPI000D:00: Ignoring unsafe software power cap! Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi_cpufreq: overriding BIOS provided _PSD data Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: acpi-tad ACPI000E:00: Unsupported capabilities Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IPMI message handler: version 39.2 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi device interface Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:c2:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:c3:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:82:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:81:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:41:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:42:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:01:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ptdma 0000:02:00.2: enabling device (0140 -> 0142) Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si: IPMI System Interface driver Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si: Adding SMBIOS-specified kcs state machine Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si IPI0001:00: ipmi_platform: probing via ACPI Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2-0x0ca3] regsize 1 spacing 1 irq 0 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: input: PC Speaker as /devices/platform/pcspkr/input/input2 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: piix4_smbus 0000:00:14.0: Auxiliary SMBus Host Controller at 0xb20 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si: Adding ACPI-specified kcs state machine Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer Dec 29 12:47:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAPL PMU: hw unit of domain package 2^-16 Joules Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: MCE: In-kernel MCE decoding enabled. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x00b85c, prod_id: 0x2000, dev_id: 0x13) Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.1 bnxt_off: renamed from ens2f1np1 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.1 lom_2: renamed from eno6 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: intel_rapl_common: Found RAPL domain package Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: intel_rapl_common: Found RAPL domain core Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 bnxt_roce: renamed from ens2f0np0 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0 lom_1: renamed from eno5 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.2 lom_3: renamed from eno7 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Console: switching to colour dummy device 80x25 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: mgag200 0000:c1:00.1: vgaarb: deactivate vga console Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:c1:00.1 on minor 0 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: fbcon: mgag200drmfb (fb0) is primary device Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_si IPI0001:00: IPMI kcs interface initialized Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.3 lom_4: renamed from eno8 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Console: switching to colour frame buffer device 128x48 Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_ssif: IPMI SSIF Interface driver Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: mgag200 0000:c1:00.1: [drm] fb0: mgag200drmfb frame buffer device Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Condition check resulted in SD_MMC_MS_PRO EFI\x20System\x20Partition being skipped. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Condition check resulted in SD_MMC_MS_PRO 3 being skipped. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Found device SD_MMC_MS_PRO 5. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Condition check resulted in SD_MMC_MS_PRO 2 being skipped. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Condition check resulted in SD_MMC_MS_PRO 4 being skipped. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Activating swap /dev/disk/by-uuid/6d8fff54-40cf-4e53-9de5-58ff0ac08839... Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_re: Broadcom NetXtreme-C/E RoCE Driver Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Adding 12487676k swap on /dev/sda5. Priority:-2 extents:1 across:12487676k FS Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Activated swap /dev/disk/by-uuid/6d8fff54-40cf-4e53-9de5-58ff0ac08839. Dec 29 12:47:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Swaps. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: infiniband bnxt_re0: Device registered successfully Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice Slice /system/rdma-load-modules. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/rdma.conf... Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load RDMA modules from /etc/rdma/modules/roce.conf... Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting RDMA Node Description Daemon... Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load RDMA modules from /etc/rdma/modules/roce.conf. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: infiniband bnxt_re1: Device registered successfully Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_off speed is unknown, defaulting to 1000 Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started RDMA Node Description Daemon. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Loading iSCSI transport class v2.0-870. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1452]: Inserted module 'ib_iser' Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: iscsi: registered transport (iser) Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Rounding down aligned max_sectors from 4294967295 to 4294967288 Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: db_root: cannot open: /etc/target Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1452]: Inserted module 'ib_isert' Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1452]: Inserted module 'ib_srpt' Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1452]: Inserted module 'rdma_ucm' Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered named UNIX socket transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered udp transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered tcp transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered tcp NFSv4.1 backchannel transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-modules-load[1452]: Inserted module 'rpcrdma' Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered rdma transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RPC: Registered rdma backchannel transport module. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load RDMA modules from /etc/rdma/modules/rdma.conf. Dec 29 12:47:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target RDMA Hardware. Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Wait for udev To Complete Device Initialization. Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Device-Mapper Multipath Device Controller was skipped because of an unmet condition check (ConditionPathExists=/etc/multipath.conf). Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Preparation for Local File Systems. Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting /boot... Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting /mnt/rdma-xfs... Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda2): Mounting V5 Filesystem Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda4): Mounting V5 Filesystem Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting File System Check on /dev/disk/by-uuid/793E-AD23... Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting File System Check on /dev/disk/by-uuid/b72e2f18-7f65-4a8b-848c-8712f858595a... Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda4): Ending clean mount Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted /mnt/rdma-xfs. Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-fsck[1551]: fsck.fat 4.2 (2021-01-31) Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-fsck[1551]: /dev/sda1: 12 files, 1909/153290 clusters Dec 29 12:47:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished File System Check on /dev/disk/by-uuid/793E-AD23. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda2): Ending clean mount Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-fsck[1553]: /dev/sda3: clean, 11/1638400 files, 146893/6553600 blocks Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished File System Check on /dev/disk/by-uuid/b72e2f18-7f65-4a8b-848c-8712f858595a. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting /mnt/rdma-ext4... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted /boot. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting /boot/efi... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted /boot/efi. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: EXT4-fs (sda3): mounted filesystem with ordered data mode. Quota mode: none. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted /mnt/rdma-ext4. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Local File Systems. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Rebuild Dynamic Linker Cache was skipped because no trigger condition checks were met. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mark the need to relabel after reboot was skipped because of an unmet condition check (ConditionSecurity=!selinux). Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Set Up Additional Binary Formats was skipped because no trigger condition checks were met. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Store a System Token in an EFI Variable was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/LoaderFeatures-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Automatic Boot Loader Update... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Commit a transient machine-id on disk was skipped because of an unmet condition check (ConditionPathIsMountPoint=/etc/machine-id). Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Create Volatile Files and Directories... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Automatic Boot Loader Update. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Create Volatile Files and Directories. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting RPC Pipe File System... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Security Auditing Service... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting RPC Bind... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Rebuild Journal Catalog was skipped because of an unmet condition check (ConditionNeedsUpdate=/var). Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Update is Completed was skipped because no trigger condition checks were met. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted RPC Pipe File System. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target rpc_pipefs.target. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started RPC Bind. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com auditd[1573]: No plugins found, not dispatching events Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com auditd[1573]: Init complete, auditd 3.0.7 listening for events (startup state enable) Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1576]: /sbin/augenrules: No change Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: No rules Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: enabled 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: failure 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: pid 1573 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: rate_limit 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_limit 8192 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: lost 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog 3 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time 60000 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time_actual 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: enabled 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: failure 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: pid 1573 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: rate_limit 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_limit 8192 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: lost 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog 4 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time 60000 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time_actual 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: enabled 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: failure 1 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: pid 1573 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: rate_limit 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_limit 8192 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: lost 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog 4 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time 60000 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com augenrules[1586]: backlog_wait_time_actual 0 Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Security Auditing Service. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Record System Boot/Shutdown in UTMP... Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Record System Boot/Shutdown in UTMP. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target System Initialization. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started dnf makecache --timer. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Daily Cleanup of Temporary Directories. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on D-Bus System Message Bus Socket. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Open-iSCSI iscsid Socket. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Open-iSCSI iscsiuio Socket. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on SSSD Kerberos Cache Manager responder socket. Dec 29 12:47:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Socket Units. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting D-Bus System Message Bus... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: TPM2 PCR Barrier (Initialization) was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started D-Bus System Message Bus. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Basic System. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dbus-broker-lau[1594]: Ready Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Network Manager... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NTP client/server... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Restore /run/initramfs on shutdown... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started irqbalance daemon. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Low Memory Monitor was skipped because of an unmet condition check (ConditionPathExists=/proc/pressure). Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Software RAID monitoring and management was skipped because of an unmet condition check (ConditionPathExists=/etc/mdadm.conf). Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Load CPU microcode update... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Authorization Manager... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting System Logging Service... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH ecdsa Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH ed25519 Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH rsa Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target sshd-keygen.target. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: System Security Services Daemon was skipped because no trigger condition checks were met. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target User and Group Name Lookups. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting User Login Management... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Restore /run/initramfs on shutdown. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New seat seat0. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Watching system buttons on /dev/input/event1 (Power Button) Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Watching system buttons on /dev/input/event0 (Power Button) Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started User Login Management. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rsyslogd[1604]: [origin software="rsyslogd" swVersion="8.2102.0-106.el9" x-pid="1604" x-info="https://www.rsyslog.com"] start Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started System Logging Service. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Created slice User Slice of UID 0. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting User Runtime Directory /run/user/0... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rsyslogd[1604]: imjournal: journal files changed, reloading... [v8.2102.0-106.el9 try https://www.rsyslog.com/e/0 ] Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished User Runtime Directory /run/user/0. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting User Manager for UID 0... Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU10: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU11: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU9: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU13: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU20: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU14: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU15: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU19: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU12: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU18: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU23: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU22: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU16: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU17: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU21: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU3: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU4: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU5: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU2: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU7: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU0: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU1: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU6: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: CPU8: new patch_level=0x08301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: microcode: Reload completed, microcode revision: 0x8301055 Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: microcode.service: Deactivated successfully. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Load CPU microcode update. Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: chronyd version 4.3 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +NTS +SECHASH +IPV6 +DEBUG) Dec 29 12:47:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: Frequency 13.662 +/- 0.414 ppm read from /var/lib/chrony/drift Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: Using right/UTC timezone to obtain leap second data Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: Loaded seccomp filter (level 2) Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started NTP client/server. Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Wait for chrony to synchronize system clock... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com polkitd[1602]: Started polkitd version 0.117 Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.4288] NetworkManager (version 1.41.6-1.el9) is starting... (boot:ba1abb09-f2c0-4f11-87d2-8f10eb4f9cc3) Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.4292] Read config: /etc/NetworkManager/NetworkManager.conf (run: 15-carrier-timeout.conf) Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Network Manager. Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.4514] bus-manager: acquired D-Bus service "org.freedesktop.NetworkManager" Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Network. Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Network Manager Wait Online... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting GSSAPI Proxy Daemon... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.5109] manager[0x557c55233030]: monitoring kernel firmware directory '/lib/firmware'. Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting OpenSSH server daemon... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Dynamic System Tuning Daemon... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.9752] hostname: hostname: using hostnamed Dec 29 12:47:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336075.9753] hostname: static hostname changed from (none) to "rdma-qe-31.rdma.lab.eng.rdu2.redhat.com" Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.0100] dns-mgr: init: dns=default,systemd-resolved rc-manager=symlink (auto) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started GSSAPI Proxy Daemon. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: RPC security service for NFS client and server was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target NFS client services. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.1303] manager[0x557c55233030]: rfkill: Wi-Fi hardware radio set enabled Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.1304] manager[0x557c55233030]: rfkill: WWAN hardware radio set enabled Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[1682]: Server listening on 0.0.0.0 port 22. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[1682]: Server listening on :: port 22. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started OpenSSH server daemon. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3225] Loaded device plugin: NMTeamFactory (/usr/lib64/NetworkManager/1.41.6-1.el9/libnm-device-plugin-team.so) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3227] manager: rfkill: Wi-Fi enabled by radio killswitch; enabled by state file Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3228] manager: rfkill: WWAN enabled by radio killswitch; enabled by state file Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3229] manager: Networking is enabled by state file Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3407] settings: Loaded settings plugin: keyfile (internal) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Network Manager Script Dispatcher Service... Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Network Manager Script Dispatcher Service. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com polkitd[1602]: Loading rules from directory /etc/polkit-1/rules.d Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com polkitd[1602]: Loading rules from directory /usr/share/polkit-1/rules.d Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.3967] settings: Loaded settings plugin: ifcfg-rh ("/usr/lib64/NetworkManager/1.41.6-1.el9/libnm-settings-plugin-ifcfg-rh.so") Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4515] dhcp: init: Using DHCP client 'internal' Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4518] manager: (lo): new Loopback device (/org/freedesktop/NetworkManager/Devices/1) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4533] device (lo): state change: unmanaged -> unavailable (reason 'connection-assumed', sys-iface-state: 'external') Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4539] device (lo): state change: unavailable -> disconnected (reason 'connection-assumed', sys-iface-state: 'external') Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4547] device (lo): Activation: starting connection 'lo' (51d321e9-0e85-42d0-b159-80047b4e4712) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4558] manager: (bnxt_off): new Ethernet device (/org/freedesktop/NetworkManager/Devices/2) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.4562] device (bnxt_off): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com polkitd[1602]: Finished loading, compiling and executing 5 rules Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Authorization Manager. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com polkitd[1602]: Acquired the name org.freedesktop.PolicyKit1 on the system bus Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Queued start job for default target Main User Target. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Created slice User Application Slice. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Mark boot as successful after the user session has run 2 minutes was skipped because of an unmet condition check (ConditionUser=!@system). Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Started Daily Cleanup of User's Temporary Directories. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Reached target Paths. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Reached target Timers. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Starting D-Bus User Message Bus Socket... Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: PipeWire PulseAudio was skipped because of an unmet condition check (ConditionUser=!root). Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Listening on PipeWire Multimedia System Socket. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Starting Create User's Volatile Files and Directories... Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Listening on D-Bus User Message Bus Socket. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Reached target Sockets. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Finished Create User's Volatile Files and Directories. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Reached target Basic System. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Reached target Main User Target. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Startup finished in 1.610s. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started User Manager for UID 0. Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_off speed is unknown, defaulting to 1000 Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.8876] manager: (bnxt_roce): new Ethernet device (/org/freedesktop/NetworkManager/Devices/3) Dec 29 12:47:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336076.8880] device (bnxt_roce): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 bnxt_roce: NIC Link is Up, 25000 Mbps full duplex, Flow control: ON - receive & transmit Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 bnxt_roce: FEC autoneg off encoding: None Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.2823] manager: (bnxt_roce.43): new VLAN device (/org/freedesktop/NetworkManager/Devices/4) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 8021q: 802.1Q VLAN Support v1.8 Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3127] device (bnxt_roce.43): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3146] manager: (bnxt_roce.45): new VLAN device (/org/freedesktop/NetworkManager/Devices/5) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3165] device (bnxt_roce.45): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3195] manager: (lom_1): new Ethernet device (/org/freedesktop/NetworkManager/Devices/6) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3200] device (lom_1): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 8021q: adding VLAN 0 to HW filter on device lom_1 Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3695] manager: (lom_2): new Ethernet device (/org/freedesktop/NetworkManager/Devices/7) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.3699] device (lom_2): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 8021q: adding VLAN 0 to HW filter on device lom_2 Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.4194] manager: (lom_3): new Ethernet device (/org/freedesktop/NetworkManager/Devices/8) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.4199] device (lom_3): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 8021q: adding VLAN 0 to HW filter on device lom_3 Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.4694] manager: (lom_4): new Ethernet device (/org/freedesktop/NetworkManager/Devices/9) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.4699] device (lom_4): state change: unmanaged -> unavailable (reason 'managed', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 8021q: adding VLAN 0 to HW filter on device lom_4 Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5226] device (lo): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5230] device (lo): state change: prepare -> config (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5233] device (lo): state change: config -> ip-config (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5240] device (bnxt_roce): carrier: link connected Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5244] device (bnxt_roce.43): carrier: link connected Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5246] device (bnxt_roce.45): carrier: link connected Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5253] device (lo): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5263] device (bnxt_roce): state change: unavailable -> disconnected (reason 'carrier-changed', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5487] device (bnxt_roce.43): state change: unavailable -> disconnected (reason 'carrier-changed', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5646] device (bnxt_roce.45): state change: unavailable -> disconnected (reason 'carrier-changed', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5849] policy: auto-activating connection 'bnxt_roce' (62c53c79-c72d-5f4b-fae3-dd2e81c4b0a4) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5852] policy: auto-activating connection 'bnxt_roce.43' (e5c0fbcd-d76b-173c-8c4b-2f601c0f822a) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5854] policy: auto-activating connection 'bnxt_roce.45' (e6bb7c00-3847-98e1-acda-b777615e0062) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5857] device (lo): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5862] device (bnxt_roce): Activation: starting connection 'bnxt_roce' (62c53c79-c72d-5f4b-fae3-dd2e81c4b0a4) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5864] device (bnxt_roce.43): Activation: starting connection 'bnxt_roce.43' (e5c0fbcd-d76b-173c-8c4b-2f601c0f822a) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5866] device (bnxt_roce.45): Activation: starting connection 'bnxt_roce.45' (e6bb7c00-3847-98e1-acda-b777615e0062) Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5867] device (lo): state change: secondaries -> activated (reason 'none', sys-iface-state: 'external') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5873] device (lo): Activation: successful, device activated. Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5882] device (bnxt_roce): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5886] manager: NetworkManager state is now CONNECTING Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5887] device (bnxt_roce): state change: prepare -> config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5894] device (bnxt_roce.43): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5899] device (bnxt_roce.43): state change: prepare -> config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5903] device (bnxt_roce.45): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5908] device (bnxt_roce.45): state change: prepare -> config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336077.5912] device (bnxt_roce): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Dynamic System Tuning Daemon. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0464] dhcp4 (bnxt_roce): activation: beginning transaction (timeout in 45 seconds) Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0483] device (bnxt_roce.43): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0643] dhcp4 (bnxt_roce.43): activation: beginning transaction (timeout in 45 seconds) Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0656] device (bnxt_roce.45): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0883] dhcp4 (bnxt_roce.45): activation: beginning transaction (timeout in 45 seconds) Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0909] dhcp4 (bnxt_roce): state changed new lease, address=172.31.40.31 Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0912] dhcp4 (bnxt_roce.43): state changed new lease, address=172.31.43.31 Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.0915] dhcp4 (bnxt_roce.45): state changed new lease, address=172.31.45.31 Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1000] device (bnxt_roce): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1099] device (bnxt_roce.43): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1178] device (bnxt_roce.45): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1198] device (bnxt_roce): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1200] device (bnxt_roce.43): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1207] device (bnxt_roce): state change: secondaries -> activated (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1214] device (bnxt_roce): Activation: successful, device activated. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1223] device (bnxt_roce.43): state change: secondaries -> activated (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1230] device (bnxt_roce.43): Activation: successful, device activated. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1237] device (bnxt_roce.45): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1239] device (bnxt_roce.45): state change: secondaries -> activated (reason 'none', sys-iface-state: 'managed') Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1244] manager: NetworkManager state is now CONNECTED_LOCAL Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.1248] device (bnxt_roce.45): Activation: successful, device activated. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 bnxt_roce: Too many traffic classes requested: 8. Max supported is 2. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com nm-dispatcher[2102]: RTNETLINK answers: Invalid argument Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com nm-dispatcher[1698]: req:13 'up' [bnxt_roce.43], "/etc/NetworkManager/dispatcher.d/98-bnxt_roce.43-egress.conf": complete: failed with Script '/etc/NetworkManager/dispatcher.d/98-bnxt_roce.43-egress.conf' exited with status 2. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.4278] dispatcher: (13) /etc/NetworkManager/dispatcher.d/98-bnxt_roce.43-egress.conf failed (failed): Script '/etc/NetworkManager/dispatcher.d/98-bnxt_roce.43-egress.conf' exited with status 2. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com nm-dispatcher[2116]: RTNETLINK answers: Invalid argument Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: bnxt_en 0000:44:00.0 bnxt_roce: Too many traffic classes requested: 8. Max supported is 2. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com nm-dispatcher[1698]: req:14 'up' [bnxt_roce.45], "/etc/NetworkManager/dispatcher.d/98-bnxt_roce.45-egress.conf": complete: failed with Script '/etc/NetworkManager/dispatcher.d/98-bnxt_roce.45-egress.conf' exited with status 2. Dec 29 12:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336078.4729] dispatcher: (14) /etc/NetworkManager/dispatcher.d/98-bnxt_roce.45-egress.conf failed (failed): Script '/etc/NetworkManager/dispatcher.d/98-bnxt_roce.45-egress.conf' exited with status 2. Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: igb 0000:c5:00.0 lom_1: igb: lom_1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: IPv6: ADDRCONF(NETDEV_CHANGE): lom_1: link becomes ready Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8481] device (lom_1): carrier: link connected Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8484] device (lom_1): state change: unavailable -> disconnected (reason 'carrier-changed', sys-iface-state: 'managed') Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8588] policy: auto-activating connection 'lom_1' (1201ac7b-bee9-8c98-6172-199cca9d3b67) Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8593] device (lom_1): Activation: starting connection 'lom_1' (1201ac7b-bee9-8c98-6172-199cca9d3b67) Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8594] device (lom_1): state change: disconnected -> prepare (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8598] manager: NetworkManager state is now CONNECTING Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8600] device (lom_1): state change: prepare -> config (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8606] device (lom_1): state change: config -> ip-config (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336080.8763] dhcp4 (lom_1): activation: beginning transaction (timeout in 45 seconds) Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.2935] dhcp4 (lom_1): state changed new lease, address=10.1.217.81 Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.2940] policy: set 'lom_1' (lom_1) as default for IPv4 routing and DNS Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3091] device (lom_1): state change: ip-config -> ip-check (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3121] device (lom_1): state change: ip-check -> secondaries (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3123] device (lom_1): state change: secondaries -> activated (reason 'none', sys-iface-state: 'managed') Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3127] manager: NetworkManager state is now CONNECTED_SITE Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3131] device (lom_1): Activation: successful, device activated. Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336081.3137] manager: NetworkManager state is now CONNECTED_GLOBAL Dec 29 12:48:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: Could not add source 10.11.160.238 Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336083.5183] manager: startup complete Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Network Manager Wait Online. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Network is Online. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Anaconda Monitoring (anamon) post-boot notification program. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Login and scanning of iSCSI devices was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/var/lib/iscsi/nodes). Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Preparation for Remote File Systems. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Remote File Systems. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Crash recovery kernel arming... Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Notify NFS peers of a restart... Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: TPM2 PCR Barrier (User) was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Permit User Sessions... Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sm-notify[2197]: Version 2.5.4 starting Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Notify NFS peers of a restart. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Permit User Sessions. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Getty on tty1. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Serial Getty on ttyS0. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Login Prompts. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: anamon.service: Deactivated successfully. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: anamon.service: Unit process 2240 (anamon) remains running after unit stopped. Dec 29 12:48:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: anamon.service: Unit process 2245 (journalctl) remains running after unit stopped. Dec 29 12:48:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: WARNING! power/level is deprecated; use power/control instead Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PKCS7: Message signed outside of X.509 validity window Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kdumpctl[2200]: kdump: kexec: loaded kdump kernel Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kdumpctl[2200]: kdump: Starting kdump: [OK] Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Crash recovery kernel arming. Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: Selected source 10.11.160.238 Dec 29 12:48:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com chronyd[1657]: System clock TAI offset set to 37 seconds Dec 29 12:48:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Wait for chrony to synchronize system clock. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target System Time Synchronized. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Daily rotation of log files. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Timer Units. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Command Scheduler. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting The restraint harness.... Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com crond[2701]: (CRON) STARTUP (1.5.7) Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started The restraint harness.. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Multi-User System. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Record Runlevel Change in UTMP... Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com crond[2701]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 12% if used.) Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com crond[2701]: (CRON) INFO (running with inotify support) Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-update-utmp-runlevel.service: Deactivated successfully. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Record Runlevel Change in UTMP. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Startup finished in 1min 40.355s (firmware) + 8.999s (loader) + 2.273s (kernel) + 9.971s (initrd) + 30.875s (userspace) = 2min 32.476s. Dec 29 12:48:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: Listening on http://localhost:8081 Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: * Fetching recipe: http://lab-02.rhts.eng.rdu.redhat.com:8000//recipes/13158869/ Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: Ignoring Server Running state Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: * Parsing recipe Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: * Running recipe Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: ** Continuing task: 154371121 [/mnt/tests/github.com/beaker-project/beaker-core-tasks/archive/master.tar.gz/reservesys] Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: ** Preparing metadata Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: ** Refreshing peer role hostnames: Retries 0 Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: ** Updating env vars Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: *** Current Time: Thu Dec 29 12:48:18 2022 Localwatchdog at: * Disabled! * Dec 29 12:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com restraintd[2703]: ** Running task: 154371121 [/distribution/reservesys] Dec 29 12:48:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com unknown: Running test [R:13158869 T:154371121 - /distribution/reservesys - Kernel: 5.14.0-226.rt14.227.1773_734386590.el9.x86_64] Dec 29 12:48:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:49:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[2830]: Accepted publickey for root from 10.8.0.181 port 53376 ssh2: RSA SHA256:KxCuG8Dsw1ul66pG2cyRs5IdO3BAiD7LOITSP7nJGNk Dec 29 12:49:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 2 of user root. Dec 29 12:49:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 2 of User root. Dec 29 12:49:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[2830]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:49:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:49:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:49:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com unknown: Running test [R:13158869 T:6 - /kernel/kdump/setup-nfsdump - Kernel: 5.14.0-226.rt14.227.1773_734386590.el9.x86_64] Dec 29 12:49:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:49:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[3588]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:49:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: FS-Cache: Loaded Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type dns_resolver registered Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NFS: Registering the id_resolver key type Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type id_resolver registered Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Key type id_legacy registered Dec 29 12:49:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com nfsrahead[3616]: setting /var/crash readahead to 128 Dec 29 12:49:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3785]: dracut-057-13.git20220816.el9 Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Executing: /usr/bin/dracut --add kdumpbase --quiet --hostonly --hostonly-cmdline --hostonly-i18n --hostonly-mode strict --hostonly-nics -o "plymouth resume ifcfg earlykdump" --mount "kdump.usersys.redhat.com:/var/www/html/vmcore /kdumproot/var/crash nfs rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,timeo=600,retrans=2,sec=sys,local_lock=none" --squash-compressor zstd --no-hostonly-default-device -f /boot/initramfs-5.14.0-226.rt14.227.1773_734386590.el9.x86_64kdump.img 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-networkd' will not be installed, because command 'networkctl' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-networkd' will not be installed, because command '/usr/lib/systemd/systemd-networkd' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-networkd' will not be installed, because command '/usr/lib/systemd/systemd-networkd-wait-online' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-resolved' will not be installed, because command 'resolvectl' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-resolved' will not be installed, because command '/usr/lib/systemd/systemd-resolved' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-timesyncd' will not be installed, because command '/usr/lib/systemd/systemd-timesyncd' could not be found! Dec 29 12:49:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-timesyncd' will not be installed, because command '/usr/lib/systemd/systemd-time-wait-sync' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'dbus-daemon' will not be installed, because command 'dbus-daemon' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmand' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmanctl' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmand-wait-online' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'network-legacy' will not be installed, because command 'dhclient' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'network-wicked' will not be installed, because command 'wicked' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'ifcfg' will not be installed, because it's in the list to be omitted! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'plymouth' will not be installed, because it's in the list to be omitted! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: 62bluetooth: Could not find any command of '/usr/lib/bluetooth/bluetoothd /usr/libexec/bluetooth/bluetoothd'! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvmmerge' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvmthinpool-monitor' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvm' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'pcsc' will not be installed, because command 'pcscd' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'tpm2-tss' will not be installed, because command 'tpm2' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'cifs' will not be installed, because command 'mount.cifs' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'nvmf' will not be installed, because command 'nvme' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'resume' will not be installed, because it's in the list to be omitted! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'biosdevname' will not be installed, because command 'biosdevname' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'earlykdump' will not be installed, because it's in the list to be omitted! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'memstrack' will not be installed, because command 'memstrack' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: memstrack is not available Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: If you need to use rd.memdebug>=4, please install memstrack and procps-ng Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-resolved' will not be installed, because command 'resolvectl' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-resolved' will not be installed, because command '/usr/lib/systemd/systemd-resolved' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-timesyncd' will not be installed, because command '/usr/lib/systemd/systemd-timesyncd' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'systemd-timesyncd' will not be installed, because command '/usr/lib/systemd/systemd-time-wait-sync' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'busybox' will not be installed, because command 'busybox' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'dbus-daemon' will not be installed, because command 'dbus-daemon' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'rngd' will not be installed, because command 'rngd' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmand' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmanctl' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'connman' will not be installed, because command 'connmand-wait-online' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'network-legacy' will not be installed, because command 'dhclient' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'network-wicked' will not be installed, because command 'wicked' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: 62bluetooth: Could not find any command of '/usr/lib/bluetooth/bluetoothd /usr/libexec/bluetooth/bluetoothd'! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvmmerge' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvmthinpool-monitor' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'btrfs' will not be installed, because command 'btrfs' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'dmraid' will not be installed, because command 'dmraid' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'lvm' will not be installed, because command 'lvm' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'pcsc' will not be installed, because command 'pcscd' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'tpm2-tss' will not be installed, because command 'tpm2' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'cifs' will not be installed, because command 'mount.cifs' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'nvmf' will not be installed, because command 'nvme' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: dracut module 'memstrack' will not be installed, because command 'memstrack' could not be found! Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: memstrack is not available Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: If you need to use rd.memdebug>=4, please install memstrack and procps-ng Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: bash *** Dec 29 12:49:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: systemd *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: systemd-initrd *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: systemd-sysusers *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: nss-softokn *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: dbus-broker *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: dbus *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: i18n *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: network-manager *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: network *** Dec 29 12:49:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: drm *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: prefixdevname *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: kernel-modules *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: kernel-modules-extra *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: kernel-modules-extra: configuration source "/run/depmod.d" does not exist Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: kernel-modules-extra: configuration source "/lib/depmod.d" does not exist Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: kernel-modules-extra: parsing configuration file "/etc/depmod.d/dist.conf" Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: kernel-modules-extra: /etc/depmod.d/dist.conf: added "updates extra built-in weak-updates" to the list of search directories Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: kernel-network-modules *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: fstab-sys *** Dec 29 12:49:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: nfs *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: rootfs-block *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: terminfo *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: udev-rules *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Skipping udev rule: 91-permissions.rules Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Skipping udev rule: 80-drivers-modprobe.rules Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: dracut-systemd *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: usrmount *** Dec 29 12:49:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: base *** Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: fs-lib *** Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: kdumpbase *** Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.5617] audit: op="connection-add" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" pid=5775 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.6024] audit: op="connection-update" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" args="connection.timestamp" pid=5780 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Warning: There is another connection with the name 'lom_1'. Reference the connection by its uuid '0c4325e3-e46c-4889-b1a6-19f3df00f913' Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.6364] audit: op="connection-update" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" args="ipv6.method" pid=5787 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Warning: There is another connection with the name 'lom_1'. Reference the connection by its uuid '0c4325e3-e46c-4889-b1a6-19f3df00f913' Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.6715] audit: op="connection-update" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" args="connection.wait-device-timeout" pid=5794 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Warning: There is another connection with the name 'lom_1'. Reference the connection by its uuid '0c4325e3-e46c-4889-b1a6-19f3df00f913' Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.7450] audit: op="connection-update" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" pid=5809 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Warning: There is another connection with the name 'lom_1'. Reference the connection by its uuid '0c4325e3-e46c-4889-b1a6-19f3df00f913' Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.7791] audit: op="connection-update" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" args="connection.interface-name" pid=5816 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Warning: There is another connection with the name 'lom_1'. Reference the connection by its uuid '0c4325e3-e46c-4889-b1a6-19f3df00f913' Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336173.8522] audit: op="connection-delete" uuid="0c4325e3-e46c-4889-b1a6-19f3df00f913" name="lom_1" pid=5832 uid=0 result="success" Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Connection 'lom_1' (0c4325e3-e46c-4889-b1a6-19f3df00f913) successfully deleted. Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: microcode_ctl-fw_dir_override *** Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl module: mangling fw_dir Dec 29 12:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-2d-07"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-2d-07" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-4e-03"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-4e-03" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-4f-01"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-4f-01" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-55-04"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-55-04" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-5e-03"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-5e-03" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-8c-01"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-8c-01" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-8e-9e-0x-0xca"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-8e-9e-0x-0xca" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: processing data directory "/usr/share/microcode_ctl/ucode_with_caveats/intel-06-8e-9e-0x-dell"... Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: configuration "intel-06-8e-9e-0x-dell" is ignored Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: microcode_ctl: final fw_dir: "/lib/firmware/updates/5.14.0-226.rt14.227.1773_734386590.el9.x86_64 /lib/firmware/updates /lib/firmware/5.14.0-226.rt14.227.1773_734386590.el9.x86_64 /lib/firmware" Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: shutdown *** Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including module: squash *** Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Including modules done *** Dec 29 12:49:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Installing kernel module dependencies *** Dec 29 12:49:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Installing kernel module dependencies done *** Dec 29 12:49:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Resolving executable dependencies *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Resolving executable dependencies done *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Hardlinking files *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Mode: real Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Files: 525 Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Linked: 1 files Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Compared: 0 xattrs Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Compared: 10 files Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Saved: 55.97 KiB Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Duration: 0.016424 seconds Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Hardlinking files done *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Generating early-microcode cpio image *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Constructing AuthenticAMD.bin *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Store current command line parameters *** Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: Stored kernel commandline: Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: rd.neednet Dec 29 12:49:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: kdump_remote_ip=10.0.152.11 Dec 29 12:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Install squash loader *** Dec 29 12:49:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Stripping files *** Dec 29 12:49:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Stripping files done *** Dec 29 12:49:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Squashing the files inside the initramfs *** Dec 29 12:49:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Squashing the files inside the initramfs done *** Dec 29 12:49:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Creating image file '/boot/initramfs-5.14.0-226.rt14.227.1773_734386590.el9.x86_64kdump.img' *** Dec 29 12:49:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dracut[3787]: *** Creating initramfs image file '/boot/initramfs-5.14.0-226.rt14.227.1773_734386590.el9.x86_64kdump.img' done *** Dec 29 12:49:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: PKCS7: Message signed outside of X.509 validity window Dec 29 12:49:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:50:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:50:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:50:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:51:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:51:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:51:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com unknown: Running test [R:13158869 T:7 - RDMA Sanity Test - RoCE - Server - Kernel: 5.14.0-226.rt14.227.1773_734386590.el9.x86_64] Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping OpenSSH server daemon... Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[1682]: Received signal 15; terminating. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: sshd.service: Deactivated successfully. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped OpenSSH server daemon. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped target sshd-keygen.target. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping sshd-keygen.target... Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH ecdsa Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH ed25519 Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: OpenSSH rsa Server Key Generation was skipped because no trigger condition checks were met. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target sshd-keygen.target. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting OpenSSH server daemon... Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[11172]: Server listening on 0.0.0.0 port 22. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[11172]: Server listening on :: port 22. Dec 29 12:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started OpenSSH server daemon. Dec 29 12:51:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[15440]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:51:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Queuing reload/restart jobs for marked units… Dec 29 12:51:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:51:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[15590]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:51:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r27df467922c74970bb14e492f49801ab.service: Deactivated successfully. Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Starts the OpenSM InfiniBand fabric Subnet Manager... Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Starts the OpenSM InfiniBand fabric Subnet Manager. Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: ------------------------------------------------- Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: OpenSM 3.3.24 Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Command Line Arguments: Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Log File: /var/log/opensm.log Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: ------------------------------------------------- Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[15624]: /var/log/opensm.log log file opened Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: OpenSM 3.3.24 Dec 29 12:51:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[15624]: OpenSM 3.3.24 Dec 29 12:51:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Using default GUID 0x20af7fffe97b162 Dec 29 12:51:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Entering DISCOVERING state Dec 29 12:51:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[15624]: Entering DISCOVERING state Dec 29 12:51:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: ibwarn: [15624] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:51:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Error from osm_opensm_bind (0x2A) Dec 29 12:51:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Perhaps another instance of OpenSM is already running Dec 29 12:51:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[15624]: Exiting SM Dec 29 12:51:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[15624]: Exiting SM Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: ------------------------------------------------- Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: OpenSM 3.3.24 Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Command Line Arguments: Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Log File: /var/log/opensm.log Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: ------------------------------------------------- Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: OpenSM 3.3.24 Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[17463]: /var/log/opensm.log log file opened Dec 29 12:52:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[17463]: OpenSM 3.3.24 Dec 29 12:52:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Using default GUID 0x20af7fffe97b162 Dec 29 12:52:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Entering DISCOVERING state Dec 29 12:52:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[17463]: Entering DISCOVERING state Dec 29 12:52:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:52:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:52:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: ibwarn: [17463] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:52:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Error from osm_opensm_bind (0x2A) Dec 29 12:52:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Perhaps another instance of OpenSM is already running Dec 29 12:52:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[17463]: Exiting SM Dec 29 12:52:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[17463]: Exiting SM Dec 29 12:53:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: ------------------------------------------------- Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: OpenSM 3.3.24 Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Command Line Arguments: Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Log File: /var/log/opensm.log Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: ------------------------------------------------- Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: OpenSM 3.3.24 Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19542]: /var/log/opensm.log log file opened Dec 29 12:53:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19542]: OpenSM 3.3.24 Dec 29 12:53:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Using default GUID 0x20af7fffe97b162 Dec 29 12:53:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Entering DISCOVERING state Dec 29 12:53:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19542]: Entering DISCOVERING state Dec 29 12:53:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: ibwarn: [19542] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:53:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Error from osm_opensm_bind (0x2A) Dec 29 12:53:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Perhaps another instance of OpenSM is already running Dec 29 12:53:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19542]: Exiting SM Dec 29 12:53:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19542]: Exiting SM Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: ------------------------------------------------- Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: OpenSM 3.3.24 Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Command Line Arguments: Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Log File: /var/log/opensm.log Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: ------------------------------------------------- Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: OpenSM 3.3.24 Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19615]: /var/log/opensm.log log file opened Dec 29 12:53:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19615]: OpenSM 3.3.24 Dec 29 12:53:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Using default GUID 0x20af7fffe97b162 Dec 29 12:53:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Entering DISCOVERING state Dec 29 12:53:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19615]: Entering DISCOVERING state Dec 29 12:53:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Created slice User Background Tasks Slice. Dec 29 12:53:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Starting Cleanup of User's Temporary Files and Directories... Dec 29 12:53:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1655]: Finished Cleanup of User's Temporary Files and Directories. Dec 29 12:53:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: ibwarn: [19615] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:53:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Error from osm_opensm_bind (0x2A) Dec 29 12:53:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Perhaps another instance of OpenSM is already running Dec 29 12:53:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19615]: Exiting SM Dec 29 12:53:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19615]: Exiting SM Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: ------------------------------------------------- Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: OpenSM 3.3.24 Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Command Line Arguments: Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Log File: /var/log/opensm.log Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: ------------------------------------------------- Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: OpenSM 3.3.24 Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19688]: /var/log/opensm.log log file opened Dec 29 12:54:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19688]: OpenSM 3.3.24 Dec 29 12:54:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Using default GUID 0x20af7fffe97b162 Dec 29 12:54:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Entering DISCOVERING state Dec 29 12:54:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19688]: Entering DISCOVERING state Dec 29 12:54:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: ibwarn: [19688] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:54:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Error from osm_opensm_bind (0x2A) Dec 29 12:54:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Perhaps another instance of OpenSM is already running Dec 29 12:54:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19688]: Exiting SM Dec 29 12:54:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19688]: Exiting SM Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: ------------------------------------------------- Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: OpenSM 3.3.24 Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Command Line Arguments: Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Log File: /var/log/opensm.log Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: ------------------------------------------------- Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19760]: /var/log/opensm.log log file opened Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: OpenSM 3.3.24 Dec 29 12:54:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19760]: OpenSM 3.3.24 Dec 29 12:54:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Using default GUID 0x20af7fffe97b162 Dec 29 12:54:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Entering DISCOVERING state Dec 29 12:54:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19760]: Entering DISCOVERING state Dec 29 12:55:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: ibwarn: [19760] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:55:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Error from osm_opensm_bind (0x2A) Dec 29 12:55:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Perhaps another instance of OpenSM is already running Dec 29 12:55:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19760]: Exiting SM Dec 29 12:55:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19760]: Exiting SM Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: ------------------------------------------------- Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: OpenSM 3.3.24 Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Command Line Arguments: Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Log File: /var/log/opensm.log Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: ------------------------------------------------- Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: OpenSM 3.3.24 Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19831]: /var/log/opensm.log log file opened Dec 29 12:55:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19831]: OpenSM 3.3.24 Dec 29 12:55:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Using default GUID 0x20af7fffe97b162 Dec 29 12:55:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Entering DISCOVERING state Dec 29 12:55:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19831]: Entering DISCOVERING state Dec 29 12:55:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: ibwarn: [19831] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:55:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Error from osm_opensm_bind (0x2A) Dec 29 12:55:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Perhaps another instance of OpenSM is already running Dec 29 12:55:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19831]: Exiting SM Dec 29 12:55:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19831]: Exiting SM Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: ------------------------------------------------- Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: OpenSM 3.3.24 Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Command Line Arguments: Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Log File: /var/log/opensm.log Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: ------------------------------------------------- Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: OpenSM 3.3.24 Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19903]: /var/log/opensm.log log file opened Dec 29 12:56:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19903]: OpenSM 3.3.24 Dec 29 12:56:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Using default GUID 0x20af7fffe97b162 Dec 29 12:56:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Entering DISCOVERING state Dec 29 12:56:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19903]: Entering DISCOVERING state Dec 29 12:56:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: ibwarn: [19903] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:56:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Error from osm_opensm_bind (0x2A) Dec 29 12:56:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Perhaps another instance of OpenSM is already running Dec 29 12:56:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19903]: Exiting SM Dec 29 12:56:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19903]: Exiting SM Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: ------------------------------------------------- Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: OpenSM 3.3.24 Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Command Line Arguments: Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Log File: /var/log/opensm.log Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: ------------------------------------------------- Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: OpenSM 3.3.24 Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19975]: /var/log/opensm.log log file opened Dec 29 12:56:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19975]: OpenSM 3.3.24 Dec 29 12:56:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Using default GUID 0x20af7fffe97b162 Dec 29 12:56:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Entering DISCOVERING state Dec 29 12:56:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19975]: Entering DISCOVERING state Dec 29 12:56:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: ibwarn: [19975] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:56:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Error from osm_opensm_bind (0x2A) Dec 29 12:56:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Perhaps another instance of OpenSM is already running Dec 29 12:56:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[19975]: Exiting SM Dec 29 12:56:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[19975]: Exiting SM Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: ------------------------------------------------- Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: OpenSM 3.3.24 Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Command Line Arguments: Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Log File: /var/log/opensm.log Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: ------------------------------------------------- Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: OpenSM 3.3.24 Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20046]: /var/log/opensm.log log file opened Dec 29 12:57:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20046]: OpenSM 3.3.24 Dec 29 12:57:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Using default GUID 0x20af7fffe97b162 Dec 29 12:57:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Entering DISCOVERING state Dec 29 12:57:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20046]: Entering DISCOVERING state Dec 29 12:57:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: ibwarn: [20046] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:57:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Error from osm_opensm_bind (0x2A) Dec 29 12:57:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Perhaps another instance of OpenSM is already running Dec 29 12:57:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20046]: Exiting SM Dec 29 12:57:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20046]: Exiting SM Dec 29 12:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting SSSD Kerberos Cache Manager... Dec 29 12:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started SSSD Kerberos Cache Manager. Dec 29 12:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sssd_kcm[20124]: Starting up Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: ------------------------------------------------- Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: OpenSM 3.3.24 Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Command Line Arguments: Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Log File: /var/log/opensm.log Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: ------------------------------------------------- Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: OpenSM 3.3.24 Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20360]: /var/log/opensm.log log file opened Dec 29 12:57:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20360]: OpenSM 3.3.24 Dec 29 12:58:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Using default GUID 0x20af7fffe97b162 Dec 29 12:58:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Entering DISCOVERING state Dec 29 12:58:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20360]: Entering DISCOVERING state Dec 29 12:58:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: ibwarn: [20360] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:58:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Error from osm_opensm_bind (0x2A) Dec 29 12:58:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Perhaps another instance of OpenSM is already running Dec 29 12:58:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20360]: Exiting SM Dec 29 12:58:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20360]: Exiting SM Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20427]: Accepted publickey for root from 10.1.217.80 port 57270 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 3 of user root. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 3 of User root. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20427]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20430]: Received disconnect from 10.1.217.80 port 57270:11: disconnected by user Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20430]: Disconnected from user root 10.1.217.80 port 57270 Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20427]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-3.scope: Deactivated successfully. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 3 logged out. Waiting for processes to exit. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 3. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20462]: Accepted publickey for root from 10.1.217.80 port 57286 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 4 of user root. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 4 of User root. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20462]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20466]: Received disconnect from 10.1.217.80 port 57286:11: disconnected by user Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20466]: Disconnected from user root 10.1.217.80 port 57286 Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20462]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-4.scope: Deactivated successfully. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 4 logged out. Waiting for processes to exit. Dec 29 12:58:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 4. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20498]: Accepted publickey for root from 10.1.217.80 port 57290 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 5 of user root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 5 of User root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20498]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20501]: Received disconnect from 10.1.217.80 port 57290:11: disconnected by user Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20501]: Disconnected from user root 10.1.217.80 port 57290 Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20498]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 5 logged out. Waiting for processes to exit. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-5.scope: Deactivated successfully. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 5. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20534]: Accepted publickey for root from 10.1.217.80 port 57306 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 6 of user root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 6 of User root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20534]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20538]: Received disconnect from 10.1.217.80 port 57306:11: disconnected by user Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20538]: Disconnected from user root 10.1.217.80 port 57306 Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20534]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-6.scope: Deactivated successfully. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 6 logged out. Waiting for processes to exit. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 6. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20570]: Accepted publickey for root from 10.1.217.80 port 41074 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 7 of user root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 7 of User root. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20570]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20574]: Received disconnect from 10.1.217.80 port 41074:11: disconnected by user Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20574]: Disconnected from user root 10.1.217.80 port 41074 Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20570]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-7.scope: Deactivated successfully. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 7 logged out. Waiting for processes to exit. Dec 29 12:58:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 7. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20606]: Accepted publickey for root from 10.1.217.80 port 41084 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 8 of user root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 8 of User root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20606]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20609]: Received disconnect from 10.1.217.80 port 41084:11: disconnected by user Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20609]: Disconnected from user root 10.1.217.80 port 41084 Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20606]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 8 logged out. Waiting for processes to exit. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-8.scope: Deactivated successfully. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 8. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20643]: Accepted publickey for root from 10.1.217.80 port 41086 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 9 of user root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 9 of User root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20643]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20646]: Received disconnect from 10.1.217.80 port 41086:11: disconnected by user Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20646]: Disconnected from user root 10.1.217.80 port 41086 Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20643]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 9 logged out. Waiting for processes to exit. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-9.scope: Deactivated successfully. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 9. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20678]: Accepted publickey for root from 10.1.217.80 port 41090 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 10 of user root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 10 of User root. Dec 29 12:58:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20678]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20681]: Received disconnect from 10.1.217.80 port 41090:11: disconnected by user Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20681]: Disconnected from user root 10.1.217.80 port 41090 Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20678]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-10.scope: Deactivated successfully. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 10 logged out. Waiting for processes to exit. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 10. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20713]: Accepted publickey for root from 10.1.217.80 port 41098 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 11 of user root. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 11 of User root. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20713]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20717]: Received disconnect from 10.1.217.80 port 41098:11: disconnected by user Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20717]: Disconnected from user root 10.1.217.80 port 41098 Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[20713]: pam_unix(sshd:session): session closed for user root Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-11.scope: Deactivated successfully. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 11 logged out. Waiting for processes to exit. Dec 29 12:58:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 11. Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: ------------------------------------------------- Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: OpenSM 3.3.24 Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Command Line Arguments: Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Log File: /var/log/opensm.log Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: ------------------------------------------------- Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: OpenSM 3.3.24 Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20751]: /var/log/opensm.log log file opened Dec 29 12:58:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20751]: OpenSM 3.3.24 Dec 29 12:58:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Using default GUID 0x20af7fffe97b162 Dec 29 12:58:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Entering DISCOVERING state Dec 29 12:58:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20751]: Entering DISCOVERING state Dec 29 12:58:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: ibwarn: [20751] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:58:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Error from osm_opensm_bind (0x2A) Dec 29 12:58:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Perhaps another instance of OpenSM is already running Dec 29 12:58:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[20751]: Exiting SM Dec 29 12:58:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[20751]: Exiting SM Dec 29 12:58:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 12:58:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 12:59:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 12:59:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 12:59:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 12:59:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 12:59:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r949dd02991b94107b24b7f3e10b5518b.service: Deactivated successfully. Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: ------------------------------------------------- Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: OpenSM 3.3.24 Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Command Line Arguments: Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Log File: /var/log/opensm.log Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: ------------------------------------------------- Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: OpenSM 3.3.24 Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[30656]: /var/log/opensm.log log file opened Dec 29 12:59:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[30656]: OpenSM 3.3.24 Dec 29 12:59:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 12:59:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r068972a3cbef4ca4baf14cf380a0208e.service: Deactivated successfully. Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Using default GUID 0x20af7fffe97b162 Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Entering DISCOVERING state Dec 29 12:59:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[30656]: Entering DISCOVERING state Dec 29 12:59:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:59:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[31502]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:59:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:59:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: ibwarn: [30656] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:59:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Error from osm_opensm_bind (0x2A) Dec 29 12:59:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Perhaps another instance of OpenSM is already running Dec 29 12:59:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[30656]: Exiting SM Dec 29 12:59:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[30656]: Exiting SM Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[31572]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:59:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Queuing reload/restart jobs for marked units… Dec 29 12:59:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 12:59:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 12:59:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 12:59:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-rd5ca67013b9f457aa77dd6905c8baf29.service: Deactivated successfully. Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[31740]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 12:59:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Queuing reload/restart jobs for marked units… Dec 29 12:59:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 12:59:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 12:59:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r4f1c1d73adfc48828f4b28052e21e156.service: Deactivated successfully. Dec 29 12:59:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672336771.0602] manager: (bnxt_roce.81): new VLAN device (/org/freedesktop/NetworkManager/Devices/10) Dec 29 12:59:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Daemon that discovers and logs in to SRP target systems... Dec 29 12:59:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Daemon that discovers and logs in to SRP target systems. Dec 29 12:59:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: srp_daemon.service: Deactivated successfully. Dec 29 12:59:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped Daemon that discovers and logs in to SRP target systems. Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: ------------------------------------------------- Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: OpenSM 3.3.24 Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Command Line Arguments: Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Log File: /var/log/opensm.log Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: ------------------------------------------------- Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: OpenSM 3.3.24 Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[32410]: /var/log/opensm.log log file opened Dec 29 12:59:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[32410]: OpenSM 3.3.24 Dec 29 12:59:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Using default GUID 0x20af7fffe97b162 Dec 29 12:59:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Entering DISCOVERING state Dec 29 12:59:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[32410]: Entering DISCOVERING state Dec 29 12:59:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: ibwarn: [32410] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 12:59:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Error from osm_opensm_bind (0x2A) Dec 29 12:59:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Perhaps another instance of OpenSM is already running Dec 29 12:59:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[32410]: Exiting SM Dec 29 12:59:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[32410]: Exiting SM Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: ------------------------------------------------- Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: OpenSM 3.3.24 Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Command Line Arguments: Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Log File: /var/log/opensm.log Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: ------------------------------------------------- Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[34902]: /var/log/opensm.log log file opened Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: OpenSM 3.3.24 Dec 29 13:00:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[34902]: OpenSM 3.3.24 Dec 29 13:00:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Using default GUID 0x20af7fffe97b162 Dec 29 13:00:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Entering DISCOVERING state Dec 29 13:00:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[34902]: Entering DISCOVERING state Dec 29 13:00:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: ibwarn: [34902] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:00:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Error from osm_opensm_bind (0x2A) Dec 29 13:00:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Perhaps another instance of OpenSM is already running Dec 29 13:00:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[34902]: Exiting SM Dec 29 13:00:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[34902]: Exiting SM Dec 29 13:00:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 13:00:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 13:00:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 13:00:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 13:00:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r51cfada5bd5c4c37b79eed2844f88650.service: Deactivated successfully. Dec 29 13:00:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started /usr/bin/systemctl start man-db-cache-update. Dec 29 13:00:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting man-db-cache-update.service... Dec 29 13:00:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: man-db-cache-update.service: Deactivated successfully. Dec 29 13:00:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished man-db-cache-update.service. Dec 29 13:00:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-r6cfa8cbb780b4b128e4a35eccbbf5497.service: Deactivated successfully. Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading. Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-rc-local-generator[40304]: /etc/rc.d/rc.local is not marked executable, skipping. Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: /usr/lib/systemd/system/restraintd.service:8: Standard output type syslog+console is obsolete, automatically updating to journal+console. Please update your unit file, and consider removing the setting altogether. Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting dnf makecache... Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: Failed determining last makecache time. Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: BUILDROOT-C9S 925 kB/s | 3.8 kB 00:00 Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-AppStream 745 kB/s | 2.8 kB 00:00 Dec 29 13:00:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-AppStream-debuginfo 531 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-BaseOS 622 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-BaseOS-debuginfo 557 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-CRB 726 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-CRB-debuginfo 554 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-HighAvailability 799 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-HighAvailability-debuginfo 602 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-NFV 833 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-NFV-debuginfo 607 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-RT 828 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-RT-debuginfo 612 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-ResilientStorage 896 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-ResilientStorage-debuginfo 617 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-SAP 909 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-SAP-debuginfo 520 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-SAPHANA 944 kB/s | 2.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-SAPHANA-debuginfo 648 kB/s | 1.5 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-harness 33 kB/s | 1.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: beaker-tasks 33 kB/s | 1.3 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: CentOS Stream 9 - BaseOS 47 kB/s | 7.7 kB 00:00 Dec 29 13:00:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: CentOS Stream 9 - AppStream 22 kB/s | 7.8 kB 00:00 Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: CentOS Stream 9 - Extras packages 79 kB/s | 8.4 kB 00:00 Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: kernel-cki 57 kB/s | 3.0 kB 00:00 Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com dnf[40312]: Metadata cache created. Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dnf-makecache.service: Deactivated successfully. Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished dnf makecache. Dec 29 13:00:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: dnf-makecache.service: Consumed 1.386s CPU time. Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com CROND[40404]: (root) CMD (run-parts /etc/cron.hourly) Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com run-parts[40407]: (/etc/cron.hourly) starting 0anacron Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Anacron started on 2022-12-29 Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Will run job `cron.daily' in 29 min. Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Will run job `cron.weekly' in 49 min. Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Will run job `cron.monthly' in 69 min. Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Jobs will be executed sequentially Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com run-parts[40417]: (/etc/cron.hourly) finished 0anacron Dec 29 13:01:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com CROND[40403]: (root) CMDEND (run-parts /etc/cron.hourly) Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: ------------------------------------------------- Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: OpenSM 3.3.24 Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Command Line Arguments: Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Log File: /var/log/opensm.log Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: ------------------------------------------------- Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40418]: /var/log/opensm.log log file opened Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40418]: OpenSM 3.3.24 Dec 29 13:01:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: OpenSM 3.3.24 Dec 29 13:01:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Using default GUID 0x20af7fffe97b162 Dec 29 13:01:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Entering DISCOVERING state Dec 29 13:01:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40418]: Entering DISCOVERING state Dec 29 13:01:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: ibwarn: [40418] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:01:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Error from osm_opensm_bind (0x2A) Dec 29 13:01:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Perhaps another instance of OpenSM is already running Dec 29 13:01:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40418]: Exiting SM Dec 29 13:01:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40418]: Exiting SM Dec 29 13:01:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40717]: Accepted publickey for root from 172.31.40.30 port 55440 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:01:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 12 of user root. Dec 29 13:01:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 12 of User root. Dec 29 13:01:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40717]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: ------------------------------------------------- Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: OpenSM 3.3.24 Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Command Line Arguments: Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Log File: /var/log/opensm.log Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: ------------------------------------------------- Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: OpenSM 3.3.24 Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40761]: /var/log/opensm.log log file opened Dec 29 13:01:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40761]: OpenSM 3.3.24 Dec 29 13:01:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Using default GUID 0x20af7fffe97b162 Dec 29 13:01:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Entering DISCOVERING state Dec 29 13:01:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40761]: Entering DISCOVERING state Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40720]: Received disconnect from 172.31.40.30 port 55440:11: disconnected by user Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40720]: Disconnected from user root 172.31.40.30 port 55440 Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40717]: pam_unix(sshd:session): session closed for user root Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-12.scope: Deactivated successfully. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-12.scope: Consumed 11.490s CPU time. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 12 logged out. Waiting for processes to exit. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 12. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40820]: Accepted publickey for root from 172.31.40.30 port 55572 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 13 of user root. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 13 of User root. Dec 29 13:01:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40820]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:01:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: ibwarn: [40761] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:01:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Error from osm_opensm_bind (0x2A) Dec 29 13:01:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Perhaps another instance of OpenSM is already running Dec 29 13:01:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40761]: Exiting SM Dec 29 13:01:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40761]: Exiting SM Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40823]: Received disconnect from 172.31.40.30 port 55572:11: disconnected by user Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40823]: Disconnected from user root 172.31.40.30 port 55572 Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40820]: pam_unix(sshd:session): session closed for user root Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-13.scope: Deactivated successfully. Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-13.scope: Consumed 8.437s CPU time. Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 13 logged out. Waiting for processes to exit. Dec 29 13:01:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 13. Dec 29 13:01:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40869]: Accepted publickey for root from 172.31.40.30 port 42476 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:01:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 14 of user root. Dec 29 13:01:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 14 of User root. Dec 29 13:01:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40869]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40872]: Received disconnect from 172.31.40.30 port 42476:11: disconnected by user Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40872]: Disconnected from user root 172.31.40.30 port 42476 Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40869]: pam_unix(sshd:session): session closed for user root Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-14.scope: Deactivated successfully. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-14.scope: Consumed 9.538s CPU time. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 14 logged out. Waiting for processes to exit. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 14. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40919]: Accepted publickey for root from 172.31.40.30 port 45762 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 15 of user root. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 15 of User root. Dec 29 13:02:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40919]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: ------------------------------------------------- Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: OpenSM 3.3.24 Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Command Line Arguments: Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Log File: /var/log/opensm.log Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: ------------------------------------------------- Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: OpenSM 3.3.24 Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40967]: /var/log/opensm.log log file opened Dec 29 13:02:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40967]: OpenSM 3.3.24 Dec 29 13:02:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Using default GUID 0x20af7fffe97b162 Dec 29 13:02:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Entering DISCOVERING state Dec 29 13:02:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40967]: Entering DISCOVERING state Dec 29 13:02:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: ibwarn: [40967] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:02:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Error from osm_opensm_bind (0x2A) Dec 29 13:02:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Perhaps another instance of OpenSM is already running Dec 29 13:02:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[40967]: Exiting SM Dec 29 13:02:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[40967]: Exiting SM Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40922]: Received disconnect from 172.31.40.30 port 45762:11: disconnected by user Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40922]: Disconnected from user root 172.31.40.30 port 45762 Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[40919]: pam_unix(sshd:session): session closed for user root Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-15.scope: Deactivated successfully. Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-15.scope: Consumed 18.562s CPU time. Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 15 logged out. Waiting for processes to exit. Dec 29 13:02:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 15. Dec 29 13:02:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Cleanup of Temporary Directories... Dec 29 13:02:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. Dec 29 13:02:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished Cleanup of Temporary Directories. Dec 29 13:02:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully. Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: ------------------------------------------------- Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: OpenSM 3.3.24 Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Command Line Arguments: Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Log File: /var/log/opensm.log Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: ------------------------------------------------- Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: OpenSM 3.3.24 Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41098]: /var/log/opensm.log log file opened Dec 29 13:02:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41098]: OpenSM 3.3.24 Dec 29 13:02:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Using default GUID 0x20af7fffe97b162 Dec 29 13:02:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Entering DISCOVERING state Dec 29 13:02:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41098]: Entering DISCOVERING state Dec 29 13:03:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: ibwarn: [41098] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:03:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Error from osm_opensm_bind (0x2A) Dec 29 13:03:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Perhaps another instance of OpenSM is already running Dec 29 13:03:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41098]: Exiting SM Dec 29 13:03:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41098]: Exiting SM Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: ------------------------------------------------- Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: OpenSM 3.3.24 Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Command Line Arguments: Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Log File: /var/log/opensm.log Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: ------------------------------------------------- Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41169]: /var/log/opensm.log log file opened Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: OpenSM 3.3.24 Dec 29 13:03:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41169]: OpenSM 3.3.24 Dec 29 13:03:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Using default GUID 0x20af7fffe97b162 Dec 29 13:03:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Entering DISCOVERING state Dec 29 13:03:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41169]: Entering DISCOVERING state Dec 29 13:03:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: ibwarn: [41169] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:03:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Error from osm_opensm_bind (0x2A) Dec 29 13:03:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Perhaps another instance of OpenSM is already running Dec 29 13:03:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41169]: Exiting SM Dec 29 13:03:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41169]: Exiting SM Dec 29 13:03:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41292]: Accepted publickey for root from 172.31.40.30 port 37042 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 16 of user root. Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 16 of User root. Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41292]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41295]: Received disconnect from 172.31.40.30 port 37042:11: disconnected by user Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41295]: Disconnected from user root 172.31.40.30 port 37042 Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41292]: pam_unix(sshd:session): session closed for user root Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 16 logged out. Waiting for processes to exit. Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-16.scope: Deactivated successfully. Dec 29 13:03:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 16. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41588]: Accepted publickey for root from 172.31.40.31 port 42174 ssh2: RSA SHA256:LCYXNoe/HiiP7stjKn+g06rdAdw5eyj6ydzJmT/orhQ Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: New session 17 of user root. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Session 17 of User root. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41588]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41591]: Received disconnect from 172.31.40.31 port 42174:11: disconnected by user Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41591]: Disconnected from user root 172.31.40.31 port 42174 Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sshd[41588]: pam_unix(sshd:session): session closed for user root Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Session 17 logged out. Waiting for processes to exit. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: session-17.scope: Deactivated successfully. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd-logind[1607]: Removed session 17. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: mnt-rdma\x2dxfs.mount: Deactivated successfully. Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda4): Unmounting Filesystem Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: ------------------------------------------------- Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: OpenSM 3.3.24 Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Command Line Arguments: Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Log File: /var/log/opensm.log Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: ------------------------------------------------- Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: OpenSM 3.3.24 Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41634]: /var/log/opensm.log log file opened Dec 29 13:04:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41634]: OpenSM 3.3.24 Dec 29 13:04:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Using default GUID 0x20af7fffe97b162 Dec 29 13:04:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Entering DISCOVERING state Dec 29 13:04:09 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41634]: Entering DISCOVERING state Dec 29 13:04:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: ibwarn: [41634] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:04:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Error from osm_opensm_bind (0x2A) Dec 29 13:04:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Perhaps another instance of OpenSM is already running Dec 29 13:04:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41634]: Exiting SM Dec 29 13:04:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41634]: Exiting SM Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: ------------------------------------------------- Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: OpenSM 3.3.24 Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Command Line Arguments: Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Log File: /var/log/opensm.log Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: ------------------------------------------------- Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: OpenSM 3.3.24 Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41777]: /var/log/opensm.log log file opened Dec 29 13:04:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41777]: OpenSM 3.3.24 Dec 29 13:04:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Using default GUID 0x20af7fffe97b162 Dec 29 13:04:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Entering DISCOVERING state Dec 29 13:04:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41777]: Entering DISCOVERING state Dec 29 13:04:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: ibwarn: [41777] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:04:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Error from osm_opensm_bind (0x2A) Dec 29 13:04:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Perhaps another instance of OpenSM is already running Dec 29 13:04:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41777]: Exiting SM Dec 29 13:04:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41777]: Exiting SM Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda4): Mounting V5 Filesystem Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: XFS (sda4): Ending clean mount Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: ------------------------------------------------- Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: OpenSM 3.3.24 Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Command Line Arguments: Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Log File: /var/log/opensm.log Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: ------------------------------------------------- Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: OpenSM 3.3.24 Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41899]: /var/log/opensm.log log file opened Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41899]: OpenSM 3.3.24 Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reached target Host and Network Name Lookups. Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounting NFSD configuration filesystem... Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NFSv4 ID-name mapping service... Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: RPC security service for NFS client and server was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NFS status monitor for NFSv2/3 locking.... Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.idmapd[42011]: Setting log level to 0 Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.statd[42012]: Version 2.5.4 starting Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.statd[42012]: Flags: TI-RPC Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started NFSv4 ID-name mapping service. Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.statd[42012]: Initializing NSM state Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started NFS status monitor for NFSv2/3 locking.. Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Mounted NFSD configuration filesystem. Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NFS Mount Daemon... Dec 29 13:05:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NFSv4 Client Tracking Daemon... Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started NFSv4 Client Tracking Daemon. Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.mountd[42017]: Version 2.5.4 starting Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started NFS Mount Daemon. Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting NFS server and services... Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NFSD: Using nfsdcld client tracking operations. Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000) Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloading GSSAPI Proxy Daemon... Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Reloaded GSSAPI Proxy Daemon. Dec 29 13:05:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Finished NFS server and services. Dec 29 13:05:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Using default GUID 0x20af7fffe97b162 Dec 29 13:05:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Entering DISCOVERING state Dec 29 13:05:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41899]: Entering DISCOVERING state Dec 29 13:05:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: ibwarn: [41899] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:05:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Error from osm_opensm_bind (0x2A) Dec 29 13:05:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Perhaps another instance of OpenSM is already running Dec 29 13:05:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[41899]: Exiting SM Dec 29 13:05:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[41899]: Exiting SM Dec 29 13:05:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.mountd[42017]: authenticated mount request from 172.31.40.30:868 for /srv/nfs (/srv/nfs) Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: ------------------------------------------------- Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: OpenSM 3.3.24 Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Command Line Arguments: Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Log File: /var/log/opensm.log Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: ------------------------------------------------- Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: OpenSM 3.3.24 Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42109]: /var/log/opensm.log log file opened Dec 29 13:05:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42109]: OpenSM 3.3.24 Dec 29 13:05:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Using default GUID 0x20af7fffe97b162 Dec 29 13:05:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Entering DISCOVERING state Dec 29 13:05:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42109]: Entering DISCOVERING state Dec 29 13:06:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: ibwarn: [42109] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:06:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Error from osm_opensm_bind (0x2A) Dec 29 13:06:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Perhaps another instance of OpenSM is already running Dec 29 13:06:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42109]: Exiting SM Dec 29 13:06:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42109]: Exiting SM Dec 29 13:06:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.mountd[42017]: authenticated unmount request from 172.31.40.30:724 for /srv/nfs (/srv/nfs) Dec 29 13:06:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping NFS server and services... Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: ------------------------------------------------- Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: OpenSM 3.3.24 Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Command Line Arguments: Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Log File: /var/log/opensm.log Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: ------------------------------------------------- Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: OpenSM 3.3.24 Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42234]: /var/log/opensm.log log file opened Dec 29 13:06:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42234]: OpenSM 3.3.24 Dec 29 13:06:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Using default GUID 0x20af7fffe97b162 Dec 29 13:06:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Entering DISCOVERING state Dec 29 13:06:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42234]: Entering DISCOVERING state Dec 29 13:06:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: ibwarn: [42234] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:06:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Error from osm_opensm_bind (0x2A) Dec 29 13:06:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Perhaps another instance of OpenSM is already running Dec 29 13:06:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42234]: Exiting SM Dec 29 13:06:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42234]: Exiting SM Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: ------------------------------------------------- Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: OpenSM 3.3.24 Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Command Line Arguments: Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Log File: /var/log/opensm.log Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: ------------------------------------------------- Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: OpenSM 3.3.24 Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42305]: /var/log/opensm.log log file opened Dec 29 13:07:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42305]: OpenSM 3.3.24 Dec 29 13:07:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Using default GUID 0x20af7fffe97b162 Dec 29 13:07:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Entering DISCOVERING state Dec 29 13:07:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42305]: Entering DISCOVERING state Dec 29 13:07:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: ibwarn: [42305] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:07:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Error from osm_opensm_bind (0x2A) Dec 29 13:07:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Perhaps another instance of OpenSM is already running Dec 29 13:07:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42305]: Exiting SM Dec 29 13:07:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42305]: Exiting SM Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: ------------------------------------------------- Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: OpenSM 3.3.24 Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Command Line Arguments: Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Log File: /var/log/opensm.log Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: ------------------------------------------------- Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: OpenSM 3.3.24 Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42374]: /var/log/opensm.log log file opened Dec 29 13:07:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42374]: OpenSM 3.3.24 Dec 29 13:07:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Using default GUID 0x20af7fffe97b162 Dec 29 13:07:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Entering DISCOVERING state Dec 29 13:07:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42374]: Entering DISCOVERING state Dec 29 13:07:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: ibwarn: [42374] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:07:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Error from osm_opensm_bind (0x2A) Dec 29 13:07:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Perhaps another instance of OpenSM is already running Dec 29 13:07:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42374]: Exiting SM Dec 29 13:07:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42374]: Exiting SM Dec 29 13:08:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Stopping timed out. Terminating. Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: ------------------------------------------------- Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: OpenSM 3.3.24 Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Command Line Arguments: Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Log File: /var/log/opensm.log Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: ------------------------------------------------- Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: OpenSM 3.3.24 Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42445]: /var/log/opensm.log log file opened Dec 29 13:08:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42445]: OpenSM 3.3.24 Dec 29 13:08:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Using default GUID 0x20af7fffe97b162 Dec 29 13:08:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Entering DISCOVERING state Dec 29 13:08:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42445]: Entering DISCOVERING state Dec 29 13:08:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: ibwarn: [42445] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:08:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Error from osm_opensm_bind (0x2A) Dec 29 13:08:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Perhaps another instance of OpenSM is already running Dec 29 13:08:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42445]: Exiting SM Dec 29 13:08:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42445]: Exiting SM Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: ------------------------------------------------- Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: OpenSM 3.3.24 Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Command Line Arguments: Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Log File: /var/log/opensm.log Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: ------------------------------------------------- Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: OpenSM 3.3.24 Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42514]: /var/log/opensm.log log file opened Dec 29 13:09:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42514]: OpenSM 3.3.24 Dec 29 13:09:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Using default GUID 0x20af7fffe97b162 Dec 29 13:09:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Entering DISCOVERING state Dec 29 13:09:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42514]: Entering DISCOVERING state Dec 29 13:09:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: ibwarn: [42514] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:09:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Error from osm_opensm_bind (0x2A) Dec 29 13:09:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Perhaps another instance of OpenSM is already running Dec 29 13:09:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42514]: Exiting SM Dec 29 13:09:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42514]: Exiting SM Dec 29 13:09:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: State 'stop-sigterm' timed out. Killing. Dec 29 13:09:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Killing process 42233 (rpc.nfsd) with signal SIGKILL. Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: ------------------------------------------------- Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: OpenSM 3.3.24 Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Command Line Arguments: Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Log File: /var/log/opensm.log Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: ------------------------------------------------- Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42583]: /var/log/opensm.log log file opened Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: OpenSM 3.3.24 Dec 29 13:09:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42583]: OpenSM 3.3.24 Dec 29 13:09:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Using default GUID 0x20af7fffe97b162 Dec 29 13:09:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Entering DISCOVERING state Dec 29 13:09:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42583]: Entering DISCOVERING state Dec 29 13:09:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: ibwarn: [42583] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:09:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Error from osm_opensm_bind (0x2A) Dec 29 13:09:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Perhaps another instance of OpenSM is already running Dec 29 13:09:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42583]: Exiting SM Dec 29 13:09:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42583]: Exiting SM Dec 29 13:10:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com sssd_kcm[20124]: Shutting down (status = 0) Dec 29 13:10:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: sssd-kcm.service: Deactivated successfully. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42024 blocked for more than 122 seconds. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42024 ppid: 2 flags:0x00004000 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42027 blocked for more than 122 seconds. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42027 ppid: 2 flags:0x00004000 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42029 blocked for more than 123 seconds. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42029 ppid: 2 flags:0x00004000 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42030 blocked for more than 123 seconds. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42030 ppid: 2 flags:0x00004000 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task rpc.nfsd:42233 blocked for more than 123 seconds. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpc.nfsd state:D stack: 0 pid:42233 ppid: 1 flags:0x00000006 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread_stop+0x62/0x1d0 Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_set_num_threads+0x10d/0x200 [sunrpc] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd_svc+0x123/0x190 [nfsd] Dec 29 13:10:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_threads+0x95/0x100 [nfsd] Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? simple_transaction_get+0xc4/0xf0 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? write_pool_threads+0x230/0x230 [nfsd] Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsctl_transaction_write+0x46/0x80 [nfsd] Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fbc26a37be7 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe615eb898 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fbc26a37be7 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000002 RSI: 000055b890ce8c20 RDI: 0000000000000003 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: 00007ffe615eb730 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055b890ce8c20 Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fbc268f66c0 R14: 00007ffe615eb960 R15: 00000000ffffffff Dec 29 13:10:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: ------------------------------------------------- Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: OpenSM 3.3.24 Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Command Line Arguments: Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Log File: /var/log/opensm.log Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: ------------------------------------------------- Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: OpenSM 3.3.24 Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42655]: /var/log/opensm.log log file opened Dec 29 13:10:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42655]: OpenSM 3.3.24 Dec 29 13:10:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Using default GUID 0x20af7fffe97b162 Dec 29 13:10:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Entering DISCOVERING state Dec 29 13:10:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42655]: Entering DISCOVERING state Dec 29 13:10:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: ibwarn: [42655] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:10:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Error from osm_opensm_bind (0x2A) Dec 29 13:10:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Perhaps another instance of OpenSM is already running Dec 29 13:10:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42655]: Exiting SM Dec 29 13:10:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42655]: Exiting SM Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: ------------------------------------------------- Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: OpenSM 3.3.24 Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Command Line Arguments: Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Log File: /var/log/opensm.log Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: ------------------------------------------------- Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: OpenSM 3.3.24 Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42724]: /var/log/opensm.log log file opened Dec 29 13:10:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42724]: OpenSM 3.3.24 Dec 29 13:10:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Using default GUID 0x20af7fffe97b162 Dec 29 13:10:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Entering DISCOVERING state Dec 29 13:10:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42724]: Entering DISCOVERING state Dec 29 13:10:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: ibwarn: [42724] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:10:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Error from osm_opensm_bind (0x2A) Dec 29 13:10:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Perhaps another instance of OpenSM is already running Dec 29 13:10:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42724]: Exiting SM Dec 29 13:10:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42724]: Exiting SM Dec 29 13:11:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Processes still around after SIGKILL. Ignoring. Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: ------------------------------------------------- Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: OpenSM 3.3.24 Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Command Line Arguments: Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Log File: /var/log/opensm.log Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: ------------------------------------------------- Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: OpenSM 3.3.24 Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42794]: /var/log/opensm.log log file opened Dec 29 13:11:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42794]: OpenSM 3.3.24 Dec 29 13:11:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Using default GUID 0x20af7fffe97b162 Dec 29 13:11:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Entering DISCOVERING state Dec 29 13:11:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42794]: Entering DISCOVERING state Dec 29 13:11:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: ibwarn: [42794] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:11:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Error from osm_opensm_bind (0x2A) Dec 29 13:11:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Perhaps another instance of OpenSM is already running Dec 29 13:11:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42794]: Exiting SM Dec 29 13:11:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42794]: Exiting SM Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: ------------------------------------------------- Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: OpenSM 3.3.24 Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Command Line Arguments: Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Log File: /var/log/opensm.log Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: ------------------------------------------------- Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: OpenSM 3.3.24 Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42866]: /var/log/opensm.log log file opened Dec 29 13:12:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42866]: OpenSM 3.3.24 Dec 29 13:12:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Using default GUID 0x20af7fffe97b162 Dec 29 13:12:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Entering DISCOVERING state Dec 29 13:12:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42866]: Entering DISCOVERING state Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42024 blocked for more than 245 seconds. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42024 ppid: 2 flags:0x00004000 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42027 blocked for more than 245 seconds. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42027 ppid: 2 flags:0x00004000 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42029 blocked for more than 245 seconds. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42029 ppid: 2 flags:0x00004000 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task nfsd:42030 blocked for more than 246 seconds. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42030 ppid: 2 flags:0x00004000 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: INFO: task rpc.nfsd:42233 blocked for more than 246 seconds. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Not tainted 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpc.nfsd state:D stack: 0 pid:42233 ppid: 1 flags:0x00000006 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread_stop+0x62/0x1d0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_set_num_threads+0x10d/0x200 [sunrpc] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd_svc+0x123/0x190 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_threads+0x95/0x100 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? simple_transaction_get+0xc4/0xf0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? write_pool_threads+0x230/0x230 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsctl_transaction_write+0x46/0x80 [nfsd] Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fbc26a37be7 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe615eb898 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fbc26a37be7 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000002 RSI: 000055b890ce8c20 RDI: 0000000000000003 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: 00007ffe615eb730 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055b890ce8c20 Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fbc268f66c0 R14: 00007ffe615eb960 R15: 00000000ffffffff Dec 29 13:12:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:12:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: ibwarn: [42866] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:12:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Error from osm_opensm_bind (0x2A) Dec 29 13:12:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Perhaps another instance of OpenSM is already running Dec 29 13:12:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42866]: Exiting SM Dec 29 13:12:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42866]: Exiting SM Dec 29 13:12:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: State 'stop-post' timed out. Terminating. Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: ------------------------------------------------- Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: OpenSM 3.3.24 Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Command Line Arguments: Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Log File: /var/log/opensm.log Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: ------------------------------------------------- Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: OpenSM 3.3.24 Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42935]: /var/log/opensm.log log file opened Dec 29 13:12:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42935]: OpenSM 3.3.24 Dec 29 13:12:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Using default GUID 0x20af7fffe97b162 Dec 29 13:12:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Entering DISCOVERING state Dec 29 13:12:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42935]: Entering DISCOVERING state Dec 29 13:12:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: ibwarn: [42935] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:12:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Error from osm_opensm_bind (0x2A) Dec 29 13:12:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Perhaps another instance of OpenSM is already running Dec 29 13:12:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[42935]: Exiting SM Dec 29 13:12:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[42935]: Exiting SM Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: ------------------------------------------------- Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: OpenSM 3.3.24 Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Command Line Arguments: Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Log File: /var/log/opensm.log Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: ------------------------------------------------- Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: OpenSM 3.3.24 Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43004]: /var/log/opensm.log log file opened Dec 29 13:13:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43004]: OpenSM 3.3.24 Dec 29 13:13:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Using default GUID 0x20af7fffe97b162 Dec 29 13:13:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Entering DISCOVERING state Dec 29 13:13:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43004]: Entering DISCOVERING state Dec 29 13:13:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: ibwarn: [43004] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:13:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Error from osm_opensm_bind (0x2A) Dec 29 13:13:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Perhaps another instance of OpenSM is already running Dec 29 13:13:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43004]: Exiting SM Dec 29 13:13:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43004]: Exiting SM Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: ------------------------------------------------- Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: OpenSM 3.3.24 Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Command Line Arguments: Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Log File: /var/log/opensm.log Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: ------------------------------------------------- Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: OpenSM 3.3.24 Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43076]: /var/log/opensm.log log file opened Dec 29 13:13:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43076]: OpenSM 3.3.24 Dec 29 13:13:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Using default GUID 0x20af7fffe97b162 Dec 29 13:13:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Entering DISCOVERING state Dec 29 13:13:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43076]: Entering DISCOVERING state Dec 29 13:14:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: State 'final-sigterm' timed out. Killing. Dec 29 13:14:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Killing process 42783 (exportfs) with signal SIGKILL. Dec 29 13:14:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Killing process 42233 (rpc.nfsd) with signal SIGKILL. Dec 29 13:14:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: ibwarn: [43076] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:14:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Error from osm_opensm_bind (0x2A) Dec 29 13:14:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Perhaps another instance of OpenSM is already running Dec 29 13:14:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43076]: Exiting SM Dec 29 13:14:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43076]: Exiting SM Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: ------------------------------------------------- Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: OpenSM 3.3.24 Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Command Line Arguments: Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Log File: /var/log/opensm.log Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: ------------------------------------------------- Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: OpenSM 3.3.24 Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43145]: /var/log/opensm.log log file opened Dec 29 13:14:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43145]: OpenSM 3.3.24 Dec 29 13:14:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Using default GUID 0x20af7fffe97b162 Dec 29 13:14:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Entering DISCOVERING state Dec 29 13:14:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43145]: Entering DISCOVERING state Dec 29 13:14:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: ibwarn: [43145] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:14:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Error from osm_opensm_bind (0x2A) Dec 29 13:14:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Perhaps another instance of OpenSM is already running Dec 29 13:14:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43145]: Exiting SM Dec 29 13:14:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43145]: Exiting SM Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: ------------------------------------------------- Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: OpenSM 3.3.24 Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Command Line Arguments: Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Log File: /var/log/opensm.log Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: ------------------------------------------------- Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: OpenSM 3.3.24 Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43214]: /var/log/opensm.log log file opened Dec 29 13:15:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43214]: OpenSM 3.3.24 Dec 29 13:15:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Using default GUID 0x20af7fffe97b162 Dec 29 13:15:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Entering DISCOVERING state Dec 29 13:15:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43214]: Entering DISCOVERING state Dec 29 13:15:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: ibwarn: [43214] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:15:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Error from osm_opensm_bind (0x2A) Dec 29 13:15:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Perhaps another instance of OpenSM is already running Dec 29 13:15:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43214]: Exiting SM Dec 29 13:15:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43214]: Exiting SM Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Processes still around after final SIGKILL. Entering failed mode. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Failed with result 'timeout'. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Unit process 42233 (rpc.nfsd) remains running after unit stopped. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-server.service: Unit process 42783 (exportfs) remains running after unit stopped. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped NFS server and services. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.idmapd[42011]: exiting on signal 15 Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping NFSv4 ID-name mapping service... Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopping NFS Mount Daemon... Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com rpc.mountd[42017]: Caught signal 15, un-registering and exiting. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-idmapd.service: Deactivated successfully. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped NFSv4 ID-name mapping service. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: nfs-mountd.service: Deactivated successfully. Dec 29 13:15:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Stopped NFS Mount Daemon. Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: ------------------------------------------------- Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: OpenSM 3.3.24 Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Command Line Arguments: Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Log File: /var/log/opensm.log Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: ------------------------------------------------- Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: OpenSM 3.3.24 Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43332]: /var/log/opensm.log log file opened Dec 29 13:15:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43332]: OpenSM 3.3.24 Dec 29 13:15:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Using default GUID 0x20af7fffe97b162 Dec 29 13:15:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Entering DISCOVERING state Dec 29 13:15:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43332]: Entering DISCOVERING state Dec 29 13:15:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: ibwarn: [43332] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:15:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Error from osm_opensm_bind (0x2A) Dec 29 13:15:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Perhaps another instance of OpenSM is already running Dec 29 13:15:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43332]: Exiting SM Dec 29 13:15:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43332]: Exiting SM Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: ------------------------------------------------- Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: OpenSM 3.3.24 Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Command Line Arguments: Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Log File: /var/log/opensm.log Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: ------------------------------------------------- Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: OpenSM 3.3.24 Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43401]: /var/log/opensm.log log file opened Dec 29 13:16:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43401]: OpenSM 3.3.24 Dec 29 13:16:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Using default GUID 0x20af7fffe97b162 Dec 29 13:16:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Entering DISCOVERING state Dec 29 13:16:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43401]: Entering DISCOVERING state Dec 29 13:16:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: ibwarn: [43401] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:16:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Error from osm_opensm_bind (0x2A) Dec 29 13:16:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Perhaps another instance of OpenSM is already running Dec 29 13:16:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43401]: Exiting SM Dec 29 13:16:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43401]: Exiting SM Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: ------------------------------------------------- Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: OpenSM 3.3.24 Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Command Line Arguments: Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Log File: /var/log/opensm.log Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: ------------------------------------------------- Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43472]: /var/log/opensm.log log file opened Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: OpenSM 3.3.24 Dec 29 13:17:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43472]: OpenSM 3.3.24 Dec 29 13:17:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Using default GUID 0x20af7fffe97b162 Dec 29 13:17:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Entering DISCOVERING state Dec 29 13:17:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43472]: Entering DISCOVERING state Dec 29 13:17:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: ibwarn: [43472] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:17:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Error from osm_opensm_bind (0x2A) Dec 29 13:17:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Perhaps another instance of OpenSM is already running Dec 29 13:17:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43472]: Exiting SM Dec 29 13:17:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43472]: Exiting SM Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: ------------------------------------------------- Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: OpenSM 3.3.24 Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Command Line Arguments: Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Log File: /var/log/opensm.log Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: ------------------------------------------------- Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: OpenSM 3.3.24 Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43542]: /var/log/opensm.log log file opened Dec 29 13:17:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43542]: OpenSM 3.3.24 Dec 29 13:17:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Using default GUID 0x20af7fffe97b162 Dec 29 13:17:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Entering DISCOVERING state Dec 29 13:17:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43542]: Entering DISCOVERING state Dec 29 13:17:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: ibwarn: [43542] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:17:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Error from osm_opensm_bind (0x2A) Dec 29 13:17:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Perhaps another instance of OpenSM is already running Dec 29 13:17:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43542]: Exiting SM Dec 29 13:17:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43542]: Exiting SM Dec 29 13:17:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672337878.1079] dhcp4 (bnxt_roce): state changed new lease, address=172.31.40.31 Dec 29 13:17:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672337878.1343] dhcp4 (bnxt_roce.43): state changed new lease, address=172.31.43.31 Dec 29 13:17:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672337878.1607] dhcp4 (bnxt_roce.45): state changed new lease, address=172.31.45.31 Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: ------------------------------------------------- Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: OpenSM 3.3.24 Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Command Line Arguments: Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Log File: /var/log/opensm.log Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: ------------------------------------------------- Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: OpenSM 3.3.24 Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43611]: /var/log/opensm.log log file opened Dec 29 13:18:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43611]: OpenSM 3.3.24 Dec 29 13:18:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Using default GUID 0x20af7fffe97b162 Dec 29 13:18:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Entering DISCOVERING state Dec 29 13:18:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43611]: Entering DISCOVERING state Dec 29 13:18:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: ibwarn: [43611] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:18:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Error from osm_opensm_bind (0x2A) Dec 29 13:18:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Perhaps another instance of OpenSM is already running Dec 29 13:18:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43611]: Exiting SM Dec 29 13:18:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43611]: Exiting SM Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: ------------------------------------------------- Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: OpenSM 3.3.24 Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Command Line Arguments: Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Log File: /var/log/opensm.log Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: ------------------------------------------------- Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: OpenSM 3.3.24 Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43680]: /var/log/opensm.log log file opened Dec 29 13:18:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43680]: OpenSM 3.3.24 Dec 29 13:18:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Using default GUID 0x20af7fffe97b162 Dec 29 13:18:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Entering DISCOVERING state Dec 29 13:18:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43680]: Entering DISCOVERING state Dec 29 13:18:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: ibwarn: [43680] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:18:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Error from osm_opensm_bind (0x2A) Dec 29 13:18:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Perhaps another instance of OpenSM is already running Dec 29 13:18:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43680]: Exiting SM Dec 29 13:18:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43680]: Exiting SM Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: ------------------------------------------------- Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: OpenSM 3.3.24 Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Command Line Arguments: Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Log File: /var/log/opensm.log Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: ------------------------------------------------- Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: OpenSM 3.3.24 Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43749]: /var/log/opensm.log log file opened Dec 29 13:19:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43749]: OpenSM 3.3.24 Dec 29 13:19:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Using default GUID 0x20af7fffe97b162 Dec 29 13:19:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Entering DISCOVERING state Dec 29 13:19:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43749]: Entering DISCOVERING state Dec 29 13:19:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: ibwarn: [43749] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:19:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Error from osm_opensm_bind (0x2A) Dec 29 13:19:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Perhaps another instance of OpenSM is already running Dec 29 13:19:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43749]: Exiting SM Dec 29 13:19:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43749]: Exiting SM Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: ------------------------------------------------- Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: OpenSM 3.3.24 Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Command Line Arguments: Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Log File: /var/log/opensm.log Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: ------------------------------------------------- Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: OpenSM 3.3.24 Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43820]: /var/log/opensm.log log file opened Dec 29 13:20:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43820]: OpenSM 3.3.24 Dec 29 13:20:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Using default GUID 0x20af7fffe97b162 Dec 29 13:20:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Entering DISCOVERING state Dec 29 13:20:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43820]: Entering DISCOVERING state Dec 29 13:20:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: ibwarn: [43820] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:20:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Error from osm_opensm_bind (0x2A) Dec 29 13:20:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Perhaps another instance of OpenSM is already running Dec 29 13:20:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43820]: Exiting SM Dec 29 13:20:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43820]: Exiting SM Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: ------------------------------------------------- Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: OpenSM 3.3.24 Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Command Line Arguments: Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Log File: /var/log/opensm.log Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: ------------------------------------------------- Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: OpenSM 3.3.24 Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43889]: /var/log/opensm.log log file opened Dec 29 13:20:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43889]: OpenSM 3.3.24 Dec 29 13:20:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Using default GUID 0x20af7fffe97b162 Dec 29 13:20:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Entering DISCOVERING state Dec 29 13:20:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43889]: Entering DISCOVERING state Dec 29 13:20:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: ibwarn: [43889] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:20:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Error from osm_opensm_bind (0x2A) Dec 29 13:20:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Perhaps another instance of OpenSM is already running Dec 29 13:20:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43889]: Exiting SM Dec 29 13:20:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43889]: Exiting SM Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: ------------------------------------------------- Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: OpenSM 3.3.24 Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Command Line Arguments: Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Log File: /var/log/opensm.log Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: ------------------------------------------------- Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: OpenSM 3.3.24 Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43958]: /var/log/opensm.log log file opened Dec 29 13:21:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43958]: OpenSM 3.3.24 Dec 29 13:21:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Using default GUID 0x20af7fffe97b162 Dec 29 13:21:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Entering DISCOVERING state Dec 29 13:21:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43958]: Entering DISCOVERING state Dec 29 13:21:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: ibwarn: [43958] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:21:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Error from osm_opensm_bind (0x2A) Dec 29 13:21:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Perhaps another instance of OpenSM is already running Dec 29 13:21:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[43958]: Exiting SM Dec 29 13:21:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[43958]: Exiting SM Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: ------------------------------------------------- Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: OpenSM 3.3.24 Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Command Line Arguments: Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Log File: /var/log/opensm.log Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: ------------------------------------------------- Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: OpenSM 3.3.24 Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44029]: /var/log/opensm.log log file opened Dec 29 13:21:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44029]: OpenSM 3.3.24 Dec 29 13:21:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Using default GUID 0x20af7fffe97b162 Dec 29 13:21:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Entering DISCOVERING state Dec 29 13:21:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44029]: Entering DISCOVERING state Dec 29 13:21:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: ibwarn: [44029] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:21:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Error from osm_opensm_bind (0x2A) Dec 29 13:21:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Perhaps another instance of OpenSM is already running Dec 29 13:21:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44029]: Exiting SM Dec 29 13:21:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44029]: Exiting SM Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: ------------------------------------------------- Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: OpenSM 3.3.24 Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Command Line Arguments: Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Log File: /var/log/opensm.log Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: ------------------------------------------------- Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: OpenSM 3.3.24 Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44098]: /var/log/opensm.log log file opened Dec 29 13:22:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44098]: OpenSM 3.3.24 Dec 29 13:22:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Using default GUID 0x20af7fffe97b162 Dec 29 13:22:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Entering DISCOVERING state Dec 29 13:22:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44098]: Entering DISCOVERING state Dec 29 13:22:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: ibwarn: [44098] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:22:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Error from osm_opensm_bind (0x2A) Dec 29 13:22:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Perhaps another instance of OpenSM is already running Dec 29 13:22:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44098]: Exiting SM Dec 29 13:22:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44098]: Exiting SM Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: ------------------------------------------------- Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: OpenSM 3.3.24 Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Command Line Arguments: Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Log File: /var/log/opensm.log Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: ------------------------------------------------- Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: OpenSM 3.3.24 Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44170]: /var/log/opensm.log log file opened Dec 29 13:23:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44170]: OpenSM 3.3.24 Dec 29 13:23:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Using default GUID 0x20af7fffe97b162 Dec 29 13:23:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Entering DISCOVERING state Dec 29 13:23:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44170]: Entering DISCOVERING state Dec 29 13:23:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: ibwarn: [44170] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:23:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Error from osm_opensm_bind (0x2A) Dec 29 13:23:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Perhaps another instance of OpenSM is already running Dec 29 13:23:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44170]: Exiting SM Dec 29 13:23:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44170]: Exiting SM Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: ------------------------------------------------- Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: OpenSM 3.3.24 Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Command Line Arguments: Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Log File: /var/log/opensm.log Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: ------------------------------------------------- Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: OpenSM 3.3.24 Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44239]: /var/log/opensm.log log file opened Dec 29 13:23:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44239]: OpenSM 3.3.24 Dec 29 13:23:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Using default GUID 0x20af7fffe97b162 Dec 29 13:23:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Entering DISCOVERING state Dec 29 13:23:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44239]: Entering DISCOVERING state Dec 29 13:23:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: ibwarn: [44239] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:23:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Error from osm_opensm_bind (0x2A) Dec 29 13:23:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Perhaps another instance of OpenSM is already running Dec 29 13:23:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44239]: Exiting SM Dec 29 13:23:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44239]: Exiting SM Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: ------------------------------------------------- Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: OpenSM 3.3.24 Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Command Line Arguments: Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Log File: /var/log/opensm.log Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: ------------------------------------------------- Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: OpenSM 3.3.24 Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44308]: /var/log/opensm.log log file opened Dec 29 13:24:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44308]: OpenSM 3.3.24 Dec 29 13:24:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Using default GUID 0x20af7fffe97b162 Dec 29 13:24:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Entering DISCOVERING state Dec 29 13:24:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44308]: Entering DISCOVERING state Dec 29 13:24:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: ibwarn: [44308] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:24:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Error from osm_opensm_bind (0x2A) Dec 29 13:24:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Perhaps another instance of OpenSM is already running Dec 29 13:24:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44308]: Exiting SM Dec 29 13:24:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44308]: Exiting SM Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: ------------------------------------------------- Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: OpenSM 3.3.24 Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Command Line Arguments: Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Log File: /var/log/opensm.log Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: ------------------------------------------------- Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: OpenSM 3.3.24 Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44380]: /var/log/opensm.log log file opened Dec 29 13:24:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44380]: OpenSM 3.3.24 Dec 29 13:24:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Using default GUID 0x20af7fffe97b162 Dec 29 13:24:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Entering DISCOVERING state Dec 29 13:24:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44380]: Entering DISCOVERING state Dec 29 13:25:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: ibwarn: [44380] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:25:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Error from osm_opensm_bind (0x2A) Dec 29 13:25:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Perhaps another instance of OpenSM is already running Dec 29 13:25:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44380]: Exiting SM Dec 29 13:25:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44380]: Exiting SM Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: ------------------------------------------------- Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: OpenSM 3.3.24 Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Command Line Arguments: Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Log File: /var/log/opensm.log Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: ------------------------------------------------- Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: OpenSM 3.3.24 Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44450]: /var/log/opensm.log log file opened Dec 29 13:25:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44450]: OpenSM 3.3.24 Dec 29 13:25:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Using default GUID 0x20af7fffe97b162 Dec 29 13:25:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Entering DISCOVERING state Dec 29 13:25:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44450]: Entering DISCOVERING state Dec 29 13:25:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: ibwarn: [44450] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:25:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Error from osm_opensm_bind (0x2A) Dec 29 13:25:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Perhaps another instance of OpenSM is already running Dec 29 13:25:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44450]: Exiting SM Dec 29 13:25:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44450]: Exiting SM Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: ------------------------------------------------- Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: OpenSM 3.3.24 Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Command Line Arguments: Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Log File: /var/log/opensm.log Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: ------------------------------------------------- Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: OpenSM 3.3.24 Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44519]: /var/log/opensm.log log file opened Dec 29 13:26:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44519]: OpenSM 3.3.24 Dec 29 13:26:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Using default GUID 0x20af7fffe97b162 Dec 29 13:26:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Entering DISCOVERING state Dec 29 13:26:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44519]: Entering DISCOVERING state Dec 29 13:26:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: ibwarn: [44519] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:26:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Error from osm_opensm_bind (0x2A) Dec 29 13:26:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Perhaps another instance of OpenSM is already running Dec 29 13:26:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44519]: Exiting SM Dec 29 13:26:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44519]: Exiting SM Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: ------------------------------------------------- Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: OpenSM 3.3.24 Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Command Line Arguments: Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Log File: /var/log/opensm.log Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: ------------------------------------------------- Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: OpenSM 3.3.24 Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44588]: /var/log/opensm.log log file opened Dec 29 13:26:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44588]: OpenSM 3.3.24 Dec 29 13:26:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Using default GUID 0x20af7fffe97b162 Dec 29 13:26:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Entering DISCOVERING state Dec 29 13:26:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44588]: Entering DISCOVERING state Dec 29 13:26:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: ibwarn: [44588] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:26:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Error from osm_opensm_bind (0x2A) Dec 29 13:26:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Perhaps another instance of OpenSM is already running Dec 29 13:26:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44588]: Exiting SM Dec 29 13:26:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44588]: Exiting SM Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: ------------------------------------------------- Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: OpenSM 3.3.24 Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Command Line Arguments: Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Log File: /var/log/opensm.log Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: ------------------------------------------------- Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: OpenSM 3.3.24 Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44659]: /var/log/opensm.log log file opened Dec 29 13:27:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44659]: OpenSM 3.3.24 Dec 29 13:27:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Using default GUID 0x20af7fffe97b162 Dec 29 13:27:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Entering DISCOVERING state Dec 29 13:27:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44659]: Entering DISCOVERING state Dec 29 13:27:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: ibwarn: [44659] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:27:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Error from osm_opensm_bind (0x2A) Dec 29 13:27:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Perhaps another instance of OpenSM is already running Dec 29 13:27:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44659]: Exiting SM Dec 29 13:27:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44659]: Exiting SM Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: ------------------------------------------------- Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: OpenSM 3.3.24 Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Command Line Arguments: Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Log File: /var/log/opensm.log Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: ------------------------------------------------- Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: OpenSM 3.3.24 Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44728]: /var/log/opensm.log log file opened Dec 29 13:27:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44728]: OpenSM 3.3.24 Dec 29 13:28:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Using default GUID 0x20af7fffe97b162 Dec 29 13:28:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Entering DISCOVERING state Dec 29 13:28:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44728]: Entering DISCOVERING state Dec 29 13:28:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: ibwarn: [44728] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:28:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Error from osm_opensm_bind (0x2A) Dec 29 13:28:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Perhaps another instance of OpenSM is already running Dec 29 13:28:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44728]: Exiting SM Dec 29 13:28:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44728]: Exiting SM Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: ------------------------------------------------- Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: OpenSM 3.3.24 Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Command Line Arguments: Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Log File: /var/log/opensm.log Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: ------------------------------------------------- Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: OpenSM 3.3.24 Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44799]: /var/log/opensm.log log file opened Dec 29 13:28:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44799]: OpenSM 3.3.24 Dec 29 13:28:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Using default GUID 0x20af7fffe97b162 Dec 29 13:28:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Entering DISCOVERING state Dec 29 13:28:37 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44799]: Entering DISCOVERING state Dec 29 13:28:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: ibwarn: [44799] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:28:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Error from osm_opensm_bind (0x2A) Dec 29 13:28:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Perhaps another instance of OpenSM is already running Dec 29 13:28:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44799]: Exiting SM Dec 29 13:28:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44799]: Exiting SM Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: ------------------------------------------------- Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: OpenSM 3.3.24 Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Command Line Arguments: Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Log File: /var/log/opensm.log Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: ------------------------------------------------- Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: OpenSM 3.3.24 Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44870]: /var/log/opensm.log log file opened Dec 29 13:29:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44870]: OpenSM 3.3.24 Dec 29 13:29:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Using default GUID 0x20af7fffe97b162 Dec 29 13:29:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Entering DISCOVERING state Dec 29 13:29:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44870]: Entering DISCOVERING state Dec 29 13:29:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: ibwarn: [44870] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:29:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Error from osm_opensm_bind (0x2A) Dec 29 13:29:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Perhaps another instance of OpenSM is already running Dec 29 13:29:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44870]: Exiting SM Dec 29 13:29:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44870]: Exiting SM Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: ------------------------------------------------- Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: OpenSM 3.3.24 Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Command Line Arguments: Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Log File: /var/log/opensm.log Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: ------------------------------------------------- Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: OpenSM 3.3.24 Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44939]: /var/log/opensm.log log file opened Dec 29 13:29:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44939]: OpenSM 3.3.24 Dec 29 13:29:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Using default GUID 0x20af7fffe97b162 Dec 29 13:29:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Entering DISCOVERING state Dec 29 13:29:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44939]: Entering DISCOVERING state Dec 29 13:29:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: ibwarn: [44939] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:29:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Error from osm_opensm_bind (0x2A) Dec 29 13:29:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Perhaps another instance of OpenSM is already running Dec 29 13:29:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[44939]: Exiting SM Dec 29 13:29:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[44939]: Exiting SM Dec 29 13:30:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Job `cron.daily' started Dec 29 13:30:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Job `cron.daily' terminated Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: ------------------------------------------------- Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: OpenSM 3.3.24 Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Command Line Arguments: Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Log File: /var/log/opensm.log Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: ------------------------------------------------- Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: OpenSM 3.3.24 Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45013]: /var/log/opensm.log log file opened Dec 29 13:30:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45013]: OpenSM 3.3.24 Dec 29 13:30:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Using default GUID 0x20af7fffe97b162 Dec 29 13:30:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Entering DISCOVERING state Dec 29 13:30:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45013]: Entering DISCOVERING state Dec 29 13:30:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: ibwarn: [45013] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:30:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Error from osm_opensm_bind (0x2A) Dec 29 13:30:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Perhaps another instance of OpenSM is already running Dec 29 13:30:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45013]: Exiting SM Dec 29 13:30:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45013]: Exiting SM Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: ------------------------------------------------- Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: OpenSM 3.3.24 Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Command Line Arguments: Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Log File: /var/log/opensm.log Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: ------------------------------------------------- Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: OpenSM 3.3.24 Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45082]: /var/log/opensm.log log file opened Dec 29 13:31:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45082]: OpenSM 3.3.24 Dec 29 13:31:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Using default GUID 0x20af7fffe97b162 Dec 29 13:31:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Entering DISCOVERING state Dec 29 13:31:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45082]: Entering DISCOVERING state Dec 29 13:31:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: ibwarn: [45082] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:31:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Error from osm_opensm_bind (0x2A) Dec 29 13:31:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Perhaps another instance of OpenSM is already running Dec 29 13:31:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45082]: Exiting SM Dec 29 13:31:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45082]: Exiting SM Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: ------------------------------------------------- Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: OpenSM 3.3.24 Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Command Line Arguments: Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Log File: /var/log/opensm.log Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: ------------------------------------------------- Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: OpenSM 3.3.24 Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45151]: /var/log/opensm.log log file opened Dec 29 13:31:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45151]: OpenSM 3.3.24 Dec 29 13:31:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Using default GUID 0x20af7fffe97b162 Dec 29 13:31:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Entering DISCOVERING state Dec 29 13:31:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45151]: Entering DISCOVERING state Dec 29 13:31:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: ibwarn: [45151] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:31:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Error from osm_opensm_bind (0x2A) Dec 29 13:31:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Perhaps another instance of OpenSM is already running Dec 29 13:31:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45151]: Exiting SM Dec 29 13:31:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45151]: Exiting SM Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: ------------------------------------------------- Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: OpenSM 3.3.24 Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Command Line Arguments: Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Log File: /var/log/opensm.log Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: ------------------------------------------------- Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: OpenSM 3.3.24 Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45222]: /var/log/opensm.log log file opened Dec 29 13:32:17 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45222]: OpenSM 3.3.24 Dec 29 13:32:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Using default GUID 0x20af7fffe97b162 Dec 29 13:32:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Entering DISCOVERING state Dec 29 13:32:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45222]: Entering DISCOVERING state Dec 29 13:32:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: ibwarn: [45222] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:32:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Error from osm_opensm_bind (0x2A) Dec 29 13:32:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Perhaps another instance of OpenSM is already running Dec 29 13:32:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45222]: Exiting SM Dec 29 13:32:24 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45222]: Exiting SM Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: ------------------------------------------------- Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: OpenSM 3.3.24 Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Command Line Arguments: Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Log File: /var/log/opensm.log Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: ------------------------------------------------- Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45291]: /var/log/opensm.log log file opened Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: OpenSM 3.3.24 Dec 29 13:32:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45291]: OpenSM 3.3.24 Dec 29 13:32:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Using default GUID 0x20af7fffe97b162 Dec 29 13:32:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Entering DISCOVERING state Dec 29 13:32:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45291]: Entering DISCOVERING state Dec 29 13:33:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: ibwarn: [45291] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:33:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Error from osm_opensm_bind (0x2A) Dec 29 13:33:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Perhaps another instance of OpenSM is already running Dec 29 13:33:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45291]: Exiting SM Dec 29 13:33:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45291]: Exiting SM Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: ------------------------------------------------- Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: OpenSM 3.3.24 Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Command Line Arguments: Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Log File: /var/log/opensm.log Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: ------------------------------------------------- Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: OpenSM 3.3.24 Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45362]: /var/log/opensm.log log file opened Dec 29 13:33:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45362]: OpenSM 3.3.24 Dec 29 13:33:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Using default GUID 0x20af7fffe97b162 Dec 29 13:33:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Entering DISCOVERING state Dec 29 13:33:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45362]: Entering DISCOVERING state Dec 29 13:33:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: ibwarn: [45362] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:33:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Error from osm_opensm_bind (0x2A) Dec 29 13:33:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Perhaps another instance of OpenSM is already running Dec 29 13:33:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45362]: Exiting SM Dec 29 13:33:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45362]: Exiting SM Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: ------------------------------------------------- Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: OpenSM 3.3.24 Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Command Line Arguments: Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Log File: /var/log/opensm.log Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: ------------------------------------------------- Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: OpenSM 3.3.24 Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45432]: /var/log/opensm.log log file opened Dec 29 13:34:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45432]: OpenSM 3.3.24 Dec 29 13:34:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Using default GUID 0x20af7fffe97b162 Dec 29 13:34:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Entering DISCOVERING state Dec 29 13:34:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45432]: Entering DISCOVERING state Dec 29 13:34:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: ibwarn: [45432] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:34:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Error from osm_opensm_bind (0x2A) Dec 29 13:34:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Perhaps another instance of OpenSM is already running Dec 29 13:34:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45432]: Exiting SM Dec 29 13:34:14 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45432]: Exiting SM Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: ------------------------------------------------- Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: OpenSM 3.3.24 Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Command Line Arguments: Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Log File: /var/log/opensm.log Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: ------------------------------------------------- Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: OpenSM 3.3.24 Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45501]: /var/log/opensm.log log file opened Dec 29 13:34:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45501]: OpenSM 3.3.24 Dec 29 13:34:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Using default GUID 0x20af7fffe97b162 Dec 29 13:34:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Entering DISCOVERING state Dec 29 13:34:47 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45501]: Entering DISCOVERING state Dec 29 13:34:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: ibwarn: [45501] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:34:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Error from osm_opensm_bind (0x2A) Dec 29 13:34:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Perhaps another instance of OpenSM is already running Dec 29 13:34:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45501]: Exiting SM Dec 29 13:34:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45501]: Exiting SM Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: ------------------------------------------------- Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: OpenSM 3.3.24 Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Command Line Arguments: Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Log File: /var/log/opensm.log Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: ------------------------------------------------- Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: OpenSM 3.3.24 Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45573]: /var/log/opensm.log log file opened Dec 29 13:35:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45573]: OpenSM 3.3.24 Dec 29 13:35:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Using default GUID 0x20af7fffe97b162 Dec 29 13:35:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Entering DISCOVERING state Dec 29 13:35:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45573]: Entering DISCOVERING state Dec 29 13:35:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: ibwarn: [45573] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:35:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Error from osm_opensm_bind (0x2A) Dec 29 13:35:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Perhaps another instance of OpenSM is already running Dec 29 13:35:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45573]: Exiting SM Dec 29 13:35:29 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45573]: Exiting SM Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: ------------------------------------------------- Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: OpenSM 3.3.24 Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Command Line Arguments: Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Log File: /var/log/opensm.log Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: ------------------------------------------------- Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: OpenSM 3.3.24 Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45643]: /var/log/opensm.log log file opened Dec 29 13:35:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45643]: OpenSM 3.3.24 Dec 29 13:36:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Using default GUID 0x20af7fffe97b162 Dec 29 13:36:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Entering DISCOVERING state Dec 29 13:36:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45643]: Entering DISCOVERING state Dec 29 13:36:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: ibwarn: [45643] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:36:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Error from osm_opensm_bind (0x2A) Dec 29 13:36:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Perhaps another instance of OpenSM is already running Dec 29 13:36:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45643]: Exiting SM Dec 29 13:36:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45643]: Exiting SM Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: ------------------------------------------------- Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: OpenSM 3.3.24 Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Command Line Arguments: Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Log File: /var/log/opensm.log Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: ------------------------------------------------- Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: OpenSM 3.3.24 Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45714]: /var/log/opensm.log log file opened Dec 29 13:36:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45714]: OpenSM 3.3.24 Dec 29 13:36:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Using default GUID 0x20af7fffe97b162 Dec 29 13:36:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Entering DISCOVERING state Dec 29 13:36:39 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45714]: Entering DISCOVERING state Dec 29 13:36:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: ibwarn: [45714] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:36:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Error from osm_opensm_bind (0x2A) Dec 29 13:36:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Perhaps another instance of OpenSM is already running Dec 29 13:36:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45714]: Exiting SM Dec 29 13:36:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45714]: Exiting SM Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: ------------------------------------------------- Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: OpenSM 3.3.24 Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Command Line Arguments: Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Log File: /var/log/opensm.log Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: ------------------------------------------------- Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45783]: /var/log/opensm.log log file opened Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: OpenSM 3.3.24 Dec 29 13:37:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45783]: OpenSM 3.3.24 Dec 29 13:37:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Using default GUID 0x20af7fffe97b162 Dec 29 13:37:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Entering DISCOVERING state Dec 29 13:37:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45783]: Entering DISCOVERING state Dec 29 13:37:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: ibwarn: [45783] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:37:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Error from osm_opensm_bind (0x2A) Dec 29 13:37:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Perhaps another instance of OpenSM is already running Dec 29 13:37:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45783]: Exiting SM Dec 29 13:37:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45783]: Exiting SM Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: ------------------------------------------------- Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: OpenSM 3.3.24 Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Command Line Arguments: Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Log File: /var/log/opensm.log Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: ------------------------------------------------- Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: OpenSM 3.3.24 Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45852]: /var/log/opensm.log log file opened Dec 29 13:37:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45852]: OpenSM 3.3.24 Dec 29 13:37:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Using default GUID 0x20af7fffe97b162 Dec 29 13:37:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Entering DISCOVERING state Dec 29 13:37:54 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45852]: Entering DISCOVERING state Dec 29 13:37:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: ibwarn: [45852] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:37:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Error from osm_opensm_bind (0x2A) Dec 29 13:37:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Perhaps another instance of OpenSM is already running Dec 29 13:37:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45852]: Exiting SM Dec 29 13:37:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45852]: Exiting SM Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: ------------------------------------------------- Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: OpenSM 3.3.24 Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Command Line Arguments: Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Log File: /var/log/opensm.log Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: ------------------------------------------------- Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: OpenSM 3.3.24 Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45923]: /var/log/opensm.log log file opened Dec 29 13:38:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45923]: OpenSM 3.3.24 Dec 29 13:38:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Using default GUID 0x20af7fffe97b162 Dec 29 13:38:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Entering DISCOVERING state Dec 29 13:38:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45923]: Entering DISCOVERING state Dec 29 13:38:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: ibwarn: [45923] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:38:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Error from osm_opensm_bind (0x2A) Dec 29 13:38:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Perhaps another instance of OpenSM is already running Dec 29 13:38:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45923]: Exiting SM Dec 29 13:38:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45923]: Exiting SM Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: ------------------------------------------------- Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: OpenSM 3.3.24 Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Command Line Arguments: Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Log File: /var/log/opensm.log Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: ------------------------------------------------- Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: OpenSM 3.3.24 Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45992]: /var/log/opensm.log log file opened Dec 29 13:39:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45992]: OpenSM 3.3.24 Dec 29 13:39:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Using default GUID 0x20af7fffe97b162 Dec 29 13:39:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Entering DISCOVERING state Dec 29 13:39:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45992]: Entering DISCOVERING state Dec 29 13:39:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: ibwarn: [45992] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:39:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Error from osm_opensm_bind (0x2A) Dec 29 13:39:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Perhaps another instance of OpenSM is already running Dec 29 13:39:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[45992]: Exiting SM Dec 29 13:39:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[45992]: Exiting SM Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: ------------------------------------------------- Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: OpenSM 3.3.24 Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Command Line Arguments: Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Log File: /var/log/opensm.log Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: ------------------------------------------------- Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: OpenSM 3.3.24 Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46064]: /var/log/opensm.log log file opened Dec 29 13:39:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46064]: OpenSM 3.3.24 Dec 29 13:39:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Using default GUID 0x20af7fffe97b162 Dec 29 13:39:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Entering DISCOVERING state Dec 29 13:39:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46064]: Entering DISCOVERING state Dec 29 13:39:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: ibwarn: [46064] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:39:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Error from osm_opensm_bind (0x2A) Dec 29 13:39:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Perhaps another instance of OpenSM is already running Dec 29 13:39:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46064]: Exiting SM Dec 29 13:39:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46064]: Exiting SM Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: ------------------------------------------------- Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: OpenSM 3.3.24 Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Command Line Arguments: Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Log File: /var/log/opensm.log Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: ------------------------------------------------- Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46133]: /var/log/opensm.log log file opened Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46133]: OpenSM 3.3.24 Dec 29 13:40:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: OpenSM 3.3.24 Dec 29 13:40:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Using default GUID 0x20af7fffe97b162 Dec 29 13:40:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Entering DISCOVERING state Dec 29 13:40:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46133]: Entering DISCOVERING state Dec 29 13:40:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: ibwarn: [46133] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:40:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Error from osm_opensm_bind (0x2A) Dec 29 13:40:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Perhaps another instance of OpenSM is already running Dec 29 13:40:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46133]: Exiting SM Dec 29 13:40:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46133]: Exiting SM Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: ------------------------------------------------- Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: OpenSM 3.3.24 Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Command Line Arguments: Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Log File: /var/log/opensm.log Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: ------------------------------------------------- Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: OpenSM 3.3.24 Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46202]: /var/log/opensm.log log file opened Dec 29 13:40:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46202]: OpenSM 3.3.24 Dec 29 13:40:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Using default GUID 0x20af7fffe97b162 Dec 29 13:40:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Entering DISCOVERING state Dec 29 13:40:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46202]: Entering DISCOVERING state Dec 29 13:41:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: ibwarn: [46202] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:41:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Error from osm_opensm_bind (0x2A) Dec 29 13:41:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Perhaps another instance of OpenSM is already running Dec 29 13:41:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46202]: Exiting SM Dec 29 13:41:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46202]: Exiting SM Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: ------------------------------------------------- Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: OpenSM 3.3.24 Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Command Line Arguments: Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Log File: /var/log/opensm.log Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: ------------------------------------------------- Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: OpenSM 3.3.24 Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46273]: /var/log/opensm.log log file opened Dec 29 13:41:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46273]: OpenSM 3.3.24 Dec 29 13:41:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Using default GUID 0x20af7fffe97b162 Dec 29 13:41:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Entering DISCOVERING state Dec 29 13:41:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46273]: Entering DISCOVERING state Dec 29 13:41:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: ibwarn: [46273] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:41:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Error from osm_opensm_bind (0x2A) Dec 29 13:41:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Perhaps another instance of OpenSM is already running Dec 29 13:41:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46273]: Exiting SM Dec 29 13:41:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46273]: Exiting SM Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: ------------------------------------------------- Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: OpenSM 3.3.24 Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Command Line Arguments: Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Log File: /var/log/opensm.log Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: ------------------------------------------------- Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: OpenSM 3.3.24 Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46342]: /var/log/opensm.log log file opened Dec 29 13:42:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46342]: OpenSM 3.3.24 Dec 29 13:42:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Using default GUID 0x20af7fffe97b162 Dec 29 13:42:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Entering DISCOVERING state Dec 29 13:42:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46342]: Entering DISCOVERING state Dec 29 13:42:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: ibwarn: [46342] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:42:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Error from osm_opensm_bind (0x2A) Dec 29 13:42:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Perhaps another instance of OpenSM is already running Dec 29 13:42:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46342]: Exiting SM Dec 29 13:42:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46342]: Exiting SM Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: ------------------------------------------------- Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: OpenSM 3.3.24 Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Command Line Arguments: Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Log File: /var/log/opensm.log Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: ------------------------------------------------- Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46413]: /var/log/opensm.log log file opened Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: OpenSM 3.3.24 Dec 29 13:42:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46413]: OpenSM 3.3.24 Dec 29 13:42:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Using default GUID 0x20af7fffe97b162 Dec 29 13:42:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Entering DISCOVERING state Dec 29 13:42:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46413]: Entering DISCOVERING state Dec 29 13:42:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: ibwarn: [46413] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:42:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Error from osm_opensm_bind (0x2A) Dec 29 13:42:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Perhaps another instance of OpenSM is already running Dec 29 13:42:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46413]: Exiting SM Dec 29 13:42:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46413]: Exiting SM Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: ------------------------------------------------- Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: OpenSM 3.3.24 Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Command Line Arguments: Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Log File: /var/log/opensm.log Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: ------------------------------------------------- Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: OpenSM 3.3.24 Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46484]: /var/log/opensm.log log file opened Dec 29 13:43:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46484]: OpenSM 3.3.24 Dec 29 13:43:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Using default GUID 0x20af7fffe97b162 Dec 29 13:43:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Entering DISCOVERING state Dec 29 13:43:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46484]: Entering DISCOVERING state Dec 29 13:43:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: ibwarn: [46484] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:43:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Error from osm_opensm_bind (0x2A) Dec 29 13:43:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Perhaps another instance of OpenSM is already running Dec 29 13:43:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46484]: Exiting SM Dec 29 13:43:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46484]: Exiting SM Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: ------------------------------------------------- Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: OpenSM 3.3.24 Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Command Line Arguments: Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Log File: /var/log/opensm.log Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: ------------------------------------------------- Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46553]: /var/log/opensm.log log file opened Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: OpenSM 3.3.24 Dec 29 13:44:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46553]: OpenSM 3.3.24 Dec 29 13:44:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Using default GUID 0x20af7fffe97b162 Dec 29 13:44:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Entering DISCOVERING state Dec 29 13:44:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46553]: Entering DISCOVERING state Dec 29 13:44:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: ibwarn: [46553] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:44:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Error from osm_opensm_bind (0x2A) Dec 29 13:44:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Perhaps another instance of OpenSM is already running Dec 29 13:44:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46553]: Exiting SM Dec 29 13:44:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46553]: Exiting SM Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: ------------------------------------------------- Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: OpenSM 3.3.24 Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Command Line Arguments: Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Log File: /var/log/opensm.log Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: ------------------------------------------------- Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46625]: /var/log/opensm.log log file opened Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46625]: OpenSM 3.3.24 Dec 29 13:44:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: OpenSM 3.3.24 Dec 29 13:44:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Using default GUID 0x20af7fffe97b162 Dec 29 13:44:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Entering DISCOVERING state Dec 29 13:44:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46625]: Entering DISCOVERING state Dec 29 13:44:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: ibwarn: [46625] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:44:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Error from osm_opensm_bind (0x2A) Dec 29 13:44:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Perhaps another instance of OpenSM is already running Dec 29 13:44:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46625]: Exiting SM Dec 29 13:44:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46625]: Exiting SM Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: ------------------------------------------------- Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: OpenSM 3.3.24 Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Command Line Arguments: Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Log File: /var/log/opensm.log Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: ------------------------------------------------- Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: OpenSM 3.3.24 Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46694]: /var/log/opensm.log log file opened Dec 29 13:45:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46694]: OpenSM 3.3.24 Dec 29 13:45:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Using default GUID 0x20af7fffe97b162 Dec 29 13:45:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Entering DISCOVERING state Dec 29 13:45:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46694]: Entering DISCOVERING state Dec 29 13:45:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: ibwarn: [46694] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:45:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Error from osm_opensm_bind (0x2A) Dec 29 13:45:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Perhaps another instance of OpenSM is already running Dec 29 13:45:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46694]: Exiting SM Dec 29 13:45:23 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46694]: Exiting SM Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: ------------------------------------------------- Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: OpenSM 3.3.24 Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Command Line Arguments: Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Log File: /var/log/opensm.log Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: ------------------------------------------------- Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46765]: /var/log/opensm.log log file opened Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: OpenSM 3.3.24 Dec 29 13:45:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46765]: OpenSM 3.3.24 Dec 29 13:45:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Using default GUID 0x20af7fffe97b162 Dec 29 13:45:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Entering DISCOVERING state Dec 29 13:45:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46765]: Entering DISCOVERING state Dec 29 13:45:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: ibwarn: [46765] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:45:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Error from osm_opensm_bind (0x2A) Dec 29 13:45:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Perhaps another instance of OpenSM is already running Dec 29 13:45:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46765]: Exiting SM Dec 29 13:45:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46765]: Exiting SM Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: ------------------------------------------------- Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: OpenSM 3.3.24 Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Command Line Arguments: Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Log File: /var/log/opensm.log Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: ------------------------------------------------- Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: OpenSM 3.3.24 Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46834]: /var/log/opensm.log log file opened Dec 29 13:46:28 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46834]: OpenSM 3.3.24 Dec 29 13:46:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Using default GUID 0x20af7fffe97b162 Dec 29 13:46:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Entering DISCOVERING state Dec 29 13:46:31 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46834]: Entering DISCOVERING state Dec 29 13:46:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: ibwarn: [46834] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:46:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Error from osm_opensm_bind (0x2A) Dec 29 13:46:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Perhaps another instance of OpenSM is already running Dec 29 13:46:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46834]: Exiting SM Dec 29 13:46:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46834]: Exiting SM Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: ------------------------------------------------- Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: OpenSM 3.3.24 Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Command Line Arguments: Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Log File: /var/log/opensm.log Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: ------------------------------------------------- Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: OpenSM 3.3.24 Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46903]: /var/log/opensm.log log file opened Dec 29 13:47:04 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46903]: OpenSM 3.3.24 Dec 29 13:47:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Using default GUID 0x20af7fffe97b162 Dec 29 13:47:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Entering DISCOVERING state Dec 29 13:47:07 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46903]: Entering DISCOVERING state Dec 29 13:47:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: ibwarn: [46903] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:47:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Error from osm_opensm_bind (0x2A) Dec 29 13:47:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Perhaps another instance of OpenSM is already running Dec 29 13:47:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46903]: Exiting SM Dec 29 13:47:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46903]: Exiting SM Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: ------------------------------------------------- Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: OpenSM 3.3.24 Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Command Line Arguments: Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Log File: /var/log/opensm.log Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: ------------------------------------------------- Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: OpenSM 3.3.24 Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46972]: /var/log/opensm.log log file opened Dec 29 13:47:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46972]: OpenSM 3.3.24 Dec 29 13:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Using default GUID 0x20af7fffe97b162 Dec 29 13:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Entering DISCOVERING state Dec 29 13:47:44 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46972]: Entering DISCOVERING state Dec 29 13:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: ibwarn: [46972] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Error from osm_opensm_bind (0x2A) Dec 29 13:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Perhaps another instance of OpenSM is already running Dec 29 13:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[46972]: Exiting SM Dec 29 13:47:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[46972]: Exiting SM Dec 29 13:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672339678.0992] dhcp4 (bnxt_roce): state changed new lease, address=172.31.40.31 Dec 29 13:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672339678.1062] dhcp4 (bnxt_roce.43): state changed new lease, address=172.31.43.31 Dec 29 13:47:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com NetworkManager[1596]: [1672339678.1421] dhcp4 (bnxt_roce.45): state changed new lease, address=172.31.45.31 Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: ------------------------------------------------- Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: OpenSM 3.3.24 Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Command Line Arguments: Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Log File: /var/log/opensm.log Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: ------------------------------------------------- Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: OpenSM 3.3.24 Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47043]: /var/log/opensm.log log file opened Dec 29 13:48:18 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47043]: OpenSM 3.3.24 Dec 29 13:48:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Using default GUID 0x20af7fffe97b162 Dec 29 13:48:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Entering DISCOVERING state Dec 29 13:48:21 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47043]: Entering DISCOVERING state Dec 29 13:48:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: ibwarn: [47043] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:48:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Error from osm_opensm_bind (0x2A) Dec 29 13:48:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Perhaps another instance of OpenSM is already running Dec 29 13:48:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47043]: Exiting SM Dec 29 13:48:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47043]: Exiting SM Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: ------------------------------------------------- Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: OpenSM 3.3.24 Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Command Line Arguments: Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Log File: /var/log/opensm.log Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: ------------------------------------------------- Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: OpenSM 3.3.24 Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47112]: /var/log/opensm.log log file opened Dec 29 13:48:55 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47112]: OpenSM 3.3.24 Dec 29 13:48:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Using default GUID 0x20af7fffe97b162 Dec 29 13:48:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Entering DISCOVERING state Dec 29 13:48:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47112]: Entering DISCOVERING state Dec 29 13:49:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: ibwarn: [47112] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:49:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Error from osm_opensm_bind (0x2A) Dec 29 13:49:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Perhaps another instance of OpenSM is already running Dec 29 13:49:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47112]: Exiting SM Dec 29 13:49:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47112]: Exiting SM Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: ------------------------------------------------- Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: OpenSM 3.3.24 Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Command Line Arguments: Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Log File: /var/log/opensm.log Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: ------------------------------------------------- Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: OpenSM 3.3.24 Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47183]: /var/log/opensm.log log file opened Dec 29 13:49:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47183]: OpenSM 3.3.24 Dec 29 13:49:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Using default GUID 0x20af7fffe97b162 Dec 29 13:49:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Entering DISCOVERING state Dec 29 13:49:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47183]: Entering DISCOVERING state Dec 29 13:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: ibwarn: [47183] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Error from osm_opensm_bind (0x2A) Dec 29 13:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Perhaps another instance of OpenSM is already running Dec 29 13:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47183]: Exiting SM Dec 29 13:49:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47183]: Exiting SM Dec 29 13:50:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Job `cron.weekly' started Dec 29 13:50:01 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com anacron[40415]: Job `cron.weekly' terminated Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: ------------------------------------------------- Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: OpenSM 3.3.24 Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Command Line Arguments: Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Log File: /var/log/opensm.log Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: ------------------------------------------------- Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47255]: /var/log/opensm.log log file opened Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47255]: OpenSM 3.3.24 Dec 29 13:50:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: OpenSM 3.3.24 Dec 29 13:50:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Using default GUID 0x20af7fffe97b162 Dec 29 13:50:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Entering DISCOVERING state Dec 29 13:50:11 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47255]: Entering DISCOVERING state Dec 29 13:50:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: ibwarn: [47255] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:50:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Error from osm_opensm_bind (0x2A) Dec 29 13:50:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Perhaps another instance of OpenSM is already running Dec 29 13:50:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47255]: Exiting SM Dec 29 13:50:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47255]: Exiting SM Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: ------------------------------------------------- Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: OpenSM 3.3.24 Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Command Line Arguments: Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Log File: /var/log/opensm.log Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: ------------------------------------------------- Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: OpenSM 3.3.24 Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47324]: /var/log/opensm.log log file opened Dec 29 13:50:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47324]: OpenSM 3.3.24 Dec 29 13:50:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Using default GUID 0x20af7fffe97b162 Dec 29 13:50:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Entering DISCOVERING state Dec 29 13:50:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47324]: Entering DISCOVERING state Dec 29 13:50:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: ibwarn: [47324] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:50:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Error from osm_opensm_bind (0x2A) Dec 29 13:50:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Perhaps another instance of OpenSM is already running Dec 29 13:50:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47324]: Exiting SM Dec 29 13:50:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47324]: Exiting SM Dec 29 13:51:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Starting Hostname Service... Dec 29 13:51:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: Started Hostname Service. Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: ------------------------------------------------- Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: OpenSM 3.3.24 Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Command Line Arguments: Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Log File: /var/log/opensm.log Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: ------------------------------------------------- Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: OpenSM 3.3.24 Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47479]: /var/log/opensm.log log file opened Dec 29 13:51:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47479]: OpenSM 3.3.24 Dec 29 13:51:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Using default GUID 0x20af7fffe97b162 Dec 29 13:51:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Entering DISCOVERING state Dec 29 13:51:25 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47479]: Entering DISCOVERING state Dec 29 13:51:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: ibwarn: [47479] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:51:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Error from osm_opensm_bind (0x2A) Dec 29 13:51:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Perhaps another instance of OpenSM is already running Dec 29 13:51:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47479]: Exiting SM Dec 29 13:51:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47479]: Exiting SM Dec 29 13:51:46 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com systemd[1]: systemd-hostnamed.service: Deactivated successfully. Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: ------------------------------------------------- Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: OpenSM 3.3.24 Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Command Line Arguments: Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Log File: /var/log/opensm.log Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: ------------------------------------------------- Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47577]: /var/log/opensm.log log file opened Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: OpenSM 3.3.24 Dec 29 13:52:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47577]: OpenSM 3.3.24 Dec 29 13:52:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Using default GUID 0x20af7fffe97b162 Dec 29 13:52:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Entering DISCOVERING state Dec 29 13:52:02 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47577]: Entering DISCOVERING state Dec 29 13:52:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: ibwarn: [47577] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:52:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Error from osm_opensm_bind (0x2A) Dec 29 13:52:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Perhaps another instance of OpenSM is already running Dec 29 13:52:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47577]: Exiting SM Dec 29 13:52:06 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47577]: Exiting SM Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: ------------------------------------------------- Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: OpenSM 3.3.24 Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Command Line Arguments: Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Log File: /var/log/opensm.log Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: ------------------------------------------------- Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: OpenSM 3.3.24 Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47651]: /var/log/opensm.log log file opened Dec 29 13:52:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47651]: OpenSM 3.3.24 Dec 29 13:52:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Using default GUID 0x20af7fffe97b162 Dec 29 13:52:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Entering DISCOVERING state Dec 29 13:52:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47651]: Entering DISCOVERING state Dec 29 13:52:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: ibwarn: [47651] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:52:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Error from osm_opensm_bind (0x2A) Dec 29 13:52:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Perhaps another instance of OpenSM is already running Dec 29 13:52:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47651]: Exiting SM Dec 29 13:52:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47651]: Exiting SM Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: ------------------------------------------------- Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: OpenSM 3.3.24 Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Command Line Arguments: Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Log File: /var/log/opensm.log Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: ------------------------------------------------- Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: OpenSM 3.3.24 Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47727]: /var/log/opensm.log log file opened Dec 29 13:53:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47727]: OpenSM 3.3.24 Dec 29 13:53:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Using default GUID 0x20af7fffe97b162 Dec 29 13:53:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Entering DISCOVERING state Dec 29 13:53:16 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47727]: Entering DISCOVERING state Dec 29 13:53:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: ibwarn: [47727] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:53:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Error from osm_opensm_bind (0x2A) Dec 29 13:53:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Perhaps another instance of OpenSM is already running Dec 29 13:53:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47727]: Exiting SM Dec 29 13:53:20 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47727]: Exiting SM Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: ------------------------------------------------- Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: OpenSM 3.3.24 Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Command Line Arguments: Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Log File: /var/log/opensm.log Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: ------------------------------------------------- Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: OpenSM 3.3.24 Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47801]: /var/log/opensm.log log file opened Dec 29 13:53:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47801]: OpenSM 3.3.24 Dec 29 13:53:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Using default GUID 0x20af7fffe97b162 Dec 29 13:53:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Entering DISCOVERING state Dec 29 13:53:53 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47801]: Entering DISCOVERING state Dec 29 13:53:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: ibwarn: [47801] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:53:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Error from osm_opensm_bind (0x2A) Dec 29 13:53:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Perhaps another instance of OpenSM is already running Dec 29 13:53:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47801]: Exiting SM Dec 29 13:53:57 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47801]: Exiting SM Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: ------------------------------------------------- Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: OpenSM 3.3.24 Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Command Line Arguments: Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Log File: /var/log/opensm.log Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: ------------------------------------------------- Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: OpenSM 3.3.24 Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47877]: /var/log/opensm.log log file opened Dec 29 13:54:27 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47877]: OpenSM 3.3.24 Dec 29 13:54:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Using default GUID 0x20af7fffe97b162 Dec 29 13:54:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Entering DISCOVERING state Dec 29 13:54:30 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47877]: Entering DISCOVERING state Dec 29 13:54:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: ibwarn: [47877] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:54:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Error from osm_opensm_bind (0x2A) Dec 29 13:54:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Perhaps another instance of OpenSM is already running Dec 29 13:54:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47877]: Exiting SM Dec 29 13:54:35 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47877]: Exiting SM Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: ------------------------------------------------- Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: OpenSM 3.3.24 Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Command Line Arguments: Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Log File: /var/log/opensm.log Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: ------------------------------------------------- Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47951]: /var/log/opensm.log log file opened Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47951]: OpenSM 3.3.24 Dec 29 13:55:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: OpenSM 3.3.24 Dec 29 13:55:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Using default GUID 0x20af7fffe97b162 Dec 29 13:55:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Entering DISCOVERING state Dec 29 13:55:08 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47951]: Entering DISCOVERING state Dec 29 13:55:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: ibwarn: [47951] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:55:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Error from osm_opensm_bind (0x2A) Dec 29 13:55:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Perhaps another instance of OpenSM is already running Dec 29 13:55:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[47951]: Exiting SM Dec 29 13:55:12 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[47951]: Exiting SM Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: ------------------------------------------------- Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: OpenSM 3.3.24 Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Command Line Arguments: Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Log File: /var/log/opensm.log Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: ------------------------------------------------- Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: OpenSM 3.3.24 Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48027]: /var/log/opensm.log log file opened Dec 29 13:55:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48027]: OpenSM 3.3.24 Dec 29 13:55:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Using default GUID 0x20af7fffe97b162 Dec 29 13:55:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Entering DISCOVERING state Dec 29 13:55:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48027]: Entering DISCOVERING state Dec 29 13:55:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: ibwarn: [48027] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:55:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Error from osm_opensm_bind (0x2A) Dec 29 13:55:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Perhaps another instance of OpenSM is already running Dec 29 13:55:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48027]: Exiting SM Dec 29 13:55:49 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48027]: Exiting SM Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: ------------------------------------------------- Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: OpenSM 3.3.24 Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Command Line Arguments: Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Log File: /var/log/opensm.log Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: ------------------------------------------------- Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: OpenSM 3.3.24 Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48101]: /var/log/opensm.log log file opened Dec 29 13:56:19 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48101]: OpenSM 3.3.24 Dec 29 13:56:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Using default GUID 0x20af7fffe97b162 Dec 29 13:56:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Entering DISCOVERING state Dec 29 13:56:22 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48101]: Entering DISCOVERING state Dec 29 13:56:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: ibwarn: [48101] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:56:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Error from osm_opensm_bind (0x2A) Dec 29 13:56:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Perhaps another instance of OpenSM is already running Dec 29 13:56:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48101]: Exiting SM Dec 29 13:56:26 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48101]: Exiting SM Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: ------------------------------------------------- Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: OpenSM 3.3.24 Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Command Line Arguments: Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Log File: /var/log/opensm.log Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: ------------------------------------------------- Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48175]: /var/log/opensm.log log file opened Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: OpenSM 3.3.24 Dec 29 13:56:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48175]: OpenSM 3.3.24 Dec 29 13:56:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Using default GUID 0x20af7fffe97b162 Dec 29 13:56:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Entering DISCOVERING state Dec 29 13:56:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48175]: Entering DISCOVERING state Dec 29 13:57:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: ibwarn: [48175] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:57:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Error from osm_opensm_bind (0x2A) Dec 29 13:57:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Perhaps another instance of OpenSM is already running Dec 29 13:57:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48175]: Exiting SM Dec 29 13:57:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48175]: Exiting SM Dec 29 13:57:32 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com unknown: RDMA Sanity Test - RoCE - Server hit test timeout, aborting it... Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com unknown[48273]: List of m Tasks: Start Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: ------------------------------------------------- Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: OpenSM 3.3.24 Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Command Line Arguments: Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Log File: /var/log/opensm.log Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: ------------------------------------------------- Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: OpenSM 3.3.24 Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48275]: /var/log/opensm.log log file opened Dec 29 13:57:33 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48275]: OpenSM 3.3.24 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sysrq: Show Memory Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Mem-Info: Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: active_anon:639 inactive_anon:40987 isolated_anon:0 active_file:80643 inactive_file:57989 isolated_file:0 unevictable:768 dirty:0 writeback:1 slab_reclaimable:64624 slab_unreclaimable:65631 mapped:15365 shmem:3163 pagetables:704 bounce:0 kernel_misc_reclaimable:0 free:15687305 free_pcp:12932 free_cma:0 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 active_anon:2556kB inactive_anon:163948kB active_file:322572kB inactive_file:231956kB unevictable:3072kB isolated(anon):0kB isolated(file):0kB mapped:61460kB dirty:0kB writeback:4kB shmem:12652kB writeback_tmp:0kB kernel_stack:14392kB pagetables:2816kB all_unreclaimable? no Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 DMA free:11264kB boost:0kB min:4kB low:16kB high:28kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: lowmem_reserve[]: 0 758 63056 63056 63056 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 DMA32 free:800480kB boost:0kB min:384kB low:1160kB high:1936kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1923200kB managed:807400kB mlocked:0kB bounce:0kB free_pcp:776kB local_pcp:0kB free_cma:0kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: lowmem_reserve[]: 0 0 62298 62298 62298 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 Normal free:61936036kB boost:0kB min:31748kB low:95540kB high:159332kB reserved_highatomic:0KB active_anon:2556kB inactive_anon:163948kB active_file:322572kB inactive_file:231956kB unevictable:3072kB writepending:0kB present:64997376kB managed:63800820kB mlocked:0kB bounce:0kB free_pcp:50680kB local_pcp:564kB free_cma:0kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: lowmem_reserve[]: 0 0 0 0 0 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 DMA32: 18*4kB (UM) 13*8kB (UM) 15*16kB (UM) 14*32kB (UM) 10*64kB (UM) 14*128kB (M) 14*256kB (UM) 8*512kB (M) 11*1024kB (UM) 10*2048kB (UM) 185*4096kB (M) = 800480kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 Normal: 14*4kB (UME) 1833*8kB (UME) 1567*16kB (UME) 934*32kB (UME) 532*64kB (UME) 324*128kB (UME) 114*256kB (UME) 48*512kB (UME) 32*1024kB (UME) 16*2048kB (UME) 15056*4096kB (UM) = 61933872kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 141796 total pagecache pages Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 0 pages in swap cache Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Swap cache stats: add 0, delete 0, find 0/0 Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Free swap = 12487676kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Total swap = 12487676kB Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 16734143 pages RAM Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 0 pages HighMem/MovableOnly Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 578248 pages reserved Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 0 pages cma reserved Dec 29 13:57:34 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: 0 pages hwpoisoned Dec 29 13:57:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Using default GUID 0x20af7fffe97b162 Dec 29 13:57:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Entering DISCOVERING state Dec 29 13:57:36 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48275]: Entering DISCOVERING state Dec 29 13:57:38 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com logger[48343]: List of m Tasks: Stop Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: ibwarn: [48275] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Error from osm_opensm_bind (0x2A) Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Perhaps another instance of OpenSM is already running Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48275]: Exiting SM Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48275]: Exiting SM Dec 29 13:57:40 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com logger[48346]: List of t Tasks: Start Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sysrq: Show State Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:systemd state:S stack: 0 pid: 1 ppid: 0 flags:0x00000002 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xa8/0xf0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ksys_read+0x62/0xe0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ksys_read+0x62/0xe0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f057fe9cb0e Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd6f19ce50 EFLAGS: 00000293 ORIG_RAX: 00000000000000e8 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000055f251e3b7f0 RCX: 00007f057fe9cb0e Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000005a RSI: 000055f251efb0d0 RDI: 0000000000000004 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000055f251e3b980 R08: 0000000000000000 R09: ac512d8daf65c98f Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000293 R12: 000000000000021c Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f251e3b7f0 R14: 000000000000005a R15: 0000000000000036 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kthreadd state:S stack: 0 pid: 2 ppid: 0 flags:0x00004000 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthreadd+0x2ab/0x2c0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_is_per_cpu+0x30/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_gp state:I stack: 0 pid: 3 ppid: 2 flags:0x00004000 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_par_gp state:I stack: 0 pid: 4 ppid: 2 flags:0x00004000 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:41 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:slub_flushwq state:I stack: 0 pid: 5 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:netns state:I stack: 0 pid: 6 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/0:0H state:I stack: 0 pid: 8 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/0:1H state:I stack: 0 pid: 10 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:mm_percpu_wq state:I stack: 0 pid: 11 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_tasks_kthre state:I stack: 0 pid: 13 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_tasks_invoke_cbs_wq+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_tasks_kthread+0x49/0x110 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_tasks_rude_ state:I stack: 0 pid: 14 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_tasks_invoke_cbs_wq+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_tasks_kthread+0x49/0x110 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_tasks_trace state:I stack: 0 pid: 15 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_tasks_invoke_cbs_wq+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_tasks_kthread+0x49/0x110 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/0 state:S stack: 0 pid: 16 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/0 state:S stack: 0 pid: 17 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:pr/ttyS0 state:S stack: 0 pid: 18 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: printk_kthread_func.cold+0x1dc/0x27b Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? console_start+0x30/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcu_preempt state:I stack: 0 pid: 19 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_gp_init+0x580/0x580 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_gp_fqs_loop+0xfc/0x390 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_gp_kthread+0xdf/0x170 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcub/1 state:S stack: 0 pid: 20 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_boost_kthread+0x51/0x380 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_exp_handler+0xd0/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/0 state:S stack: 0 pid: 21 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/0 state:S stack: 0 pid: 22 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/0 state:S stack: 0 pid: 23 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/0 state:S stack: 0 pid: 25 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/1 state:S stack: 0 pid: 26 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/1 state:S stack: 0 pid: 27 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/1 state:S stack: 0 pid: 28 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/1 state:S stack: 0 pid: 29 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/1 state:S stack: 0 pid: 30 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/1 state:S stack: 0 pid: 31 ppid: 2 flags:0x00004000 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:42 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/1:0H state:I stack: 0 pid: 33 ppid: 2 flags:0x00004000 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/2 state:S stack: 0 pid: 34 ppid: 2 flags:0x00004000 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/2 state:S stack: 0 pid: 35 ppid: 2 flags:0x00004000 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/2 state:S stack: 0 pid: 36 ppid: 2 flags:0x00004000 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/2 state:S stack: 0 pid: 37 ppid: 2 flags:0x00004000 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:57:43 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: ------------------------------------------------- Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: OpenSM 3.3.24 Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Command Line Arguments: Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Log File: /var/log/opensm.log Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: ------------------------------------------------- Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: OpenSM 3.3.24 Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48360]: /var/log/opensm.log log file opened Dec 29 13:58:10 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48360]: OpenSM 3.3.24 Dec 29 13:58:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Using default GUID 0x20af7fffe97b162 Dec 29 13:58:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Entering DISCOVERING state Dec 29 13:58:13 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48360]: Entering DISCOVERING state Dec 29 13:58:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: ibwarn: [48360] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:58:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Error from osm_opensm_bind (0x2A) Dec 29 13:58:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Perhaps another instance of OpenSM is already running Dec 29 13:58:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48360]: Exiting SM Dec 29 13:58:15 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48360]: Exiting SM Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: ------------------------------------------------- Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: OpenSM 3.3.24 Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Reading Cached Option File: /etc/rdma/opensm.conf Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Command Line Arguments: Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Log File: /var/log/opensm.log Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: ------------------------------------------------- Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: OpenSM 3.3.24 Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48429]: /var/log/opensm.log log file opened Dec 29 13:58:45 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48429]: OpenSM 3.3.24 Dec 29 13:58:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Using default GUID 0x20af7fffe97b162 Dec 29 13:58:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Entering DISCOVERING state Dec 29 13:58:48 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48429]: Entering DISCOVERING state Dec 29 13:58:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: ibwarn: [48429] get_abi_version: can't read ABI version from /sys/class/infiniband_mad/abi_version (No such file or directory): is ib_umad module loaded? Dec 29 13:58:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Error from osm_opensm_bind (0x2A) Dec 29 13:58:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Perhaps another instance of OpenSM is already running Dec 29 13:58:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com OpenSM[48429]: Exiting SM Dec 29 13:58:50 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com opensm-launch[48429]: Exiting SM Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sched: RT throttling activated Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/2 state:S stack: 0 pid: 38 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/2 state:S stack: 0 pid: 39 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/2:0H state:I stack: 0 pid: 41 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/3 state:S stack: 0 pid: 42 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/3 state:S stack: 0 pid: 43 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/3 state:S stack: 0 pid: 44 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/3 state:S stack: 0 pid: 45 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/3 state:S stack: 0 pid: 46 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/3 state:S stack: 0 pid: 47 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/3:0H state:I stack: 0 pid: 49 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? lock_timer_base+0x61/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/4 state:S stack: 0 pid: 50 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/4 state:S stack: 0 pid: 51 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/4 state:S stack: 0 pid: 52 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/4 state:S stack: 0 pid: 53 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/4 state:S stack: 0 pid: 54 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/4 state:S stack: 0 pid: 55 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/4:0H state:I stack: 0 pid: 57 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/5 state:S stack: 0 pid: 58 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/5 state:S stack: 0 pid: 59 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/5 state:S stack: 0 pid: 60 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/5 state:S stack: 0 pid: 61 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/5 state:S stack: 0 pid: 62 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/5 state:S stack: 0 pid: 63 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/5:0 state:I stack: 0 pid: 64 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/5:0H state:I stack: 0 pid: 65 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/6 state:S stack: 0 pid: 66 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/6 state:S stack: 0 pid: 67 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/6 state:S stack: 0 pid: 68 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/6 state:S stack: 0 pid: 69 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/6 state:S stack: 0 pid: 70 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/6 state:S stack: 0 pid: 71 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/6:0H state:I stack: 0 pid: 73 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/7 state:S stack: 0 pid: 74 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/7 state:S stack: 0 pid: 75 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/7 state:S stack: 0 pid: 76 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/7 state:S stack: 0 pid: 77 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/7 state:S stack: 0 pid: 78 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/7 state:S stack: 0 pid: 79 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/7:0H state:I stack: 0 pid: 81 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/8 state:S stack: 0 pid: 82 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/8 state:S stack: 0 pid: 83 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/8 state:S stack: 0 pid: 84 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/8 state:S stack: 0 pid: 85 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/8 state:S stack: 0 pid: 86 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/8 state:S stack: 0 pid: 87 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/8:0H state:I stack: 0 pid: 89 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/9 state:S stack: 0 pid: 90 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/9 state:S stack: 0 pid: 91 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/9 state:S stack: 0 pid: 92 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/9 state:S stack: 0 pid: 93 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/9 state:S stack: 0 pid: 94 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/9 state:S stack: 0 pid: 95 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/9:0 state:I stack: 0 pid: 96 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/9:0H state:I stack: 0 pid: 97 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/10 state:S stack: 0 pid: 98 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/10 state:S stack: 0 pid: 99 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/10 state:S stack: 0 pid: 100 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/10 state:S stack: 0 pid: 101 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/10 state:S stack: 0 pid: 102 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/10 state:S stack: 0 pid: 103 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/10:0H state:I stack: 0 pid: 105 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/11 state:S stack: 0 pid: 106 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/11 state:S stack: 0 pid: 107 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/11 state:S stack: 0 pid: 108 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/11 state:S stack: 0 pid: 109 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/11 state:S stack: 0 pid: 110 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/11 state:S stack: 0 pid: 111 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/11:0 state:I stack: 0 pid: 112 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/11:0H state:I stack: 0 pid: 113 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/12 state:S stack: 0 pid: 114 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/12 state:S stack: 0 pid: 115 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/12 state:S stack: 0 pid: 116 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/12 state:S stack: 0 pid: 117 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/12 state:S stack: 0 pid: 118 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/12 state:S stack: 0 pid: 119 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/12:0 state:I stack: 0 pid: 120 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/12:0H state:I stack: 0 pid: 121 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/13 state:S stack: 0 pid: 122 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/13 state:S stack: 0 pid: 123 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/13 state:S stack: 0 pid: 124 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/13 state:S stack: 0 pid: 125 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/13 state:S stack: 0 pid: 126 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/13 state:S stack: 0 pid: 127 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/13:0H state:I stack: 0 pid: 129 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/14 state:S stack: 0 pid: 130 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/14 state:S stack: 0 pid: 131 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/14 state:S stack: 0 pid: 132 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/14 state:S stack: 0 pid: 133 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/14 state:S stack: 0 pid: 134 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/14 state:S stack: 0 pid: 135 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/14:0H state:I stack: 0 pid: 137 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/15 state:S stack: 0 pid: 138 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/15 state:S stack: 0 pid: 139 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/15 state:S stack: 0 pid: 140 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/15 state:S stack: 0 pid: 141 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/15 state:S stack: 0 pid: 142 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/15 state:S stack: 0 pid: 143 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __set_cpus_allowed_ptr+0x54/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/15:0H state:I stack: 0 pid: 145 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/16 state:S stack: 0 pid: 146 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/16 state:R running task stack: 0 pid: 147 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/16 state:S stack: 0 pid: 148 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/16 state:S stack: 0 pid: 149 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/16 state:S stack: 0 pid: 150 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/16 state:R running task stack: 0 pid: 151 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/16:0H state:I stack: 0 pid: 153 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcub/2 state:D stack: 0 pid: 154 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock_block.constprop.0+0x33/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock.constprop.0+0xd9/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_boost_kthread+0xd1/0x380 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_exp_handler+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/17 state:S stack: 0 pid: 155 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/17 state:S stack: 0 pid: 156 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/17 state:S stack: 0 pid: 157 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/17 state:S stack: 0 pid: 158 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/17 state:S stack: 0 pid: 159 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/17 state:S stack: 0 pid: 160 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/17:0 state:I stack: 0 pid: 161 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/17:0H state:I stack: 0 pid: 162 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/18 state:S stack: 0 pid: 163 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/18 state:S stack: 0 pid: 164 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/18 state:S stack: 0 pid: 165 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/18 state:S stack: 0 pid: 166 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/18 state:S stack: 0 pid: 167 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/18 state:S stack: 0 pid: 168 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/18:0H state:I stack: 0 pid: 170 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/19 state:S stack: 0 pid: 171 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/19 state:S stack: 0 pid: 172 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/19 state:S stack: 0 pid: 173 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/19 state:S stack: 0 pid: 174 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/19 state:S stack: 0 pid: 175 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/19 state:S stack: 0 pid: 176 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/19:0H state:I stack: 0 pid: 178 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/20 state:S stack: 0 pid: 179 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/20 state:S stack: 0 pid: 180 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/20 state:S stack: 0 pid: 181 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/20 state:S stack: 0 pid: 182 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/20 state:S stack: 0 pid: 183 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/20 state:S stack: 0 pid: 184 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/20:0H state:I stack: 0 pid: 186 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/21 state:S stack: 0 pid: 187 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/21 state:S stack: 0 pid: 188 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/21 state:S stack: 0 pid: 189 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/21 state:S stack: 0 pid: 190 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/21 state:S stack: 0 pid: 191 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/21 state:S stack: 0 pid: 192 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/21:0H state:I stack: 0 pid: 194 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/22 state:S stack: 0 pid: 195 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/22 state:S stack: 0 pid: 196 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/22 state:S stack: 0 pid: 197 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/22 state:S stack: 0 pid: 198 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/22 state:S stack: 0 pid: 199 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/22 state:S stack: 0 pid: 200 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/22:0H state:I stack: 0 pid: 202 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/23 state:S stack: 0 pid: 203 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/23 state:S stack: 0 pid: 204 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/23 state:S stack: 0 pid: 205 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/23 state:S stack: 0 pid: 206 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/23 state:S stack: 0 pid: 207 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/23 state:S stack: 0 pid: 208 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/23:0 state:I stack: 0 pid: 209 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/23:0H state:I stack: 0 pid: 210 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/24 state:S stack: 0 pid: 211 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/24 state:S stack: 0 pid: 212 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/24 state:S stack: 0 pid: 213 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/24 state:S stack: 0 pid: 214 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/24 state:S stack: 0 pid: 215 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/24 state:S stack: 0 pid: 216 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/24:0 state:I stack: 0 pid: 217 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/24:0H state:I stack: 0 pid: 218 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/25 state:S stack: 0 pid: 219 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/25 state:S stack: 0 pid: 220 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/25 state:S stack: 0 pid: 221 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/25 state:S stack: 0 pid: 222 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/25 state:S stack: 0 pid: 223 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/25 state:S stack: 0 pid: 224 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/25:0 state:I stack: 0 pid: 225 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/25:0H state:I stack: 0 pid: 226 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/26 state:S stack: 0 pid: 227 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/26 state:S stack: 0 pid: 228 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/26 state:S stack: 0 pid: 229 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/26 state:S stack: 0 pid: 230 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/26 state:S stack: 0 pid: 231 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/26 state:S stack: 0 pid: 232 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x134/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/26:0 state:I stack: 0 pid: 233 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/26:0H state:I stack: 0 pid: 234 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/27 state:S stack: 0 pid: 235 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/27 state:S stack: 0 pid: 236 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/27 state:S stack: 0 pid: 237 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/27 state:S stack: 0 pid: 238 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/27 state:S stack: 0 pid: 239 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/27 state:S stack: 0 pid: 240 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/27:0H state:I stack: 0 pid: 242 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/28 state:S stack: 0 pid: 243 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/28 state:S stack: 0 pid: 244 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/28 state:S stack: 0 pid: 245 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/28 state:S stack: 0 pid: 246 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/28 state:S stack: 0 pid: 247 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/28 state:S stack: 0 pid: 248 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/28:0 state:I stack: 0 pid: 249 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/28:0H state:I stack: 0 pid: 250 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/29 state:S stack: 0 pid: 251 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/29 state:S stack: 0 pid: 252 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/29 state:S stack: 0 pid: 253 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/29 state:S stack: 0 pid: 254 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/29 state:S stack: 0 pid: 255 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/29 state:S stack: 0 pid: 256 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __set_cpus_allowed_ptr+0x54/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/29:0H state:I stack: 0 pid: 258 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/30 state:S stack: 0 pid: 259 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/30 state:S stack: 0 pid: 260 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/30 state:S stack: 0 pid: 261 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/30 state:S stack: 0 pid: 262 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/30 state:S stack: 0 pid: 263 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/30 state:S stack: 0 pid: 264 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/30:0H state:I stack: 0 pid: 266 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/31 state:S stack: 0 pid: 267 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/31 state:S stack: 0 pid: 268 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/31 state:S stack: 0 pid: 269 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/31 state:S stack: 0 pid: 270 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/31 state:S stack: 0 pid: 271 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/31 state:S stack: 0 pid: 272 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/31:0 state:I stack: 0 pid: 273 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/31:0H state:I stack: 0 pid: 274 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? lock_timer_base+0x61/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/32 state:S stack: 0 pid: 275 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/32 state:S stack: 0 pid: 276 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/32 state:S stack: 0 pid: 277 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/32 state:S stack: 0 pid: 278 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/32 state:S stack: 0 pid: 279 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/32 state:S stack: 0 pid: 280 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/32:0 state:I stack: 0 pid: 281 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/32:0H state:I stack: 0 pid: 282 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcub/3 state:S stack: 0 pid: 283 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_exp_handler+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rcu_boost_kthread+0x51/0x380 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_exp_handler+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/33 state:S stack: 0 pid: 284 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/33 state:S stack: 0 pid: 285 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/33 state:S stack: 0 pid: 286 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/33 state:S stack: 0 pid: 287 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/33 state:S stack: 0 pid: 288 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/33 state:S stack: 0 pid: 289 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/33:0H state:I stack: 0 pid: 291 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/34 state:S stack: 0 pid: 292 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/34 state:S stack: 0 pid: 293 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/34 state:S stack: 0 pid: 294 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/34 state:S stack: 0 pid: 295 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/34 state:S stack: 0 pid: 296 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/34 state:S stack: 0 pid: 297 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/34:0H state:I stack: 0 pid: 299 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/35 state:S stack: 0 pid: 300 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/35 state:S stack: 0 pid: 301 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/35 state:S stack: 0 pid: 302 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/35 state:S stack: 0 pid: 303 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/35 state:S stack: 0 pid: 304 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/35 state:S stack: 0 pid: 305 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/35:0H state:I stack: 0 pid: 307 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/36 state:S stack: 0 pid: 308 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/36 state:S stack: 0 pid: 309 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/36 state:S stack: 0 pid: 310 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/36 state:S stack: 0 pid: 311 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/36 state:S stack: 0 pid: 312 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/36 state:S stack: 0 pid: 313 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/37 state:S stack: 0 pid: 316 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/37 state:S stack: 0 pid: 317 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/37 state:S stack: 0 pid: 318 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/37 state:S stack: 0 pid: 319 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/37 state:S stack: 0 pid: 320 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/37 state:S stack: 0 pid: 321 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/37:0H state:I stack: 0 pid: 323 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/38 state:S stack: 0 pid: 324 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/38 state:S stack: 0 pid: 325 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/38 state:S stack: 0 pid: 326 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/38 state:S stack: 0 pid: 327 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/38 state:S stack: 0 pid: 328 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/38 state:S stack: 0 pid: 329 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/38:0H state:I stack: 0 pid: 331 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/39 state:S stack: 0 pid: 332 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/39 state:S stack: 0 pid: 333 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/39 state:S stack: 0 pid: 334 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/39 state:S stack: 0 pid: 335 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/39 state:S stack: 0 pid: 336 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/39 state:S stack: 0 pid: 337 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/39:0 state:I stack: 0 pid: 338 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? lock_timer_base+0x61/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/39:0H state:I stack: 0 pid: 339 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/40 state:S stack: 0 pid: 340 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/40 state:S stack: 0 pid: 341 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/40 state:S stack: 0 pid: 342 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/40 state:S stack: 0 pid: 343 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/40 state:S stack: 0 pid: 344 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/40 state:S stack: 0 pid: 345 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/40:0H state:I stack: 0 pid: 347 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/41 state:S stack: 0 pid: 348 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/41 state:S stack: 0 pid: 349 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/41 state:S stack: 0 pid: 350 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/41 state:S stack: 0 pid: 351 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/41 state:S stack: 0 pid: 352 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/41 state:S stack: 0 pid: 353 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/41:0H state:I stack: 0 pid: 355 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/42 state:S stack: 0 pid: 356 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/42 state:S stack: 0 pid: 357 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/42 state:S stack: 0 pid: 358 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/42 state:S stack: 0 pid: 359 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/42 state:S stack: 0 pid: 360 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/42 state:S stack: 0 pid: 361 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/42:0H state:I stack: 0 pid: 363 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/43 state:S stack: 0 pid: 364 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/43 state:S stack: 0 pid: 365 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/43 state:S stack: 0 pid: 366 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/43 state:S stack: 0 pid: 367 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/43 state:S stack: 0 pid: 368 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/43 state:S stack: 0 pid: 369 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/43:0H state:I stack: 0 pid: 371 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/44 state:S stack: 0 pid: 372 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/44 state:S stack: 0 pid: 373 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/44 state:S stack: 0 pid: 374 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/44 state:S stack: 0 pid: 375 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/44 state:S stack: 0 pid: 376 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/44 state:S stack: 0 pid: 377 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/44:0H state:I stack: 0 pid: 379 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/45 state:S stack: 0 pid: 380 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/45 state:S stack: 0 pid: 381 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/45 state:S stack: 0 pid: 382 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/45 state:S stack: 0 pid: 383 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/45 state:S stack: 0 pid: 384 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/45 state:S stack: 0 pid: 385 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/45:0H state:I stack: 0 pid: 387 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/46 state:S stack: 0 pid: 388 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/46 state:S stack: 0 pid: 389 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/46 state:S stack: 0 pid: 390 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/46 state:S stack: 0 pid: 391 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/46 state:S stack: 0 pid: 392 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/46 state:S stack: 0 pid: 393 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/46:0H state:I stack: 0 pid: 395 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cpuhp/47 state:S stack: 0 pid: 396 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq_work/47 state:S stack: 0 pid: 397 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:migration/47 state:S stack: 0 pid: 398 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Stopper: 0x0 <- 0x0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rcuc/47 state:S stack: 0 pid: 399 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ktimers/47 state:S stack: 0 pid: 400 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksoftirqd/47 state:S stack: 0 pid: 401 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: smpboot_thread_fn+0xe0/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? smpboot_register_percpu_thread+0xf0/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/47:0H state:I stack: 0 pid: 403 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kdevtmpfs state:S stack: 0 pid: 452 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: devtmpfs_work_loop+0x275/0x280 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? dmar_validate_one_drhd+0xb0/0xb0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: devtmpfsd+0x25/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:inet_frag_wq state:I stack: 0 pid: 453 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kauditd state:S stack: 0 pid: 454 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kauditd_thread+0x1d0/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? auditd_reset+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/31:2 state:I stack: 0 pid: 458 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:khungtaskd state:S stack: 0 pid: 459 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? check_hung_uninterruptible_tasks+0x300/0x300 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: watchdog+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:oom_reaper state:S stack: 0 pid: 460 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __oom_reap_task_mm+0x140/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: oom_reaper+0x1ab/0x460 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __oom_reap_task_mm+0x140/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:writeback state:I stack: 0 pid: 461 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kcompactd0 state:S stack: 0 pid: 462 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kcompactd+0x395/0x420 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kcompactd_do_work+0x300/0x300 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ksmd state:S stack: 0 pid: 463 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cmp_and_merge_page+0x6a0/0x6a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksm_scan_thread+0x313/0x350 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:cryptd state:I stack: 0 pid: 464 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kintegrityd state:I stack: 0 pid: 465 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kblockd state:I stack: 0 pid: 466 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/27:1 state:I stack: 0 pid: 467 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:blkcg_punt_bio state:I stack: 0 pid: 468 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/9-acpi state:S stack: 0 pid: 469 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tpm_dev_wq state:I stack: 0 pid: 471 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:md state:I stack: 0 pid: 472 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:edac-poller state:I stack: 0 pid: 473 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:watchdogd state:S stack: 0 pid: 474 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread_worker_fn+0x136/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_delayed_work_timer_fn+0xb0/0xb0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/13:1 state:I stack: 0 pid: 475 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/13:1H state:I stack: 0 pid: 476 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/5:1 state:I stack: 0 pid: 477 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/26-AMD-Vi state:S stack: 0 pid: 479 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/26-s-AMD-Vi state:S stack: 0 pid: 480 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/27-AMD-Vi state:S stack: 0 pid: 481 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/27-s-AMD-Vi state:S stack: 0 pid: 482 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/28-AMD-Vi state:S stack: 0 pid: 483 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/28-s-AMD-Vi state:S stack: 0 pid: 484 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/29-AMD-Vi state:S stack: 0 pid: 485 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/29-s-AMD-Vi state:S stack: 0 pid: 486 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/29:1 state:I stack: 0 pid: 487 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kswapd0 state:S stack: 0 pid: 488 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kswapd_try_to_sleep+0x23d/0x250 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kswapd+0xa0/0x1c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? balance_pgdat+0x710/0x710 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kthrotld state:I stack: 0 pid: 496 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/12:2 state:I stack: 0 pid: 499 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/30-PCIe PME state:S stack: 0 pid: 503 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/31-PCIe PME state:S stack: 0 pid: 504 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/32-PCIe PME state:S stack: 0 pid: 505 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/34-PCIe PME state:S stack: 0 pid: 506 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/36-PCIe PME state:S stack: 0 pid: 507 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/37-PCIe PME state:S stack: 0 pid: 508 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/37-pciehp state:S stack: 0 pid: 509 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/37-s-pciehp state:S stack: 0 pid: 510 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/38-PCIe PME state:S stack: 0 pid: 511 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/40-PCIe PME state:S stack: 0 pid: 512 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/42-PCIe PME state:S stack: 0 pid: 513 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/43-PCIe PME state:S stack: 0 pid: 514 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/44-PCIe PME state:S stack: 0 pid: 515 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/45-PCIe PME state:S stack: 0 pid: 516 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/45-pciehp state:S stack: 0 pid: 517 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/45-s-pciehp state:S stack: 0 pid: 518 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? disable_irq_nosync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/47-PCIe PME state:S stack: 0 pid: 519 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/48-PCIe PME state:S stack: 0 pid: 520 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/49-PCIe PME state:S stack: 0 pid: 521 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/50-PCIe PME state:S stack: 0 pid: 522 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/52-PCIe PME state:S stack: 0 pid: 523 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/53-PCIe PME state:S stack: 0 pid: 524 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/1:1 state:I stack: 0 pid: 525 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/2:1 state:I stack: 0 pid: 526 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/3:1 state:I stack: 0 pid: 527 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/4:1 state:I stack: 0 pid: 528 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_power_efficient) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/6:1 state:I stack: 0 pid: 529 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/8:1 state:I stack: 0 pid: 530 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/9:1 state:I stack: 0 pid: 531 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/10:1 state:I stack: 0 pid: 532 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/11:1 state:I stack: 0 pid: 533 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/14:1 state:I stack: 0 pid: 534 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/16:1 state:I stack: 0 pid: 535 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/17:1 state:I stack: 0 pid: 536 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/18:1 state:I stack: 0 pid: 537 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/20:1 state:I stack: 0 pid: 539 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/22:1 state:I stack: 0 pid: 541 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/23:1 state:I stack: 0 pid: 542 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/24:1 state:I stack: 0 pid: 543 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/25:1 state:I stack: 0 pid: 544 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/26:1 state:I stack: 0 pid: 545 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/28:1 state:I stack: 0 pid: 546 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (xfs-reclaim/sda6) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/30:1 state:I stack: 0 pid: 547 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/32:1 state:I stack: 0 pid: 548 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/34:1 state:I stack: 0 pid: 550 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/35:1 state:I stack: 0 pid: 551 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/36:1 state:I stack: 0 pid: 552 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/38:1 state:I stack: 0 pid: 553 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/40:1 state:I stack: 0 pid: 555 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/41:1 state:I stack: 0 pid: 556 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/42:1 state:I stack: 0 pid: 557 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/43:1 state:I stack: 0 pid: 558 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/44:1 state:I stack: 0 pid: 559 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/45:1 state:I stack: 0 pid: 560 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/46:1 state:I stack: 0 pid: 561 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:acpi_thermal_pm state:I stack: 0 pid: 563 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kmpath_rdacd state:I stack: 0 pid: 564 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kaluad state:I stack: 0 pid: 565 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/55-ehci_hcd state:S stack: 0 pid: 566 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/57-xhci_hcd state:S stack: 0 pid: 567 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/58-xhci_hcd state:S stack: 0 pid: 568 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/59-xhci_hcd state:S stack: 0 pid: 569 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/60-xhci_hcd state:S stack: 0 pid: 570 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/61-xhci_hcd state:S stack: 0 pid: 571 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/62-xhci_hcd state:S stack: 0 pid: 572 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/63-xhci_hcd state:S stack: 0 pid: 573 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/64-xhci_hcd state:S stack: 0 pid: 574 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/25:1H state:I stack: 0 pid: 575 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/0:2 state:I stack: 0 pid: 576 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/66-xhci_hcd state:S stack: 0 pid: 577 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/67-xhci_hcd state:S stack: 0 pid: 578 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/68-xhci_hcd state:S stack: 0 pid: 579 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/69-xhci_hcd state:S stack: 0 pid: 580 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/70-xhci_hcd state:S stack: 0 pid: 581 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/71-xhci_hcd state:S stack: 0 pid: 582 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/72-xhci_hcd state:S stack: 0 pid: 583 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/73-xhci_hcd state:S stack: 0 pid: 584 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/33:1H state:I stack: 0 pid: 585 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/8-rtc0 state:S stack: 0 pid: 589 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/41:1H state:I stack: 0 pid: 590 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:mld state:I stack: 0 pid: 591 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/4:1H state:I stack: 0 pid: 592 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ipv6_addrconf state:I stack: 0 pid: 593 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kstrp state:I stack: 0 pid: 594 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:zswap-shrink state:I stack: 0 pid: 606 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/u97:0 state:I stack: 0 pid: 727 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (ib-comp-unb-wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/42:1H state:I stack: 0 pid: 729 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/19:1H state:I stack: 0 pid: 768 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/18:1H state:I stack: 0 pid: 770 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/20:1H state:I stack: 0 pid: 778 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/29:1H state:I stack: 0 pid: 781 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/45:1H state:I stack: 0 pid: 785 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/23:1H state:I stack: 0 pid: 794 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (xfs-log/sda6) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/43:1H state:I stack: 0 pid: 799 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/17:1H state:I stack: 0 pid: 830 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/16:1H state:I stack: 0 pid: 832 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/44:1H state:I stack: 0 pid: 846 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/38:1H state:I stack: 0 pid: 874 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/37:1H state:I stack: 0 pid: 946 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/46:1H state:I stack: 0 pid: 990 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/76-psp-1 state:S stack: 0 pid: 1001 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:uas state:I stack: 0 pid: 1002 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:scsi_eh_0 state:S stack: 0 pid: 1003 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: scsi_error_handler+0xd6/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? scsi_unjam_host+0x1d0/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:scsi_tmf_0 state:I stack: 0 pid: 1004 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:usb-storage state:S stack: 0 pid: 1005 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? complete+0x49/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: wait_for_completion_interruptible+0x20/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: usb_stor_control_thread+0x3d/0x2b0 [usb_storage] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usb_stor_scan_dwork+0xd0/0xd0 [usb_storage] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_pf_wq state:I stack: 0 pid: 1010 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/32:1H state:I stack: 0 pid: 1011 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/12:1H state:I stack: 0 pid: 1013 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/24:1H state:I stack: 0 pid: 1034 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/5:1H state:I stack: 0 pid: 1038 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (xfs-log/sda6) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/22:1H state:I stack: 0 pid: 1040 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/7:1H state:I stack: 0 pid: 1044 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/47:1H state:I stack: 0 pid: 1072 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/41:2 state:I stack: 0 pid: 1075 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/9:1H state:I stack: 0 pid: 1079 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/34:1H state:I stack: 0 pid: 1080 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/35:1H state:I stack: 0 pid: 1081 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/15:1H state:I stack: 0 pid: 1082 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/21:1H state:I stack: 0 pid: 1083 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/27:1H state:I stack: 0 pid: 1084 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/3:1H state:I stack: 0 pid: 1085 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/31:1H state:I stack: 0 pid: 1087 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/27:2 state:I stack: 0 pid: 1088 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfsalloc state:I stack: 0 pid: 1097 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs_mru_cache state:I stack: 0 pid: 1098 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-buf/sda6 state:I stack: 0 pid: 1099 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-conv/sda6 state:I stack: 0 pid: 1100 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-reclaim/sda state:I stack: 0 pid: 1101 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-blockgc/sda state:I stack: 0 pid: 1102 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-inodegc/sda state:I stack: 0 pid: 1103 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-log/sda6 state:I stack: 0 pid: 1104 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-cil/sda6 state:I stack: 0 pid: 1105 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfsaild/sda6 state:S stack: 0 pid: 1106 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xfsaild+0x109/0x1e0 [xfs] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfsaild_push+0x7b0/0x7b0 [xfs] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/10:1H state:I stack: 0 pid: 1107 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/40:1H state:I stack: 0 pid: 1137 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/18:2 state:I stack: 0 pid: 1138 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/11:1H state:I stack: 0 pid: 1155 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/28:1H state:I stack: 0 pid: 1170 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/36:1H state:I stack: 0 pid: 1171 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/14:1H state:I stack: 0 pid: 1178 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:systemd-journal state:S stack: 0 pid: 1182 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x9e/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x9e/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ksys_read+0x62/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f39433ecaca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffdc1820a98 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000562f2933c480 RCX: 00007f39433ecaca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000003e RSI: 0000562f2935dda0 RDI: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000562f2933c610 R08: 000000000000003e R09: 0000562f29341d8c Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 0000000000000136 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000562f2933c480 R14: 000000000000003e R15: 000000000000001f Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/1:1H state:I stack: 0 pid: 1189 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/2:1H state:I stack: 0 pid: 1190 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/26:1H state:I stack: 0 pid: 1194 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:systemd-udevd state:S stack: 0 pid: 1202 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x9e/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fe71f9c6aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffea89a2c88 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000562acc5b9f10 RCX: 00007fe71f9c6aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000000002b0 RSI: 0000562acc74dda0 RDI: 0000000000000009 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000562acc5ba0a0 R08: 00000000000002b0 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 000000000000005a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000562acc5b9f10 R14: 00000000000002b0 R15: 0000000000000009 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/21:2 state:I stack: 0 pid: 1203 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/20:2 state:I stack: 0 pid: 1250 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ipmi-msghandler state:I stack: 0 pid: 1321 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/2:2 state:I stack: 0 pid: 1322 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (inet_frag_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/136-0000:c2 state:S stack: 0 pid: 1325 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/138-0000:c3 state:S stack: 0 pid: 1326 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/139-0000:82 state:S stack: 0 pid: 1328 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/141-0000:81 state:S stack: 0 pid: 1329 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/142-0000:41 state:S stack: 0 pid: 1330 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/144-0000:42 state:S stack: 0 pid: 1331 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/145-0000:01 state:S stack: 0 pid: 1332 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/147-0000:02 state:S stack: 0 pid: 1333 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/54-hpilo state:S stack: 0 pid: 1339 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/29:2 state:I stack: 0 pid: 1347 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kipmi0 state:S stack: 0 pid: 1351 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ipmi_thread+0x1a1/0x1b0 [ipmi_si] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? flush_messages+0x40/0x40 [ipmi_si] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/6:1H state:I stack: 0 pid: 1363 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (xfs-log/sda6) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/39:1H state:I stack: 0 pid: 1366 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib-comp-wq state:I stack: 0 pid: 1372 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib-comp-unb-wq state:I stack: 0 pid: 1373 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib_mcast state:I stack: 0 pid: 1374 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib_nl_sa_wq state:I stack: 0 pid: 1375 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/8:1H state:I stack: 0 pid: 1382 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/34:2 state:I stack: 0 pid: 1388 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/10:2 state:I stack: 0 pid: 1394 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_re state:I stack: 0 pid: 1396 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/148-bnxt_qp state:S stack: 0 pid: 1397 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1404 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/149-bnxt_qp state:S stack: 0 pid: 1405 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1406 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/150-bnxt_qp state:S stack: 0 pid: 1407 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1408 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/151-bnxt_qp state:S stack: 0 pid: 1409 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1410 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/152-bnxt_qp state:S stack: 0 pid: 1411 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1412 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/153-bnxt_qp state:S stack: 0 pid: 1413 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1414 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/154-bnxt_qp state:S stack: 0 pid: 1415 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1416 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/155-bnxt_qp state:S stack: 0 pid: 1417 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1418 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/156-bnxt_qp state:S stack: 0 pid: 1419 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/157-bnxt_qp state:S stack: 0 pid: 1420 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1426 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/158-bnxt_qp state:S stack: 0 pid: 1427 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1428 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/159-bnxt_qp state:S stack: 0 pid: 1429 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1430 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/160-bnxt_qp state:S stack: 0 pid: 1431 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1432 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/161-bnxt_qp state:S stack: 0 pid: 1433 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1434 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/162-bnxt_qp state:S stack: 0 pid: 1435 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1436 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/163-bnxt_qp state:S stack: 0 pid: 1438 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1439 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/164-bnxt_qp state:S stack: 0 pid: 1440 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bnxt_qplib_nq state:I stack: 0 pid: 1441 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/165-bnxt_qp state:S stack: 0 pid: 1442 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib_mad1 state:I stack: 0 pid: 1448 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rdma-ndd state:S stack: 0 pid: 1454 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? avc_alloc_node+0x27/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_iter+0xc1/0x6c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? mod_objcg_state+0xd4/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? current_time+0x2b/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __seccomp_filter+0x45/0x470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x9e/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f06a6d59987 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fffc8a72468 EFLAGS: 00000246 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007fffc8a72490 RCX: 00007f06a6d59987 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 00007fffc8a72480 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000005 R08: 000056156fbe52d0 R09: 0000000000000001 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00007fffc8a72490 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000004 R14: 0000000000000001 R15: 000056156ed8e0fc Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ib_mad1 state:I stack: 0 pid: 1457 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rdma_cm state:I stack: 0 pid: 1463 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:iscsi_conn_clea state:I stack: 0 pid: 1468 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:target_completi state:I stack: 0 pid: 1477 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:target_submissi state:I stack: 0 pid: 1478 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xcopy_wq state:I stack: 0 pid: 1479 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpciod state:I stack: 0 pid: 1498 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xprtiod state:I stack: 0 pid: 1499 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-buf/sda2 state:I stack: 0 pid: 1530 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-conv/sda2 state:I stack: 0 pid: 1531 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-reclaim/sda state:I stack: 0 pid: 1532 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-blockgc/sda state:I stack: 0 pid: 1533 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-inodegc/sda state:I stack: 0 pid: 1534 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-log/sda2 state:I stack: 0 pid: 1536 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-cil/sda2 state:I stack: 0 pid: 1537 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfsaild/sda2 state:S stack: 0 pid: 1538 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xfsaild+0x17c/0x1e0 [xfs] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfsaild_push+0x7b0/0x7b0 [xfs] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/40:2 state:I stack: 0 pid: 1552 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/30:1H state:I stack: 0 pid: 1555 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_highpri) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/4:2 state:I stack: 0 pid: 1562 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:jbd2/sda3-8 state:S stack: 0 pid: 1564 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kjournald2+0x22a/0x290 [jbd2] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? jbd2_journal_release_jbd_inode+0x150/0x150 [jbd2] Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:ext4-rsv-conver state:I stack: 0 pid: 1565 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1a/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpcbind state:S stack: 0 pid: 1572 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? recalibrate_cpu_khz+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ktime_get_ts64+0x4c/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0xa6/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f980706c987 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffecef49468 EFLAGS: 00000246 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007ffecef494b0 RCX: 00007f980706c987 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000007530 RSI: 0000000000000007 RDI: 00007ffecef49470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffecef49570 R08: 0000561035657d30 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffecef48d10 R11: 0000000000000246 R12: 00007ffecef49470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffecef49520 R14: 00005610338107ec R15: 0000000000000020 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:auditd state:S stack: 0 pid: 1573 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __filemap_get_folio+0x15a/0x330 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? filemap_dirty_folio+0x73/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? core_sys_select+0x35a/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x77/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? fpregs_restore_userregs+0x53/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f42b1ea211d Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffec1070060 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007ffec10700f0 RCX: 00007f42b1ea211d Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00005614a71b61b0 RSI: 00005614a71b2cc0 RDI: 0000000000000040 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00005614a71b2cc0 R08: 00007ffec1070070 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000040 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffec1070070 R14: 0000000000000000 R15: 00005614a71b61b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:auditd state:S stack: 0 pid: 1574 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? raw_spin_rq_unlock+0x18/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? finish_task_switch.isra.0+0x98/0x2f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __switch_to+0x12f/0x510 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __schedule+0x263/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f42b1df939a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f42b17dcb70 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f42b1df939a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 00005614a56bb108 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00005614a56bb108 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:dbus-broker-lau state:S stack: 0 pid: 1594 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f9aa4486aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc0c81d7b8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000555816e209a0 RCX: 00007f9aa4486aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000016 RSI: 0000555816e71320 RDI: 0000000000000005 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000555816e20b30 R08: 0000000000000016 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 000000000000006e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000555816e209a0 R14: 0000000000000016 R15: 000000000000000b Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:dbus-broker state:S stack: 0 pid: 1595 ppid: 1594 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fb84d833aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd58157488 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000564027715e38 RCX: 00007fb84d833aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000000b RSI: 00007ffd58157490 RDI: 0000000000000005 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffd58157560 R08: 0000000000000001 R09: ffffffffffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000000000000000b R14: 00007ffd58157490 R15: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:NetworkManager state:S stack: 0 pid: 1596 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0xa6/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd7c8d5540 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f4e5d5b0071 RCX: 00007f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000062ccc RSI: 0000000000000013 RDI: 0000557c5535ac00 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000557c5535ac00 R08: 0000000000000000 R09: 00007ffd7c8d53d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffd7c9d2080 R11: 0000000000000293 R12: 0000000000000013 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000013 R14: 00007ffd7c8d55b0 R15: 0000557c551fab60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid: 1667 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unwind_next_frame+0x354/0x6f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __kernel_text_address+0xe/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unwind_get_return_address+0x1f/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? create_prof_cpu_mask+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? arch_stack_walk+0x9e/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sched_clock_cpu+0xb/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? metadata_update_state+0x69/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kfence_guarded_alloc+0x1c2/0x3f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unwind_next_frame+0x354/0x6f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __is_insn_slot_addr+0x43/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? is_bpf_text_address+0x1f/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kernel_text_address+0xf0/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __kernel_text_address+0xe/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unwind_get_return_address+0x1f/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? create_prof_cpu_mask+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? arch_stack_walk+0x9e/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? stack_trace_save+0x4b/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sched_clock_cpu+0xb/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? recalibrate_cpu_khz+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ktime_get_ts64+0x4c/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0xa6/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? inotify_find_inode+0x25/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __x64_sys_inotify_add_watch+0x10b/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f4e5bf5bf80 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f4e5d5b0071 RCX: 00007f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000f9c RSI: 0000000000000002 RDI: 0000557c551f9d40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000557c551f9d40 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffd7c9d2080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007f4e5bf5bff0 R15: 0000557c551fac90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gdbus state:S stack: 0 pid: 1670 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sock_def_readable+0x3c/0x80 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unix_stream_sendmsg+0x476/0x4b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x7c/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_futex+0xf7/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f4e5b75af80 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f4e5d5b0071 RCX: 00007f4e5d41f9bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000003 RDI: 0000557c5520ff20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000557c5520ff20 R08: 0000000000000000 R09: 00007f4e5b75ae10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffd7c9d2080 R11: 0000000000000293 R12: 0000000000000003 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000003 R14: 00007f4e5b75aff0 R15: 0000557c5520dd90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irqbalance state:S stack: 0 pid: 1599 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? memcg_slab_post_alloc_hook+0x181/0x250 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? bitmap_string.constprop.0+0xd2/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? seq_read_iter+0x209/0x4b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? mod_objcg_state+0xd4/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? mod_objcg_state+0xd4/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __seccomp_filter+0x45/0x470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? recalibrate_cpu_khz+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ktime_get_ts64+0x4c/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0xa6/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f7867f629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe1d4849e0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f78681bf071 RCX: 00007f7867f629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000002703 RSI: 0000000000000002 RDI: 00005587f284f2f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00005587f284f2f0 R08: 0000000000000000 R09: 00007ffe1d484870 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffe1d4ba080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007ffe1d484a50 R15: 00005587f284ff60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid: 1609 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rmqueue+0x4a7/0xe40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __seccomp_filter+0x45/0x470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __seccomp_filter+0x45/0x470 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f7867f629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f7867da1d00 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f78681bf071 RCX: 00007f7867f629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 00005587f284f7f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00005587f284f7f0 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffe1d4ba080 R11: 0000000000000293 R12: 0000000000000001 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000001 R14: 00007f7867da1d70 R15: 00005587f2856140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:polkitd state:S stack: 0 pid: 1602 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? poll_freewait+0x45/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x7c/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc27a7c1d0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f0576a89071 RCX: 00007f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 0000556fd72b9270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000556fd72b9270 R08: 0000000000000000 R09: 00007ffc27a7c060 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc27bbd080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007ffc27a7c240 R15: 0000556fd71cefa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid: 1668 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? poll_freewait+0x45/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? fpregs_restore_userregs+0x12/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f0573db7b40 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f0576a89071 RCX: 00007f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 0000556fd71cec50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000556fd71cec50 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc27bbd080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007f0573db7bb0 R15: 0000556fd71ceb40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gdbus state:S stack: 0 pid: 1669 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __wake_up_common+0x80/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_read+0x13c/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05735b6b40 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f0576a89071 RCX: 00007f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 0000556fd71e3d10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000556fd71e3d10 R08: 0000000000000000 R09: 00007f05735b69d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc27bbd080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007f05735b6bb0 R15: 0000556fd71e17e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1673 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x4a/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x151/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f0572db5a40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1674 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? alloc_cpumask_var_node+0x1b/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? avc_has_perm+0x8f/0x1b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f0572bb6a40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1675 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __schedule+0x263/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_futex+0xf7/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05729b7a40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1676 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? mod_objcg_state+0xd4/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05727b8a40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1677 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x151/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_futex+0xf7/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05725b9a40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1678 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? native_flush_tlb_local+0x2c/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? flush_tlb_func+0xd6/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sched_clock_cpu+0xb/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05723baa40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1679 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x151/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_futex+0xf7/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f05721bba40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:JS Helper state:S stack: 0 pid: 1680 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x4a/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x151/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f0571fbca40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f05749bc39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 0000556fd71b8ac8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000556fd71b8ac8 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:polkitd state:S stack: 0 pid: 1703 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f0571dbdb30 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f0576a89071 RCX: 00007f0574a629bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 0000556fd72feca0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000556fd72feca0 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc27bbd080 R11: 0000000000000293 R12: 0000000000000001 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000001 R14: 00007f0571dbdba0 R15: 0000556fd73b37a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rsyslogd state:S stack: 0 pid: 1604 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? check_preempt_curr+0x33/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ttwu_do_wakeup+0x17/0x1a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_to_wake_up+0xb4/0x680 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? autoremove_wake_function+0x30/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __wake_up_common+0x80/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_read_unlock+0x31/0x1a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? core_sys_select+0x1a0/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? recalibrate_cpu_khz+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x5d/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f3a7c423292 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe8012b870 EFLAGS: 00000293 ORIG_RAX: 000000000000010e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007ffe8012b910 RCX: 00007f3a7c423292 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffe8012b920 R08: 00007ffe8012b8a0 R09: 00007ffe8012b8b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055e909ae1240 R14: 0000000000000000 R15: 00007f3a7c658000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:in:imjournal state:S stack: 0 pid: 1629 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __filemap_get_folio+0x2c2/0x330 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? update_load_avg+0x80/0x7e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_entity+0x1a1/0x4c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? inotify_read+0x139/0x280 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sched_feat_write+0x190/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_read+0x97/0x190 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_ppoll+0xbc/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f3a7c420abe Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f3a7b36bb10 EFLAGS: 00000293 ORIG_RAX: 000000000000010f Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f3a7b36bbb0 RCX: 00007f3a7c420abe Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00007f3a7b36bb30 RSI: 0000000000000001 RDI: 00007f3a7b36bbb0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000008 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 00007f3a7b36bbb0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007f3a7b36bb30 R14: 00007f3a7b36bc60 R15: 00007f3a6c01dc10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rs:main Q:Reg state:S stack: 0 pid: 1634 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? up_write+0x2a/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f3a7c37a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f3a7af6ab40 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f3a7c37a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055e90a430a40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055e90a430a44 R14: 0000000000000001 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:systemd-logind state:S stack: 0 pid: 1607 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f5fd3ff8aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc485fe6c8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000557425392b80 RCX: 00007f5fd3ff8aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000022 RSI: 00005574253a1d10 RDI: 0000000000000004 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000557425392d10 R08: 0000000000000022 R09: 801db7477c0572da Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 00000000000000aa Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000557425392b80 R14: 0000000000000022 R15: 0000000000000011 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:systemd state:S stack: 0 pid: 1655 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_send_events+0x290/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? timerqueue_add+0x9b/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x1536f6487aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd4d8d2b28 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000055c7215137f0 RCX: 00001536f6487aca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000020 RSI: 000055c721566e40 RDI: 0000000000000004 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000055c721513980 R08: 0000000000000020 R09: d40b9b4328f78744 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 00000000000000be Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055c7215137f0 R14: 0000000000000020 R15: 0000000000000013 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:chronyd state:S stack: 0 pid: 1657 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? udp_recvmsg+0x9c/0x5f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? inet_recvmsg+0x11e/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? move_addr_to_user+0x4b/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ____sys_recvmsg+0x160/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? avc_has_perm_noaudit+0x94/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __check_object_size.part.0+0x35/0x160 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cred_has_capability.isra.0+0x78/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x77/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xa8/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fd9a869a089 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff4b5b8a10 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007fff4b5b8b00 RCX: 00007fd9a869a089 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007fff4b5b8c20 RDI: 0000000000000008 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007fff4b5b8c20 R08: 00007fff4b5b8a20 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000008 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fff4b5b8a20 R14: 00007fff4b5b8af0 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/37:2 state:I stack: 0 pid: 1658 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:(sd-pam) state:S stack: 0 pid: 1661 ppid: 1655 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sigtimedwait+0x16f/0x210 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_rt_sigtimedwait+0x76/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f057fda3aa8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd6f19c370 EFLAGS: 00000246 ORIG_RAX: 0000000000000080 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007ffd6f19c3a0 RCX: 00007f057fda3aa8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffd6f19c3a0 RDI: 00007ffd6f19c530 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffd6f19c3a0 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffd6f19c488 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffd6f19c530 R14: 0000000000000000 R15: 00007ffd6f19c490 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tuned state:S stack: 0 pid: 1683 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f568df5a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fffd2c3b120 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00005596138f8240 RCX: 00007f568df5a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000089 RDI: 00005596138f8240 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007fffd2c3b1e0 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000001 R14: 00007fffd2c3b160 R15: fffffffeffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tuned state:S stack: 0 pid: 2024 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f568df5a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f568c5b2f30 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f56840011f0 RCX: 00007f568df5a39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000089 RDI: 00007f56840011f0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007f568c5b2ff0 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000001 R14: 00007f568c5b2f70 R15: fffffffeffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tuned state:S stack: 0 pid: 2036 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_entity+0x1a1/0x4c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? default_send_IPI_single_phys+0x26/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? check_preempt_curr+0x33/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ttwu_do_wakeup+0x17/0x1a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_to_wake_up+0xb4/0x680 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x4a/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? futex_wake+0x151/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_futex+0xf7/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f568e0009bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f568bd720c0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: ffffffffffffffff RCX: 00007f568e0009bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 00007f568c6ad980 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007f568bd72110 R08: 0000000000000000 R09: 00007f568e404fe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 00007f568bd735c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007f568402a690 R14: 00007f568bd8d240 R15: 00007f568c6ad980 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tuned state:S stack: 0 pid: 2045 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? set_next_entity+0xda/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? pick_next_task_fair+0x41/0x490 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_charge_memcg+0x3e9/0x810 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_node_page_state+0x95/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_memcg_lruvec_state+0x78/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_anonymous_page+0x1ae/0x5b0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __handle_mm_fault+0x1ad/0x240 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f568e0009bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007f568b571110 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f568cdc9071 RCX: 00007f568e0009bf Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000002 RDI: 00007f5680002f90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007f5680002f90 R08: 0000000000000000 R09: 00007f568b570fa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007fffd2dd7080 R11: 0000000000000293 R12: 0000000000000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000002 R14: 00007f568b571180 R15: 00005596138c9770 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1688 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d7eeb0e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc61d28dc0 EFLAGS: 00000293 ORIG_RAX: 00000000000000e8 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d7eeb0e Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000040 RSI: 000055f55c8c5020 RDI: 0000000000000005 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ff90ce81060 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 000000000000e95f R11: 0000000000000293 R12: 00007ff90ce81060 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000fffffffe R14: 0000000000000009 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1690 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_entity+0x1a1/0x4c0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xa8/0xf0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff90cd93770 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055f55c8c0b18 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f55c8c0b18 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1691 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_node_page_state+0x95/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sigprocmask+0xb4/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff90c592770 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055f55c8c0d08 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f55c8c0d08 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1692 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? update_load_avg+0x80/0x7e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_node_page_state+0x95/0x110 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ttwu_do_wakeup+0x17/0x1a0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sigprocmask+0xb4/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff90bd91770 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055f55c8b1d68 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f55c8b1d68 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1693 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? up_read+0xdd/0x150 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff90b590770 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055f55c8b1f58 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f55c8b1f58 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gssproxy state:S stack: 0 pid: 1694 ppid: 1 flags:0x00000002 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x4d/0xa0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mnt_drop_write+0x25/0x70 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? file_update_time+0xfa/0x140 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_write+0x256/0x2e0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff90ad8f770 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff90d73c39a Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000189 RDI: 000055f55c8b214c Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffff Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f55c8b214c R14: 0000000000000001 R15: 0000000000000000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/98-bnxt_off state:S stack: 0 pid: 1727 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/99-bnxt_off state:S stack: 0 pid: 1728 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/100-bnxt_of state:S stack: 0 pid: 1729 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/101-bnxt_of state:S stack: 0 pid: 1730 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/102-bnxt_of state:S stack: 0 pid: 1731 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/103-bnxt_of state:S stack: 0 pid: 1732 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/104-bnxt_of state:S stack: 0 pid: 1733 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/105-bnxt_of state:S stack: 0 pid: 1735 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/79-lom_1 state:S stack: 0 pid: 1860 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/80-lom_1-Tx state:S stack: 0 pid: 1861 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/81-lom_1-Tx state:S stack: 0 pid: 1862 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/82-lom_1-Tx state:S stack: 0 pid: 1863 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/83-lom_1-Tx state:S stack: 0 pid: 1864 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/84-lom_1-Tx state:S stack: 0 pid: 1865 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/85-lom_1-Tx state:S stack: 0 pid: 1866 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/86-lom_1-Tx state:S stack: 0 pid: 1867 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/87-lom_1-Tx state:S stack: 0 pid: 1868 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/107-lom_2 state:S stack: 0 pid: 1899 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/108-lom_2-T state:S stack: 0 pid: 1900 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/109-lom_2-T state:S stack: 0 pid: 1901 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/110-lom_2-T state:S stack: 0 pid: 1902 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/111-lom_2-T state:S stack: 0 pid: 1903 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/112-lom_2-T state:S stack: 0 pid: 1904 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/113-lom_2-T state:S stack: 0 pid: 1905 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/114-lom_2-T state:S stack: 0 pid: 1906 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/115-lom_2-T state:S stack: 0 pid: 1907 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/117-lom_3 state:S stack: 0 pid: 1934 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/118-lom_3-T state:S stack: 0 pid: 1935 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/119-lom_3-T state:S stack: 0 pid: 1936 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/120-lom_3-T state:S stack: 0 pid: 1937 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/121-lom_3-T state:S stack: 0 pid: 1938 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/122-lom_3-T state:S stack: 0 pid: 1939 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/123-lom_3-T state:S stack: 0 pid: 1940 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/124-lom_3-T state:S stack: 0 pid: 1941 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/125-lom_3-T state:S stack: 0 pid: 1942 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/127-lom_4 state:S stack: 0 pid: 1981 ppid: 2 flags:0x00004000 Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:51 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/128-lom_4-T state:S stack: 0 pid: 1982 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/129-lom_4-T state:S stack: 0 pid: 1983 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/130-lom_4-T state:S stack: 0 pid: 1984 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/131-lom_4-T state:S stack: 0 pid: 1985 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/132-lom_4-T state:S stack: 0 pid: 1986 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/133-lom_4-T state:S stack: 0 pid: 1987 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/134-lom_4-T state:S stack: 0 pid: 1988 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/135-lom_4-T state:S stack: 0 pid: 1989 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/89-bnxt_roc state:S stack: 0 pid: 2037 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/90-bnxt_roc state:S stack: 0 pid: 2038 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/91-bnxt_roc state:S stack: 0 pid: 2039 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/92-bnxt_roc state:S stack: 0 pid: 2040 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/93-bnxt_roc state:S stack: 0 pid: 2041 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/94-bnxt_roc state:S stack: 0 pid: 2042 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/95-bnxt_roc state:S stack: 0 pid: 2043 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/96-bnxt_roc state:S stack: 0 pid: 2044 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:agetty state:S stack: 0 pid: 2206 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? step_into+0x1c9/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? radix_tree_node_alloc.constprop.0+0xb0/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? fsnotify_add_mark_list+0x9c/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __legitimize_path+0x27/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? radix_tree_node_alloc.constprop.0+0xb0/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kmem_cache_alloc+0x156/0x2c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfs_filemap_map_pages+0x55/0x70 [xfs] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_read_fault+0xdb/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_fault+0xcd/0x4c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? get_max_files+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __handle_mm_fault+0x1ad/0x240 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x77/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fdc97054089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffdae29e120 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fdc97054089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffdae29e210 RDI: 0000000000000005 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffdae29e210 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000005 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000000 R14: 0000000000000015 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:agetty state:S stack: 0 pid: 2210 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? memcg_alloc_slab_cgroups+0x39/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? radix_tree_node_alloc.constprop.0+0xb0/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __kmalloc_node+0x187/0x380 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? radix_tree_node_alloc.constprop.0+0xb0/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kmem_cache_alloc+0x156/0x2c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_read_fault+0xdb/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_fault+0xcd/0x4c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __handle_mm_fault+0x1ad/0x240 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x77/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7effc3aac089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffea008d170 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007effc3aac089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffea008d260 RDI: 0000000000000005 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffea008d260 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000005 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000000 R14: 0000000000000015 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:irq/4-ttyS0 state:S stack: 0 pid: 2700 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_fn+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: irq_thread+0x90/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_finalize_oneshot.part.0+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? irq_thread_check_affinity+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:crond state:S stack: 0 pid: 2701 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_nanosleep+0x8d/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hrtimer_nanosleep+0x95/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: common_nsleep+0x40/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_clock_nanosleep+0xbf/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f6f8812e95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd468cf878 EFLAGS: 00000246 ORIG_RAX: 00000000000000e6 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: fffffffffffffe98 RCX: 00007f6f8812e95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00007ffd468cf890 RSI: 0000000000000000 RDI: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000000000000000a R08: 0000000000000000 R09: 0000000063ad9d24 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffd468cf890 R11: 0000000000000246 R12: 000000000000003c Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000001a94b27 R14: 000000000000003b R15: 0000564e1e5a7a58 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:restraintd state:S stack: 0 pid: 2703 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x9c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ___slab_alloc+0x102/0x890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? avc_has_perm+0x8f/0x1b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? unmap_page_range+0x127/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfs_bmapi_read+0x12f/0x2e0 [xfs] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? free_pgtables+0x6d/0x100 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfs_iunlock+0xca/0x140 [xfs] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? recalibrate_cpu_khz+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ktime_get_ts64+0x4c/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __rseq_handle_notify_resume+0x32/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_loop+0xd7/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xa8/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff2f4d019bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc250ad380 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00000000005e1c10 RCX: 00007ff2f4d019bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000398f RSI: 0000000000000004 RDI: 00000000029c35f0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00000000029c35f0 R08: 0000000000000000 R09: 0000000000000003 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc250cc080 R11: 0000000000000293 R12: 0000000000000004 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000000000000398f R14: 000000007fffffff R15: 00000000029bb810 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid: 2705 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? post_alloc_hook+0xb6/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_charge_memcg+0x3e9/0x810 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_node_page_state+0x95/0x110 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff2f4d019bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff2f4bbbce0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00000000005e1c10 RCX: 00007ff2f4d019bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 00000000029d5360 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00000000029d5360 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000004022 R11: 0000000000000293 R12: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000ffffffff R14: 000000007fffffff R15: 00000000029d6400 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:pool-restraintd state:S stack: 0 pid: 2706 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait_queue+0x70/0xc0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: futex_wait+0x181/0x270 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_futex+0x15b/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_futex+0x73/0x1d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xde/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7ff2f4bfde5d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ff2efffed08 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00000000029d5210 RCX: 00007ff2f4bfde5d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000118 RSI: 0000000000000080 RDI: 00000000029d5220 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00000000fde30c84 R08: 0000000000001094 R09: 0000000000001094 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ff2efffed20 R11: 0000000000000246 R12: 00000000000010a3 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000000001eba45a0 R14: 00007ff2efffed10 R15: 0000000000000118 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:10_bash_login state:S stack: 0 pid: 2708 ppid: 2703 flags:0x00004002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f7c06ae42ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffec6cc9c98 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000ac7 RCX: 00007f7c06ae42ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffec6cc9cc0 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffec6cc9d20 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:runtest.sh state:S stack: 0 pid: 2759 ppid: 2708 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fae9bb3d2ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd371c2718 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000000000000bd22 RCX: 00007fae9bb3d2ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffd371c2740 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffd371c27a0 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:sshd state:S stack: 0 pid: 2830 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? poll_freewait+0x45/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __kmalloc_node_track_caller+0x17b/0x370 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __alloc_skb+0x8e/0x1d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sock_def_readable+0xe/0x80 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __netlink_sendskb+0x67/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __check_object_size.part.0+0x112/0x160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __wake_up_common_lock+0x82/0xb0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? get_max_files+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? call_rcu+0x198/0x310 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __rseq_handle_notify_resume+0x32/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_loop+0xd7/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exit_to_user_mode_prepare+0xa8/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f9f65436987 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd1038d318 EFLAGS: 00000246 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007ffd1038d330 RCX: 00007f9f65436987 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 00007ffd1038d330 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00005617b87f70c0 R08: 0000000000000001 R09: 00007ffd10386648 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000040 R11: 0000000000000246 R12: 00005617b87f70c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00005617ba7264d0 R14: 00005617ba712850 R15: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:sshd state:S stack: 0 pid: 2833 ppid: 2830 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __ip_queue_xmit+0x18c/0x430 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? get_nohz_timer_target+0x18/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? lock_timer_base+0x61/0x80 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __mod_timer+0x2ab/0x450 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sk_reset_timer+0x14/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? tcp_schedule_loss_probe.part.0+0x12c/0x1a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? tcp_write_xmit+0x6f3/0xaa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sock_sendmsg+0x5b/0x70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sock_write_iter+0x97/0x100 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_write+0x256/0x2e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x5d/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sigprocmask+0xb4/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f9f65439224 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd1038cfd0 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f9f65439224 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00005617ba770ce0 RSI: 00005617ba762e70 RDI: 000000000000000f Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00005617ba762e70 R08: 0000000000000000 R09: 00007ffd1038d010 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000008 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00005617ba721c80 R14: 00005617ba770ce0 R15: 00005617ba7264d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:restraintd state:S stack: 0 pid: 2834 ppid: 2833 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? tcp_rtt_estimator+0x11c/0x250 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __irq_exit_rcu+0x72/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x14dd19d129bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffd801b0bc0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00000000005e1c10 RCX: 000014dd19d129bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000004 RDI: 0000000001a3d590 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000001a3d590 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 000000000000001f R11: 0000000000000293 R12: 0000000000000004 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000ffffffff R14: 000000007fffffff R15: 00000000019e82a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid: 2865 ppid: 2833 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? poll_freewait+0x45/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_poll+0x1d8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xa_load+0x70/0xb0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? update_load_avg+0x80/0x7e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_entity+0x1a1/0x4c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? check_preempt_curr+0x33/0x70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ttwu_do_wakeup+0x17/0x1a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_to_wake_up+0xb4/0x680 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? pollwake+0x74/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_write+0xb5/0x2e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x14dd19d129bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:000014dd19bccce0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00000000005e1c10 RCX: 000014dd19d129bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 00000000019f7ed0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00000000019f7ed0 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000ffffffff R14: 000000007fffffff R15: 00000000019f9a80 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsiod state:I stack: 0 pid: 3603 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:NFSv4 callback state:S stack: 0 pid: 3607 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfs_callback_down_net+0x70/0x70 [nfsv4] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfs41_callback_svc+0x1f0/0x200 [nfsv4] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfs_callback_down_net+0x70/0x70 [nfsv4] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/46:2 state:I stack: 0 pid: 7696 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/45:2 state:I stack: 0 pid: 7975 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:make state:S stack: 0 pid: 8060 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sigprocmask+0xb4/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x14f7dac642ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff4dbd7d98 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00005631a30d24a8 RCX: 000014f7dac642ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007fff4dbd7ddc RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007fff4dbd7ddc R08: 0000000000001fa8 R09: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00005631a3e336d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00005631a30e0cc0 R14: 0000000000000001 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:runtest state:S stack: 0 pid: 8104 ppid: 8060 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x153d46a142ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fffe0ce4b28 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000007f36 RCX: 0000153d46a142ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007fffe0ce4b50 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fffe0ce4bb0 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:sshd state:S stack: 0 pid:11172 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rmqueue+0x4a7/0xe40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_iter+0xc1/0x6c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? copy_page_from_iter+0xac/0x290 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __check_object_size.part.0+0x35/0x160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xas_load+0x5/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xa_load+0x70/0xb0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rcu_nocb_try_bypass+0x4d/0x4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __fpu_restore_sig+0x9a/0x3f0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? sigprocmask+0xb4/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x5d/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fe4ee63b224 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc22f3b680 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000010 RCX: 00007fe4ee63b224 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 000055ae29831490 RDI: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000055ae29831490 R08: 0000000000000000 R09: 00007ffc22f3b6c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055ae282f6181 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000000002d8 R14: 0000000000000000 R15: 000055ae28329f60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/22:2 state:I stack: 0 pid:15410 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/39:2 state:I stack: 0 pid:15445 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_power_efficient) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/33:3 state:I stack: 0 pid:15447 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:opensm-launch state:S stack: 0 pid:15623 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f1b0c19b2ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe937623a8 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000000000000bd20 RCX: 00007f1b0c19b2ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffe937623d0 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffe93762430 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/15:0 state:I stack: 0 pid:19601 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (xfs-sync/sda2) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rstrnt-sync state:S stack: 0 pid:20113 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? tcp_rtt_estimator+0x11c/0x250 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_to_iter+0xc1/0x6d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? security_file_alloc+0x24/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __check_object_size.part.0+0x41/0x160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_read+0x13c/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x1535cf0179bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff51c6ffe0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000405590 RCX: 00001535cf0179bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000003 RDI: 0000000001201ed0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000001201ed0 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000293 R12: 0000000000000003 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000ffffffff R14: 000000007fffffff R15: 00000000011ff5e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:gmain state:S stack: 0 pid:20114 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? memcg_slab_post_alloc_hook+0x181/0x250 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_poll.constprop.0+0x1d9/0x2d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_sys_poll+0x1c8/0x260 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rmqueue+0x4a7/0xe40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? eventfd_read+0xe2/0x2b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? wake_up_q+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? new_sync_read+0xfc/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? vfs_read+0x13c/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_poll+0x39/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x1535cf0179bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00001535ceed0d20 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000405590 RCX: 00001535cf0179bf Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00000000ffffffff RSI: 0000000000000001 RDI: 0000000001201c70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000001201c70 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000004022 R11: 0000000000000293 R12: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00000000ffffffff R14: 000000007fffffff R15: 0000000001201b50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/15:2 state:I stack: 0 pid:20802 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/38:3 state:I stack: 0 pid:30648 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (inode_switch_wbs) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/19:4 state:I stack: 0 pid:30723 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (inode_switch_wbs) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/19:5 state:I stack: 0 pid:30724 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/16:0 state:I stack: 0 pid:31507 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/1:2 state:I stack: 0 pid:31680 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (cgroup_destroy) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? css_free_rwork_fn+0xd3/0x1f0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/u96:7 state:I stack: 0 pid:31746 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_unbound) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/37:0 state:I stack: 0 pid:31965 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/47:0 state:I stack: 0 pid:31966 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/3:0 state:I stack: 0 pid:32199 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:bash state:S stack: 0 pid:32566 ppid: 8104 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x1480e36872ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffced74de88 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000000000000a93d RCX: 00001480e36872ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffced74deb0 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffced74df10 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/47:3 state:I stack: 0 pid:39509 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? queue_rcu_work+0x2b/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/0:0 state:I stack: 0 pid:39510 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/44:0 state:I stack: 0 pid:39672 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/6:2 state:I stack: 0 pid:40309 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:tls-strp state:I stack: 0 pid:40390 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:anacron state:S stack: 0 pid:40415 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sigsuspend+0x83/0xb0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_rt_sigsuspend+0x3e/0x70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f07ecef507c Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff324c6e78 EFLAGS: 00000246 ORIG_RAX: 0000000000000082 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f07ecef507c Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 0000000000000008 RDI: 00007fff324c6e80 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007fff324c6e80 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000008 R11: 0000000000000246 R12: 000055f56d94cff8 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000055f56f14d100 R14: 000055f56d94f0c0 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/36:0 state:I stack: 0 pid:41095 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/u97:1 state:I stack: 0 pid:41228 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (ib-comp-unb-wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/30:0 state:I stack: 0 pid:41686 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/36:2H state:I stack: 0 pid:41769 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (kblockd) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-buf/sda4 state:I stack: 0 pid:41861 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-conv/sda4 state:I stack: 0 pid:41862 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-reclaim/sda state:I stack: 0 pid:41863 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-blockgc/sda state:I stack: 0 pid:41864 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-inodegc/sda state:I stack: 0 pid:41865 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-log/sda4 state:I stack: 0 pid:41866 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfs-cil/sda4 state:I stack: 0 pid:41867 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rescuer_thread+0x311/0x3e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cancel_delayed_work_sync+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:xfsaild/sda4 state:S stack: 0 pid:41868 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: xfsaild+0x17c/0x1e0 [xfs] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? xfsaild_push+0x7b0/0x7b0 [xfs] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpc.statd state:S stack: 0 pid:42012 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? datagram_poll+0xde/0x110 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? udp_poll+0x18/0xb0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_select+0x5a4/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __schedule+0x263/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __pollwait+0xe0/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? enqueue_task_fair+0x88/0x440 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? check_preempt_curr+0x33/0x70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ttwu_do_wakeup+0x17/0x1a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_unlock_irqrestore+0x1f/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? try_to_wake_up+0xb4/0x680 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? autoremove_wake_function+0x30/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: core_sys_select+0x1a0/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rt_spin_unlock+0x13/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_get_rseq_cs.isra.0+0x16/0x220 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? rseq_ip_fixup+0x74/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? get_max_files+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? call_rcu+0x198/0x310 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_pselect.constprop.0+0xca/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_pselect6+0x77/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fa479abd089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc621cd1b0 EFLAGS: 00000246 ORIG_RAX: 000000000000010e Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fa479abd089 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffc621cd300 RDI: 0000000000000400 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffc621cd300 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000400 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000000 R14: 00007ffc621cd2c0 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsdcld state:S stack: 0 pid:42016 ppid: 1 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_hrtimeout_range_clock+0x10c/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ep_poll+0x2d0/0x340 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? ep_insert+0x28a/0x510 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_epoll_wait+0xa3/0xc0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_epoll_wait+0x60/0x100 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_trace_enter.constprop.0+0x145/0x200 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f25ca642aca Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff41438948 EFLAGS: 00000246 ORIG_RAX: 00000000000000e8 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f25ca642aca Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000020 RSI: 000056473d08a5c0 RDI: 0000000000000003 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000056473d08a300 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000ffffffff R11: 0000000000000246 R12: 000056473d08a5c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000056473d08a5a0 R14: 000056473d08a5a0 R15: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:lockd state:S stack: 0 pid:42022 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_get_next_xprt+0x13b/0x200 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0x88/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? set_grace_period+0xa0/0xa0 [lockd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: lockd+0xa9/0x1d0 [lockd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _raw_spin_lock_irqsave+0x19/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:S stack: 0 pid:42023 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? svc_xprt_received+0x4a/0xb0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_get_next_xprt+0x13b/0x200 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0x88/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42024 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42025 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: wait_for_completion_killable+0x20/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_sendto+0x1f7/0x380 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_send+0x49/0x210 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xd5/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42026 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: wait_for_completion_killable+0x20/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_sendto+0x1f7/0x380 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_send+0x49/0x210 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xd5/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42027 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:S stack: 0 pid:42028 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x88/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __bpf_trace_tick_stop+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_get_next_xprt+0x13b/0x200 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0x88/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42029 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42030 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/43:0 state:I stack: 0 pid:42047 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/8:0 state:I stack: 0 pid:42160 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/35:2 state:I stack: 0 pid:42177 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpc.nfsd state:D stack: 0 pid:42233 ppid: 1 flags:0x00000006 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread_stop+0x62/0x1d0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_set_num_threads+0x10d/0x200 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd_svc+0x123/0x190 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_threads+0x95/0x100 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? simple_transaction_get+0xc4/0xf0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? write_pool_threads+0x230/0x230 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsctl_transaction_write+0x46/0x80 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fbc26a37be7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe615eb898 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fbc26a37be7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000002 RSI: 000055b890ce8c20 RDI: 0000000000000003 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: 00007ffe615eb730 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055b890ce8c20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fbc268f66c0 R14: 00007ffe615eb960 R15: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:exportfs state:D stack: 0 pid:42783 ppid: 1 flags:0x00000006 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock_block.constprop.0+0x33/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock.constprop.0+0xd9/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: expkey_flush+0x11/0x40 [nfsd] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_flush.constprop.0+0xdd/0x120 [sunrpc] Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? selinux_file_permission+0x108/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: proc_reg_write+0x55/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x4d/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f93cd117be7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffdf38f9ae8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000055b4b4c2ea50 RCX: 00007f93cd117be7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000000b RSI: 00007ffdf38f9af0 RDI: 0000000000000004 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffdf38f9b10 R08: 0000000000000000 R09: 00007f93cd18a4e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffdf38f9af0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000000000000000b R14: 000055b4b4c2b526 R15: 0000000000000004 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/u96:0 state:I stack: 0 pid:43279 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (flush-8:0) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/42:2 state:I stack: 0 pid:43296 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/14:0 state:I stack: 0 pid:43297 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:exportfs state:S stack: 0 pid:43325 ppid: 32566 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_lock_file_wait+0xcd/0x110 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? cpuacct_percpu_seq_show+0x10/0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: fcntl_setlk+0x11c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_fcntl+0x3fa/0x570 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_fcntl+0x92/0xc0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x14ba807590cb Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffcb203a930 EFLAGS: 00000246 ORIG_RAX: 0000000000000048 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 000014ba807590cb Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00007ffcb203a9a0 RSI: 0000000000000007 RDI: 0000000000000003 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000055ee77a417e0 R08: 0000000000000000 R09: 00007ffcb203a830 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00000000000001b6 R11: 0000000000000246 R12: 00007ffcb203ac08 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/u96:2 state:I stack: 0 pid:46403 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_unbound) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/7:0 state:I stack: 0 pid:46412 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/21:0 state:I stack: 0 pid:47248 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (mm_percpu_wq) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:10_bash_login state:S stack: 0 pid:47391 ppid: 2834 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x148ee00e62ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffeaac5f468 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000000000000b957 RCX: 0000148ee00e62ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffeaac5f490 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffeaac5f4f0 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:run_plugins state:S stack: 0 pid:47447 ppid: 47391 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_wait+0x15c/0x320 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kernel_wait4+0xa6/0x140 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? thread_group_exited+0x60/0x60 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x15249cb002ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffdeabc3968 EFLAGS: 00000246 ORIG_RAX: 000000000000003d Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000000000000bc89 RCX: 000015249cb002ea Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000000 RSI: 00007ffdeabc3990 RDI: 00000000ffffffff Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000001 R08: 0000000000000001 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffdeabc39f0 R14: 0000000000000000 R15: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/7:2 state:I stack: 0 pid:47476 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/13:2 state:I stack: 0 pid:47569 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/33:1 state:I stack: 0 pid:47572 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:kworker/21:1 state:I stack: 0 pid:48014 ppid: 2 flags:0x00004000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Workqueue: 0x0 (events_freezable_power_) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: worker_thread+0xc1/0x3b0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? process_one_work+0x410/0x410 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:20_sysinfo state:R running task stack: 0 pid:48265 ppid: 47447 flags:0x00004002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sched_show_task.cold+0xca/0xe4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: show_state_filter+0x7f/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sysrq_handle_showstate+0xc/0x20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __handle_sysrq.cold+0x43/0x11f Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_sysrq_trigger+0x24/0x40 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: proc_reg_write+0x55/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x4d/0xa0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? filp_close+0x59/0x70 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_dup2+0x89/0xc0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x14e66675fbe7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Code: 0b 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b7 0f 1f 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 b8 01 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 51 c3 48 83 ec 28 48 89 54 24 18 48 89 74 24 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe50a46668 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 000014e66675fbe7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000002 RSI: 0000561722c055a0 RDI: 0000000000000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000561722c055a0 R08: 0000000000000000 R09: 000014e6667d24e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 000014e6667d23e0 R11: 0000000000000246 R12: 0000000000000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000014e66681c780 R14: 0000000000000002 R15: 000014e6668179e0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:sleep state:S stack: 0 pid:48416 ppid: 15623 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_nanosleep+0x8d/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hrtimer_nanosleep+0x95/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: common_nsleep+0x40/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_clock_nanosleep+0xbf/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? handle_mm_fault+0xc5/0x2a0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_user_addr_fault+0x1e5/0x690 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f26719ac95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffc052095c8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e6 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f26718966c0 RCX: 00007f26719ac95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00007ffc05209620 RSI: 0000000000000000 RDI: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 000000000000001e R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007ffc05209610 R11: 0000000000000246 R12: 00007ffc05209610 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007ffc05209620 R14: 00007ffc05209798 R15: 0000555e51587040 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:sleep state:S stack: 0 pid:48422 ppid: 2759 flags:0x00000002 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_nanosleep+0x8d/0x170 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: hrtimer_nanosleep+0x95/0x120 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? __hrtimer_init+0xd0/0xd0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: common_nsleep+0x40/0x50 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __x64_sys_clock_nanosleep+0xbf/0x130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f1efa0fe95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007fff2f0f21a8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e6 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 00007f1ef9fe86c0 RCX: 00007f1efa0fe95a Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 00007fff2f0f2200 RSI: 0000000000000000 RDI: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000005 R08: 0000000000000000 R09: 0000000000000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 00007fff2f0f21f0 R11: 0000000000000246 R12: 00007fff2f0f21f0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fff2f0f2200 R14: 00007fff2f0f2378 R15: 00005632134e1040 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Sched Debug Version: v0.11, 5.14.0-226.rt14.227.1773_734386590.el9.x86_64 #1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ktime : 4253623.363979 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sched_clk : 4255786.272617 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu_clk : 4255734.685502 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: jiffies : 4298920809 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sched_clock_stable() : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sysctl_sched Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_latency : 24.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_min_granularity : 3.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_idle_min_granularity : 0.750000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_wakeup_granularity : 4.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_child_runs_first : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_features : 117221947 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .sysctl_sched_tunable_scaling : 1 (logarithmic) Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#0, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 2186864 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 32 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.920890 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4255849.047871 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4253273.235049 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[0]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 102124.714524 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[0]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.003747 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[0]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_gp 3 316.268414 2 100 0.000000 0.004509 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_par_gp 4 317.768946 2 100 0.000000 0.002544 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I slub_flushwq 5 319.769746 2 100 0.000000 0.002294 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I netns 6 321.770666 2 100 0.000000 0.002344 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/0:0H 8 325.771940 4 100 0.000000 0.007384 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/0:1H 10 102110.944819 2962 100 0.000000 40.175064 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I mm_percpu_wq 11 328.023871 2 100 0.000000 0.002624 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_tasks_kthre 13 340.446314 2 120 0.000000 0.003116 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_tasks_rude_ 14 346.577572 2 120 0.000000 0.002114 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_tasks_trace 15 352.709914 2 120 0.000000 0.001994 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/0 16 102125.286801 821282 120 0.000000 21117.504483 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/0 17 0.000000 30602 98 0.000000 106.900688 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcub/1 20 0.000361 16 98 0.000000 47.643157 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/0 21 0.000000 128649 98 0.000000 621.617419 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/0 22 0.000300 1170 0 0.000000 4.547162 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/0 23 0.000000 77731 98 0.000000 76.575297 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/0 25 7252.482096 22 120 0.000000 0.820917 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcub/3 283 3091.828165 2 98 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/0:2 576 87278.217863 3701 120 0.000000 122.157281 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/142-0000:41 1330 0.000000 3 49 0.000000 0.031479 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1430 7338.106507 2 100 0.000000 0.020949 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rdma-ndd 1454 -1.048576 27 120 0.000000 24.269889 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I iscsi_conn_clea 1468 7362.088011 2 100 0.000000 0.022110 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-inodegc/sda 1534 7385.891247 2 100 0.000000 0.042559 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rs:main Q:Reg 1634 23127.303592 4216 120 0.000000 102.302762 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1692 60.129496 1 120 0.000000 0.058881 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/124-lom_3-T 1941 0.000000 2125 49 0.000000 2.780034 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/0:0 39510 102113.013768 4259 120 0.000000 96.201016 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-log/sda4 41866 87147.283794 2 100 0.000000 0.021911 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#1, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 968780 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967271 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.921505 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4256462.058055 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4254875.369421 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 875263 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[1]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 47133.086770 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -54992.730201 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[1]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[1]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_preempt 19 0.000411 267365 98 0.000000 3993.685072 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/1 26 3195.422358 21 120 0.000000 0.682953 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/1 27 -2.996574 3770 98 0.000000 7.642744 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/1 28 0.000320 1170 0 0.000000 586.761682 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/1 29 -2.997265 92691 98 0.000000 269.759013 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/1 30 -2.997876 83423 98 0.000000 216.130855 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/1 31 47133.396439 253955 120 0.000000 4513.827095 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/1:0H 33 1338.366240 4 100 0.000000 0.034664 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/9-acpi 469 0.000000 3 49 0.000000 0.004609 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/1:1 525 47107.909273 1921 120 0.000000 212.260320 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-cil/sda6 1105 1268.312661 2 100 0.000000 0.015849 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/1:1H 1189 47119.453747 3229 100 0.000000 46.193845 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/144-0000:42 1331 0.000000 3 49 0.000000 0.027071 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I target_submissi 1478 3270.651662 2 100 0.000000 0.020268 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1674 0.833347 10 120 0.000000 0.309912 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/110-lom_2-T 1902 0.000000 2121 49 0.000000 2.445007 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/1:2 31680 43141.449859 4 120 0.000000 0.084479 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#2, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 402126 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967264 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.922008 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4256966.062533 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4255986.881640 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[2]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 43674.430435 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -58452.482765 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[2]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[2]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/2 34 8380.662722 21 120 0.000000 0.450228 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/2 35 -5.997004 908 98 0.000000 2.057253 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/2 36 442.223667 1234 0 0.000000 590.785684 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/2 37 -5.997145 41643 98 0.000000 129.591921 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/2 38 -5.997976 32885 98 0.000000 100.105713 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/2 39 43674.804226 91160 120 0.000000 1608.791750 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/2:0H 41 6769.869067 4 100 0.000000 0.040065 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/26-AMD-Vi 479 0.000000 3 49 0.000000 0.070288 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/26-s-AMD-Vi 480 0.000000 3 49 0.000000 0.033290 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/2:1 526 43644.693428 1711 120 0.000000 120.493289 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/2:1H 1190 43662.364432 3284 100 0.000000 29.845073 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/2:2 1322 22311.683213 3 120 0.000000 0.014136 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/145-0000:01 1332 0.000000 3 49 0.000000 0.028023 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_re 1396 8392.650259 2 100 0.000000 0.020028 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1410 8416.679357 2 100 0.000000 0.015179 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/160-bnxt_qp 1431 0.000000 3 49 0.000000 0.058490 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rpciod 1498 8452.752545 2 100 0.000000 0.044163 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/80-lom_1-Tx 1861 0.000000 4514 49 0.000000 16.001923 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42027 42541.548677 376 120 0.000000 85.086351 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#3, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 249727 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967268 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.922494 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4257450.086749 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4256433.484149 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[3]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 125974.136423 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : 23846.379878 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[3]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[3]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/3 42 2368.130119 21 120 0.000000 0.694019 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/3 43 -5.994941 569 98 0.000000 1.753431 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/3 44 488.225757 1148 0 0.000000 5.906333 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/3 45 -5.995482 38592 98 0.000000 1544.128386 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/3 46 -5.997275 6770 98 0.000000 31.114324 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/3 47 125974.604982 44838 120 0.000000 470.442304 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/3:0H 49 962.152001 4 100 0.000000 0.031078 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/27-AMD-Vi 481 0.000000 3 49 0.000000 0.049149 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/27-s-AMD-Vi 482 0.000000 3 49 0.000000 0.041656 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/3:1 527 125952.249328 2001 120 0.000000 62.083125 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_pf_wq 1010 680.757676 2 100 0.000000 0.017634 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/3:1H 1085 125961.300148 3008 100 0.000000 32.057932 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/147-0000:02 1333 0.000000 3 49 0.000000 0.029236 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S polkitd 1703 36.270755 6 120 0.000000 0.266579 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/87-lom_1-Tx 1868 0.000000 7964 49 0.000000 20.787926 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/3:0 32199 47483.747234 9 120 0.000000 0.078910 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#4, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 216160 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 30 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.922982 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4257941.078418 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4257237.135560 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[4]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 61168.995285 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -40959.643223 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[4]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[4]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kthreadd 2 61088.649514 1080 120 0.000000 37.948716 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/4 50 3604.483342 22 120 0.000000 0.599132 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/4 51 -8.996063 226 98 0.000000 0.796016 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/4 52 540.231531 1132 0 0.000000 591.415533 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/4 53 -8.996644 21102 98 0.000000 203.500556 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/4 54 -8.997305 9632 98 0.000000 39.728519 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/4 55 61169.364601 38391 120 0.000000 278.164530 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/4:0H 57 30.527646 4 100 0.000000 0.035945 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/28-AMD-Vi 483 0.000000 3 49 0.000000 0.051053 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/28-s-AMD-Vi 484 0.000000 3 49 0.000000 0.029215 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/4:1 528 61153.941821 2156 120 0.000000 35.175278 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/4:1H 592 61155.323831 3544 100 0.000000 49.767235 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/54-hpilo 1339 0.000000 3 49 0.000000 0.037629 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kipmi0 1351 3576.552445 197 139 0.000000 2.331983 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1439 3687.386221 2 100 0.000000 0.016130 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/4:2 1562 4024.619492 9 120 0.000000 0.047148 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/115-lom_2-T 1907 0.000000 2121 49 0.000000 2.884468 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S pool-restraintd 2706 37992.521821 583 120 0.000000 28.313205 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#5, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 209009 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967259 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.923452 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4258413.080191 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4257774.231857 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[5]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 59611.429265 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -42518.159072 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[5]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[5]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/5 58 2798.537614 21 120 0.000000 0.494047 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/5 59 -8.996133 359 98 0.000000 1.412312 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/5 60 609.231509 1120 0 0.000000 591.899101 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/5 61 -8.996725 21479 98 0.000000 260.728983 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/5 62 -8.997365 9013 98 0.000000 36.511199 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/5 63 59611.996466 39824 120 0.000000 273.022154 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/5:0 64 61.479195 4 120 0.000000 0.050253 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/5:0H 65 1426.547830 4 100 0.000000 0.032981 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/5:1 477 59574.401815 1993 120 0.000000 34.349620 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/29-AMD-Vi 485 0.000000 3 49 0.000000 0.049790 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/29-s-AMD-Vi 486 0.000000 3 49 0.000000 0.031397 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/5:1H 1038 50077.675712 651 100 0.000000 6.677466 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S systemd-journal 1182 46327.749427 4439 120 0.000000 651.517186 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/155-bnxt_qp 1417 0.000000 42 49 0.000000 0.233611 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S nfsdcld 42016 36993.639299 81 120 0.000000 6.092082 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#6, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 172417 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.923931 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4258891.122039 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4258121.147438 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[6]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 93389.084616 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -8741.452246 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[6]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[6]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/6 66 3585.940393 21 120 0.000000 0.686458 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/6 67 -8.994560 400 98 0.000000 1.274485 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/6 68 678.233595 1132 0 0.000000 5.210265 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/6 69 -8.995031 32750 98 0.000000 1363.858478 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/6 70 -8.997175 6630 98 0.000000 29.519882 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/6 71 93389.592452 33818 120 0.000000 232.144165 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/6:0H 73 3490.240837 4 100 0.000000 0.022391 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/30-PCIe PME 503 0.000000 3 49 0.000000 0.068616 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/6:1 529 93346.646057 1851 120 0.000000 29.425180 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/6:1H 1363 89475.895114 960 100 0.000000 9.593696 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1404 3637.402244 2 100 0.000000 0.019477 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1414 3649.416644 2 100 0.000000 0.016160 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/164-bnxt_qp 1440 0.000000 3 49 0.000000 0.077285 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1678 39.930586 8 120 0.000000 0.468527 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/4-ttyS0 2700 0.000000 61 49 0.000000 2.641543 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/6:2 40309 44273.870418 19 120 0.000000 0.097612 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S xfsaild/sda4 41868 45103.483727 4 120 0.000000 0.162113 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#7, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 142700 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967287 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.924390 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4259351.094057 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4258774.895863 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[7]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 35415.148751 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -66716.196916 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[7]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.089174 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[7]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/7 74 3792.555395 21 120 0.000000 0.499007 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/7 75 -8.995872 156 98 0.000000 0.556019 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/7 76 748.130661 1110 0 0.000000 595.818805 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/7 77 -8.996664 15439 98 0.000000 103.574640 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/7 78 -8.997295 5607 98 0.000000 24.059536 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/7 79 35415.877143 32815 120 0.000000 195.541520 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/7:0H 81 1977.530271 4 100 0.000000 0.028954 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/31-PCIe PME 504 0.000000 3 49 0.000000 0.029864 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/7:1H 1044 35402.248994 3155 100 0.000000 33.592610 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-log/sda6 1104 2006.958103 2 100 0.000000 0.012394 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S systemd 1655 22.414257 228 120 0.000000 202.872905 0.000000 0.000000 /user.slice/user-0.slice/user@0.service/init.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1688 38050.271730 93 120 0.000000 9.123676 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/84-lom_1-Tx 1865 0.000000 3005 49 0.000000 9.205336 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 2705 586.309187 3 120 0.000000 0.135414 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I nfsiod 3603 4704.760600 2 100 0.000000 0.041878 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u97:1 41228 32636.429329 54 100 0.000000 9.318024 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/7:0 46412 35305.941645 115 120 0.000000 2.350520 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/7:2 47476 35404.205336 571 120 0.000000 5.026463 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#8, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 152224 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967290 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.924915 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4259873.117451 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4259348.901444 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 995035 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[8]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 35885.021677 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -66247.255810 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[8]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.029750 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[8]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/8 82 3775.879207 21 120 0.000000 0.535447 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/8 83 -11.996033 185 98 0.000000 0.623732 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/8 84 822.130638 1101 0 0.000000 596.868638 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/8 85 -11.996494 16880 98 0.000000 140.855349 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/8 86 -11.997335 8358 98 0.000000 35.575961 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/8 87 35885.518174 30200 120 0.000000 153.864074 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/8:0H 89 3738.794056 4 100 0.000000 0.039491 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/32-PCIe PME 505 0.000000 3 49 0.000000 0.052184 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/8:1 530 35873.547368 2417 120 0.000000 49.113992 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/8:1H 1382 35871.268114 3883 100 0.000000 57.568567 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib_mad1 1457 3816.640974 2 100 0.000000 0.018134 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xcopy_wq 1479 3828.657319 2 100 0.000000 0.019175 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/122-lom_3-T 1939 0.000000 2123 49 0.000000 1.991965 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S 10_bash_login 2708 164.508456 125 120 0.000000 38.295236 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/8:0 42160 28984.002118 2 120 0.000000 0.038843 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S sleep 48416 22437.201291 1 120 0.000000 1.299006 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#9, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 226492 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967203 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.925362 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4260321.106420 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4259484.659277 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[9]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 68279.567051 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -33853.530954 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[9]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.097111 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[9]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/9 90 2956.377473 23 120 0.000000 0.779507 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/9 91 -11.994339 338 98 0.000000 1.120217 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/9 92 914.134500 1126 0 0.000000 5.219226 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/9 93 -11.995302 29661 98 0.000000 933.705958 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/9 94 -11.997235 15024 98 0.000000 53.608611 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/9 95 68280.124279 40356 120 0.000000 214.134592 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/9:0 96 23.038002 4 120 0.000000 0.049550 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/9:0H 97 1588.380896 4 100 0.000000 0.034896 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/34-PCIe PME 506 0.000000 2 49 0.000000 0.040704 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/9:1 531 68268.289781 6260 120 0.000000 301.567510 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I uas 1002 1338.122516 2 100 0.000000 0.016851 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/9:1H 1079 66480.935201 1048 100 0.000000 7.822061 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/158-bnxt_qp 1427 0.000000 3 49 0.000000 0.083266 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/159-bnxt_qp 1429 0.000000 3 49 0.000000 0.036628 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/161-bnxt_qp 1433 0.000000 3 49 0.000000 0.036298 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/162-bnxt_qp 1435 0.000000 3 49 0.000000 0.031338 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/163-bnxt_qp 1438 0.000000 3 49 0.000000 0.031068 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/165-bnxt_qp 1442 0.000000 3 49 0.000000 0.026039 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib_mad1 1448 3022.285624 2 100 0.000000 0.022241 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S NetworkManager 1596 49653.585961 25034 120 0.000000 574.168671 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/98-bnxt_off 1727 0.000000 3 49 0.000000 0.034435 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/99-bnxt_off 1728 0.000000 3 49 0.000000 0.036308 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/100-bnxt_of 1729 0.000000 3 49 0.000000 0.036527 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/101-bnxt_of 1730 0.000000 3 49 0.000000 0.029385 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/102-bnxt_of 1731 0.000000 3 49 0.000000 0.034054 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/103-bnxt_of 1732 0.000000 3 49 0.000000 0.027401 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/104-bnxt_of 1733 0.000000 2 49 0.000000 0.025518 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/105-bnxt_of 1735 0.000000 3 49 0.000000 0.033001 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/79-lom_1 1860 0.000000 4 49 0.000000 0.041179 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/92-bnxt_roc 2040 0.000000 569 49 0.000000 2.922328 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u96:7 31746 68268.745063 46586 120 0.000000 1260.554613 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#10, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 174505 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967193 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.926047 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4261002.133766 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4260370.246603 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[10]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 23831.685624 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -78302.697853 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[10]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.020092 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[10]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/10 98 2685.725545 21 120 0.000000 0.568733 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/10 99 -11.996033 137 98 0.000000 0.478734 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/10 100 1006.136551 1092 0 0.000000 599.672741 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/10 101 -11.996504 18140 98 0.000000 67.732147 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/10 102 -11.997355 19077 98 0.000000 62.917848 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/10 103 23831.900937 31196 120 0.000000 136.799880 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/10:0H 105 2002.469911 4 100 0.000000 0.037030 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kdevtmpfs 452 2833.295774 279 120 0.000000 9.352747 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S watchdogd 474 11.999994 2 49 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/36-PCIe PME 507 0.000000 3 49 0.000000 0.033683 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/10:1 532 23819.947062 7882 120 0.000000 443.035878 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-reclaim/sda 1101 2014.469495 2 100 0.000000 0.015979 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/10:1H 1107 23819.621856 2641 100 0.000000 16.904172 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/10:2 1394 3140.525729 9 120 0.000000 0.036259 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/125-lom_3-T 1942 0.000000 2123 49 0.000000 1.337474 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#11, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 602630 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.926476 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4261435.121297 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4259331.178884 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[11]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 28906.895109 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -73228.400266 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[11]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.119134 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[11]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/11 106 2438.990008 22 120 0.000000 0.620556 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/11 107 -11.996293 360 98 0.000000 0.892499 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/11 108 1098.136516 1118 0 0.000000 602.026558 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/11 109 -11.996623 41899 98 0.000000 176.496000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/11 110 -11.997255 94500 98 0.000000 281.284394 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/11 111 28907.463560 101780 120 0.000000 253.927458 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/11:0 112 28895.471084 5525 120 0.000000 701.013369 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/11:0H 113 1413.185773 4 100 0.000000 0.028283 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/37-PCIe PME 508 0.000000 3 49 0.000000 0.049790 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/37-pciehp 509 0.000000 3 49 0.000000 0.029624 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/37-s-pciehp 510 0.000000 3 49 0.000000 0.044350 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/11:1 533 12837.090538 853 120 0.000000 48.565952 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/11:1H 1155 28611.229870 3211 100 0.000000 15.336640 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib_mcast 1374 2416.936495 2 100 0.000000 0.019777 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1675 26.721248 11 120 0.000000 0.310834 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/93-bnxt_roc 2041 0.000000 79241 49 0.000000 111.688561 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S runtest.sh 2759 32511.982053 2248 120 0.000000 718.913401 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I tls-strp 40390 24472.736997 2 100 0.000000 0.042590 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#12, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 172653 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967266 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.926996 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4261952.144215 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4261323.869896 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[12]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 72755.817297 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 72755.817297 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 72755.817297 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -29380.424263 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[12]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[12]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/12 114 6631.499374 21 120 0.000000 0.531442 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/12 115 -11.994389 336 98 0.000000 1.109182 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/12 116 1190.139186 1120 0 0.000000 5.345925 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/12 117 -11.994651 26069 98 0.000000 950.694638 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/12 118 -11.996955 5602 98 0.000000 22.415144 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/12 119 72756.142195 23309 120 0.000000 110.036161 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/12:0 120 7931.948510 45 120 0.000000 0.457895 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/12:0H 121 1594.327731 4 100 0.000000 0.032351 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/12:2 499 72730.700906 1413 120 0.000000 33.317332 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/38-PCIe PME 511 0.000000 3 49 0.000000 0.030136 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/12:1H 1013 72742.543468 3199 100 0.000000 52.982285 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/148-bnxt_qp 1397 0.000000 571 49 0.000000 2.434462 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S jbd2/sda3-8 1564 7038.154834 2 120 0.000000 0.019136 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gdbus 1669 55536.421539 353 120 0.000000 37.353695 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/108-lom_2-T 1900 0.000000 2126 49 0.000000 3.892173 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/130-lom_4-T 1984 0.000000 2128 49 0.000000 9.603437 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S 10_bash_login 47391 18759.226568 107 120 0.000000 41.333226 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#13, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 860875 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967291 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.927456 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4262417.162755 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4258372.074903 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[13]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 26138.027530 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -75999.059030 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[13]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.024017 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[13]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S systemd 1 750.569657 9694 120 0.000000 6304.613070 0.000000 0.000000 /init.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/13 122 3572.280607 22 120 0.000000 0.483207 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/13 123 -11.995762 2873 98 0.000000 1.369692 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/13 124 1282.141273 1109 0 0.000000 604.883504 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/13 125 -11.996383 21875 98 0.000000 127.583544 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/13 126 -11.997095 12963 98 0.000000 67.067989 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/13 127 26138.324049 35330 120 0.000000 151.395208 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/13:0H 129 68.787392 4 100 0.000000 0.029003 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I inet_frag_wq 453 10.954233 2 100 0.000000 0.002815 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/13:1 475 26126.152490 5632 120 0.000000 58.430626 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/13:1H 476 25831.279467 5360 100 0.000000 6.341502 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/40-PCIe PME 512 0.000000 3 49 0.000000 0.031668 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S polkitd 1602 18290.979631 784 120 0.000000 79.797703 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/96-bnxt_roc 2044 0.000000 334970 49 0.000000 2011.298689 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S nfsd 42023 23204.840393 9211 120 0.000000 3351.601066 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/13:2 47569 25843.575055 4 120 0.000000 0.048292 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#14, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 151504 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967282 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.927915 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4262910.182497 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4262593.954801 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[14]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 20844.286333 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -81293.873515 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 9 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 9 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 9 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[14]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.003817 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[14]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/14 130 3777.056546 21 120 0.000000 0.555142 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/14 131 -11.995742 181 98 0.000000 0.717660 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/14 132 1374.141241 1099 0 0.000000 605.690830 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/14 133 -11.996193 15304 98 0.000000 72.282571 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/14 134 -11.997095 4342 98 0.000000 20.647162 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/14 135 20846.538900 28145 120 0.000000 245.024383 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/14:0H 137 2509.386726 4 100 0.000000 0.033894 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/42-PCIe PME 513 0.000000 3 49 0.000000 0.031086 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/14:1 534 20711.023738 1549 120 0.000000 60.167937 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u97:0 727 20060.522845 117 100 0.000000 12.705116 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-blockgc/sda 1102 2504.458793 2 100 0.000000 0.025749 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-inodegc/sda 1103 2516.472232 2 100 0.000000 0.015159 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/14:1H 1178 20128.774797 24 100 0.000000 0.271441 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gdbus 1670 11089.754956 1093 120 0.000000 98.029419 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/14:0 43297 20098.282753 2 120 0.000000 0.015570 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#15, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 137354 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967291 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.928384 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4263344.173540 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4262926.311078 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[15]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 54406.362177 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -47732.572504 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[15]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.016803 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[15]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/15 138 3674.588505 21 120 0.000000 0.680146 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/15 139 -11.994690 271 98 0.000000 0.884085 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/15 140 1466.143289 1110 0 0.000000 5.155408 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/15 141 -11.995392 21841 98 0.000000 697.674623 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/15 142 -11.996504 2065 98 0.000000 9.111188 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/15 143 54396.049472 17558 120 0.000000 82.908199 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/15:0H 145 2053.649646 4 100 0.000000 0.028945 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/43-PCIe PME 514 0.000000 3 49 0.000000 0.030704 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/15:1H 1082 54390.711736 508 100 0.000000 6.021279 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1432 3732.099383 2 100 0.000000 0.015268 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S auditd 1574 27241.711125 131 116 0.000000 3.760937 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1673 1.435605 9 120 0.000000 0.746821 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/15:0 19601 54388.161542 2517 120 0.000000 43.421691 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/15:2 20802 24500.828882 4 120 0.000000 0.045866 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#16, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 3 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 160700 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967281 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.928708 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 48265 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4263813.152415 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4263234.810707 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 993933 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[16]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 26992.721459 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 27002.731428 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 26992.721459 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -75137.061169 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 1048576 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 34802 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 794 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[16]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 309.246265 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[16]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/16 146 3132.023327 22 120 0.000000 0.549252 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R irq_work/16 147 -11.995732 571 98 0.000000 2.683926 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/16 148 1558.145973 1106 0 0.000000 608.311336 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/16 149 -11.996183 13376 98 0.000000 106.696064 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/16 150 -11.997114 3788 98 0.000000 16.917946 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R ksoftirqd/16 151 26992.721459 16862 120 0.000000 65.259218 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/16:0H 153 136.468205 4 100 0.000000 0.025658 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D rcub/2 154 0.000601 3 98 0.000000 0.017332 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I writeback 461 27.928985 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/44-PCIe PME 515 0.000000 3 49 0.000000 0.028853 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/16:1 535 26492.119276 1519 120 0.000000 40.777154 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/16:1H 832 26990.732593 2686 100 0.000000 30.669222 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/152-bnxt_qp 1411 0.000000 422 49 0.000000 1.135238 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/157-bnxt_qp 1420 0.000000 186 49 0.000000 0.586841 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/85-lom_1-Tx 1866 0.000000 7638 49 0.000000 16.034414 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/94-bnxt_roc 2042 0.000000 65 49 0.000000 0.376183 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S agetty 2210 441.891482 14 120 0.000000 5.509579 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/16:0 31507 21824.760395 3 120 0.000000 0.014968 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-reclaim/sda 41863 24842.288165 2 100 0.000000 0.047379 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rpc.statd 42012 22491.892630 27 120 0.000000 25.380229 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D exportfs 42783 23458.755778 4 120 0.000000 4.030385 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: >R 20_sysinfo 48265 0.000000 558 98 0.000000 52745.049557 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#17, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 120203 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.929383 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4264343.189885 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4263937.859129 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[17]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 16745.094597 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -85395.679099 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[17]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[17]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/17 155 3713.035230 21 120 0.000000 0.541284 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/17 156 -11.995712 148 98 0.000000 0.536774 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/17 157 1653.146670 1111 0 0.000000 610.714490 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/17 158 -11.996403 10168 98 0.000000 66.814303 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/17 159 -11.997085 782 98 0.000000 4.155910 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/17 160 16745.686157 25215 120 0.000000 161.347713 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/17:0 161 25.630770 4 120 0.000000 0.034974 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/17:0H 162 161.983147 4 100 0.000000 0.032540 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/45-PCIe PME 516 0.000000 3 49 0.000000 0.030154 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/45-pciehp 517 0.000000 3 49 0.000000 0.027809 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/45-s-pciehp 518 0.000000 3 49 0.000000 0.049620 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/17:1 536 16634.186289 960 120 0.000000 27.110175 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I acpi_thermal_pm 563 61.624912 2 100 0.000000 0.016720 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/17:1H 830 14965.196364 59 100 0.000000 0.574616 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ext4-rsv-conver 1565 3985.263529 2 100 0.000000 0.040196 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S runtest 8104 7892.061334 3315 120 0.000000 676.009423 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#18, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 1250763 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 6 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.929878 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4264836.184490 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4260646.508720 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[18]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 70457.635198 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -31684.120406 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[18]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[18]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/18 163 4854.759296 22 120 0.000000 1.575387 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/18 164 -12.000000 3839 98 0.000000 2.726798 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/18 165 1745.146635 1115 0 0.000000 4.969956 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/18 166 -12.000000 22810 98 0.000000 585.705471 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/18 167 -12.000000 3073 98 0.000000 12.020055 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/18 168 70458.268042 29535 120 0.000000 147.980834 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/18:0H 170 487.204771 4 100 0.000000 0.032961 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/47-PCIe PME 519 0.000000 3 49 0.000000 0.042296 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/18:1 537 70425.153553 1322 120 0.000000 43.808340 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/18:1H 770 70076.874645 10956 100 0.000000 15.508744 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/18:2 1138 4943.776227 20 120 0.000000 0.164850 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/153-bnxt_qp 1413 0.000000 87 49 0.000000 0.396132 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/107-lom_2 1899 0.000000 3 49 0.000000 0.032851 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/89-bnxt_roc 2037 0.000000 539123 49 0.000000 1656.654081 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#19, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 111252 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967280 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.930296 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4265257.171941 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4264954.656100 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[19]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 25560.360145 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -76582.328441 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[19]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.006952 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[19]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/19 171 3491.540182 21 120 0.000000 0.536405 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/19 172 -11.995722 157 98 0.000000 0.680424 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/19 173 1837.150626 1117 0 0.000000 613.930018 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/19 174 -11.996083 12648 98 0.000000 54.635635 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/19 175 -11.997064 1409 98 0.000000 8.468220 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/19 176 25560.981574 16766 120 0.000000 76.190570 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/19:0H 178 110.213896 4 100 0.000000 0.029245 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/48-PCIe PME 520 0.000000 3 49 0.000000 0.030617 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/19:1H 768 25547.754102 3329 100 0.000000 42.070214 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 1609 -1.048576 1 120 0.000000 0.114735 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/133-lom_4-T 1987 0.000000 2125 49 0.000000 2.387721 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S restraintd 2834 18005.990701 9822 120 0.000000 5424.221429 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/19:4 30723 19147.981977 4 120 0.000000 0.052178 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/19:5 30724 25547.944373 539 120 0.000000 76.292877 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#20, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 84723 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 11 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.930771 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4265724.188988 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4265452.863033 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[20]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 20170.817635 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -81972.677866 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[20]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[20]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/20 179 3475.326667 21 120 0.000000 0.547645 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/20 180 -11.995913 122 98 0.000000 0.519521 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/20 181 1929.150591 1109 0 0.000000 615.801412 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/20 182 -11.996253 11760 98 0.000000 58.578284 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/20 183 -11.997065 1205 98 0.000000 6.229160 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/20 184 20158.897515 13947 120 0.000000 58.504249 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/20:0H 186 105.952469 4 100 0.000000 0.033383 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S oom_reaper 460 21.826372 2 120 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kintegrityd 465 21.826372 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/49-PCIe PME 521 0.000000 3 49 0.000000 0.030034 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/20:1 539 20158.635374 875 120 0.000000 25.218241 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/20:1H 778 20158.818432 2590 100 0.000000 31.295083 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/20:2 1250 3441.438208 5 120 0.000000 0.066086 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rpcbind 1572 26172.880421 281 120 0.000000 41.620896 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/83-lom_1-Tx 1864 0.000000 16136 49 0.000000 37.246284 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S sshd 2833 12757.995596 470 120 0.000000 51.570527 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#21, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 706491 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 15 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.931218 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4266177.186909 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4263106.644321 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[21]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 122035.583753 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : 19891.224620 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[21]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.031901 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[21]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S pr/ttyS0 18 121942.342318 3268 120 0.000000 8024.688349 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/21 187 3273.311779 21 120 0.000000 0.717735 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/21 188 -11.994380 525 98 0.000000 1.501695 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/21 189 2021.152640 1113 0 0.000000 4.916042 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/21 190 -11.995101 45686 98 0.000000 1227.151579 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/21 191 -11.996593 32089 98 0.000000 182.769015 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/21 192 122036.121470 66489 120 0.000000 264.235516 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/21:0H 194 1367.874781 4 100 0.000000 0.049613 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kswapd0 488 -13.012089 3 120 0.000000 0.057725 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/50-PCIe PME 522 0.000000 3 49 0.000000 0.047476 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/66-xhci_hcd 577 0.000000 224276 49 0.000000 2142.641391 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/21:1H 1083 122022.961627 5883 100 0.000000 27.208006 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/21:2 1203 121935.578358 122 120 0.000000 1.114388 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1406 3336.191899 2 100 0.000000 0.014959 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1418 3360.217084 2 100 0.000000 0.012293 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/156-bnxt_qp 1419 0.000000 51 49 0.000000 0.332462 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1426 3372.256745 2 100 0.000000 0.041797 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1434 3384.295214 2 100 0.000000 0.040496 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1441 3396.334156 2 100 0.000000 0.041127 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rdma_cm 1463 3430.162538 2 100 0.000000 0.022181 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S auditd 1573 70414.913353 633 116 0.000000 45.139662 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1677 257.111097 8 120 0.000000 0.653315 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S restraintd 2703 70428.739979 750 120 0.000000 225.635878 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 20114 7815.907041 1 120 0.000000 0.130374 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-cil/sda4 41867 44184.396014 2 100 0.000000 0.016109 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/21:0 47248 117561.525683 361 120 0.000000 7.013582 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/21:1 48014 122022.985804 204 120 0.000000 3.985103 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#22, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 241234 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967291 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.931858 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4266813.193071 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4266088.894695 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[22]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 116098.116684 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : 13952.450624 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[22]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[22]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/22 195 2785.963093 21 120 0.000000 0.528648 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/22 196 -11.995972 260 98 0.000000 0.851841 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/22 197 2113.154688 1101 0 0.000000 619.249585 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/22 198 -11.996153 25160 98 0.000000 757.671372 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/22 199 -11.997065 3720 98 0.000000 16.007894 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/22 200 116098.219917 27312 120 0.000000 134.339385 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/22:0H 202 1309.638286 4 100 0.000000 0.029947 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/52-PCIe PME 523 0.000000 3 49 0.000000 0.027912 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/22:1 541 116073.665196 4096 120 0.000000 220.107940 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S usb-storage 1005 116085.450451 319892 120 0.000000 7201.173438 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/22:1H 1040 116086.153796 5074 100 0.000000 72.531462 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/113-lom_2-T 1905 0.000000 2126 49 0.000000 2.642760 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/22:2 15410 30795.684588 11 120 0.000000 0.155674 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#23, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 241869 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.932261 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4267221.211505 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4266652.973642 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 996446 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[23]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 55987.340247 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -46159.131531 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[23]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.073188 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[23]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/23 203 2453.894556 21 120 0.000000 0.586574 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/23 204 -11.995732 184 98 0.000000 0.626268 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/23 205 2205.154652 1110 0 0.000000 619.768337 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/23 206 -11.996353 17210 98 0.000000 269.782557 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/23 207 -11.997035 5408 98 0.000000 21.379140 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/23 208 55987.860925 33607 120 0.000000 183.481596 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/23:0 209 1170.659848 7 120 0.000000 0.082413 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/23:0H 210 47.710146 4 100 0.000000 0.034825 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I md 472 11.029580 2 100 0.000000 0.004388 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/53-PCIe PME 524 0.000000 3 49 0.000000 0.030486 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/23:1 542 55975.984256 5460 120 0.000000 537.224841 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/23:1H 794 54287.094515 3130 100 0.000000 37.733328 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1694 10809.776306 3 120 0.000000 1.208256 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#24, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 270103 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 49 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.932718 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4267674.221008 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4266992.094702 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[24]:/system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 7284.896577 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -94862.468386 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->exec_start : 4266909.434111 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->vruntime : 37598.734643 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->sum_exec_runtime : 213.336463 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->load.weight : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[24]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 37600.199031 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -64547.473888 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[24]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[24]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/24 211 2956.549788 21 120 0.000000 0.601642 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/24 212 -11.997936 19883 98 0.000000 17.602584 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/24 213 2297.156703 1131 0 0.000000 622.069800 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/24 214 -11.997155 30402 98 0.000000 309.096586 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/24 215 -11.997826 22995 98 0.000000 90.929156 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/24 216 37600.378770 26480 120 0.000000 96.706632 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/24:0 217 -12.882014 4 120 0.000000 0.039894 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/24:0H 218 1230.711052 4 100 0.000000 0.026069 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/24:1 543 37586.339008 1382 120 0.000000 86.624478 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/55-ehci_hcd 566 0.000000 3 49 0.000000 0.061621 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/24:1H 1034 37587.588949 3204 100 0.000000 45.667876 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rsyslogd 1604 7272.661517 61 120 0.000000 9.415034 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S in:imjournal 1629 7275.065654 5516 120 0.000000 458.837529 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/111-lom_2-T 1903 0.000000 2127 49 0.000000 2.323380 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#25, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 574684 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.933290 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4268248.245213 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4266920.087046 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[25]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 21933.624372 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -80215.018833 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[25]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.933506 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[25]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I rcu_preempt 19 0.000411 270086 98 0.000000 4017.865264 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/25 219 2535.292541 21 120 0.000000 0.614015 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/25 220 -11.996344 205 98 0.000000 0.633374 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/25 221 2389.159459 1111 0 0.000000 642.873525 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/25 222 -11.997004 83436 98 0.000000 167.695654 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/25 223 -11.997886 85653 98 0.000000 363.583469 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/25 224 21933.972540 78997 120 0.000000 220.740636 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/25:0 225 -8.067633 5 120 0.000000 0.836564 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/25:0H 226 -8.097735 5 100 0.000000 0.030904 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/25:1 544 21911.756373 1052 120 0.000000 120.979969 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/57-xhci_hcd 567 0.000000 102 49 0.000000 0.949714 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/25:1H 575 21919.996523 3689 100 0.000000 51.121046 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/123-lom_3-T 1940 0.000000 2126 49 0.000000 2.593361 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S nfsd 42028 21366.308640 8974 120 0.000000 3336.704615 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#26, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 312921 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967259 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.933754 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4268714.251835 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4267851.673549 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[26]:/system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 4211.949693 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -97937.552980 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->exec_start : 4267629.657485 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->vruntime : 17055.066697 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->sum_exec_runtime : 317.793819 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->load.weight : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[26]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 17067.929116 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -85081.902938 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[26]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[26]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/26 227 3010.797739 22 120 0.000000 0.590417 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/26 228 -11.996523 102 98 0.000000 0.336795 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/26 229 2479.963818 1102 0 0.000000 643.560564 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/26 230 -11.997155 36816 98 0.000000 92.243866 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/26 231 -11.997676 34800 98 0.000000 133.961908 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/26 232 17068.402097 46323 120 0.000000 204.188273 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/26:0 233 -12.489832 4 120 0.000000 0.043238 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/26:0H 234 1788.947367 4 100 0.000000 0.028615 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/26:1 545 17049.728942 1509 120 0.000000 73.993474 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/58-xhci_hcd 568 0.000000 3 49 0.000000 0.058036 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/26:1H 1194 16941.021059 4906 100 0.000000 30.830009 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S systemd-udevd 1202 4065.823017 1229 120 0.000000 561.996354 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/150-bnxt_qp 1407 0.000000 4861 49 0.000000 25.004339 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S in:imjournal 1629 4202.162702 5517 120 0.000000 458.881461 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S lockd 42022 16137.963245 6 120 0.000000 0.065674 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#27, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 182814 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.934340 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4269301.228707 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4268559.152774 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[27]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 95726.786042 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -6423.830378 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[27]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[27]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/27 235 2571.980282 22 120 0.000000 0.560623 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/27 236 -11.996324 564 98 0.000000 1.796984 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/27 237 2571.968854 1114 0 0.000000 645.542385 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/27 238 -11.996424 31227 98 0.000000 1299.750970 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/27 239 -11.997446 5616 98 0.000000 25.612526 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/27 240 95727.316414 30284 120 0.000000 141.946084 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/27:0H 242 1497.100141 4 100 0.000000 0.048231 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/27:1 467 95671.927595 1734 120 0.000000 29.842303 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/59-xhci_hcd 569 0.000000 3 49 0.000000 0.072420 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/27:1H 1084 65229.251779 414 100 0.000000 4.902793 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/27:2 1088 1512.104435 4 120 0.000000 0.042019 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/117-lom_3 1934 0.000000 3 49 0.000000 0.031490 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S sshd 2830 0.885150 66 120 0.000000 37.080536 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#28, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 339752 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967289 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.934796 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4269755.234417 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4268184.435456 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[28]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 30040.286102 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -72111.207581 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[28]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.004959 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[28]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/28 243 1940.389158 21 120 0.000000 0.574835 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/28 244 -11.995952 251 98 0.000000 0.577084 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/28 245 2663.968819 1109 0 0.000000 4.832734 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/28 246 -11.996453 16834 98 0.000000 149.583437 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/28 247 -11.997445 8082 98 0.000000 43.275595 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/28 248 30040.780171 37550 120 0.000000 198.178858 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/28:0 249 -12.870402 4 120 0.000000 0.056501 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/28:0H 250 772.324396 4 100 0.000000 0.026680 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S khungtaskd 459 29914.414850 305 120 0.000000 1166.032833 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/28:1 546 30020.400434 1698 120 0.000000 33.130834 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/60-xhci_hcd 570 0.000000 3 49 0.000000 0.047147 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-conv/sda6 1100 772.258146 2 100 0.000000 0.015960 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/28:1H 1170 28508.030915 2034 100 0.000000 11.704685 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1679 41.049660 7 120 0.000000 0.827922 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1690 38.443672 1 120 0.000000 0.058590 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/90-bnxt_roc 2038 0.000000 60027 49 0.000000 299.675909 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#29, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 156303 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 35 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.935245 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4270203.257821 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4269786.046381 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[29]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 45841.306777 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -56311.083022 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[29]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[29]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/29 251 2225.356179 21 120 0.000000 0.657474 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/29 252 -11.995663 178 98 0.000000 0.630964 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/29 253 2755.971490 1100 0 0.000000 648.414366 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/29 254 -11.996143 18206 98 0.000000 256.097441 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/29 255 -11.997145 8141 98 0.000000 39.840962 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/29 256 45831.150701 20764 120 0.000000 76.969564 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/29:0H 258 77.613468 4 100 0.000000 0.034937 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/29:1 487 45829.468849 1784 120 0.000000 37.349848 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/61-xhci_hcd 571 0.000000 3 49 0.000000 0.032258 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/29:1H 781 45829.313215 3655 100 0.000000 51.809973 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/29:2 1347 2649.880057 14 120 0.000000 0.109354 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1416 2298.538549 2 100 0.000000 0.017894 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-log/sda2 1536 2645.754967 2 100 0.000000 0.019898 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/112-lom_2-T 1904 0.000000 2127 49 0.000000 1.872511 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S pool-restraintd 2706 25689.602982 585 120 0.000000 28.389959 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S anacron 40415 23900.984622 19 120 0.000000 6.363279 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#30, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 151524 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.935734 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4270695.275133 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4269993.646212 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[30]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 74265.930625 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -27887.527450 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[30]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.012683 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[30]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/30 259 3084.515857 21 120 0.000000 0.552356 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/30 260 -11.996584 355 98 0.000000 1.087256 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/30 261 2847.973589 1107 0 0.000000 650.552610 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/30 262 -11.996543 27068 98 0.000000 1130.008563 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/30 263 -11.997315 4624 98 0.000000 19.593990 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/30 264 74266.400057 28643 120 0.000000 137.776202 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/30:0H 266 3123.953059 4 100 0.000000 0.018405 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/30:1 547 74254.439532 2412 120 0.000000 42.076277 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/62-xhci_hcd 572 0.000000 3 49 0.000000 0.044120 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib-comp-unb-wq 1373 3059.317581 2 100 0.000000 0.016922 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib_nl_sa_wq 1375 3071.330410 2 100 0.000000 0.014588 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/30:1H 1555 74254.374746 2834 100 0.000000 38.545500 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/135-lom_4-T 1989 0.000000 2129 49 0.000000 2.234560 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/30:0 41686 29866.406449 6 120 0.000000 0.038091 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#31, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 151285 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 3 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.936156 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4271115.250978 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4270578.048299 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[31]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 28189.135476 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -73965.126807 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[31]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.049077 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[31]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/31 267 3035.902914 21 120 0.000000 1.386964 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/31 268 -12.000000 190 98 0.000000 0.609205 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/31 269 2940.824388 1104 0 0.000000 651.569121 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/31 270 -12.000000 14632 98 0.000000 77.869316 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/31 271 -12.000000 12899 98 0.000000 51.203437 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/31 272 28189.695913 29053 120 0.000000 114.833772 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/31:0 273 28177.727463 2886 120 0.000000 41.423805 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/31:0H 274 1520.023644 4 100 0.000000 0.021931 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/31:2 458 3035.897523 3 120 0.000000 0.002755 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/63-xhci_hcd 573 0.000000 3 49 0.000000 0.035054 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/31:1H 1087 28176.736495 2609 100 0.000000 28.545906 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/118-lom_3-T 1935 0.000000 2129 49 0.000000 4.081309 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42030 23893.067520 572 120 0.000000 173.769724 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#32, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 145817 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.936573 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4271523.257931 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4270840.628730 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 996268 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[32]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 24233.956360 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -77921.099528 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[32]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[32]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/32 275 3001.747365 21 120 0.000000 0.515221 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/32 276 -11.995391 169 98 0.000000 0.604945 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/32 277 3032.828191 1099 0 0.000000 653.345540 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/32 278 -11.996233 13235 98 0.000000 117.144064 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/32 279 -11.997355 8125 98 0.000000 31.588845 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/32 280 24234.054633 32533 120 0.000000 121.030947 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/32:0 281 -11.062932 4 120 0.000000 0.031347 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/32:0H 282 1337.885686 4 100 0.000000 0.024867 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/32:1 548 24222.065273 2335 120 0.000000 33.454953 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/64-xhci_hcd 574 0.000000 3 49 0.000000 0.047336 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/32:1H 1011 24221.749694 3363 100 0.000000 52.159537 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1428 3037.797492 2 100 0.000000 0.020819 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1436 3049.836412 2 100 0.000000 0.040977 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xprtiod 1499 3072.522022 2 100 0.000000 0.017954 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/109-lom_2-T 1901 0.000000 2128 49 0.000000 1.847145 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S make 8060 3171.516878 47 120 0.000000 31.524117 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-buf/sda4 41861 21229.199776 2 100 0.000000 0.044813 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D rpc.nfsd 42233 9595.467018 3 120 0.000000 3.505753 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#33, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 248716 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967282 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.937084 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4272043.265796 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4270998.222767 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[33]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 65094.137854 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -37061.868869 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[33]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.036668 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[33]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/33 284 3023.312870 21 120 0.000000 0.675560 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/33 285 -11.996173 1401 98 0.000000 8.169820 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/33 286 3127.828147 1111 0 0.000000 655.480470 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/33 287 -11.996384 32770 98 0.000000 881.521877 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/33 288 -11.997315 17043 98 0.000000 66.021738 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/33 289 65094.324555 43238 120 0.000000 192.613929 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/33:0H 291 61.775030 4 100 0.000000 0.025618 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kblockd 466 73.771674 2 100 0.000000 0.859987 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/33:1H 585 65081.300094 2872 100 0.000000 30.435469 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I mld 591 85.793693 2 100 0.000000 0.021099 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfsalloc 1097 1869.404898 2 100 0.000000 0.017533 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1408 3059.356423 2 100 0.000000 0.016431 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1693 36.492772 1 120 0.000000 0.040576 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/119-lom_3-T 1936 0.000000 2130 49 0.000000 2.957900 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/33:3 15447 65082.403448 4634 120 0.000000 47.746903 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S bash 32566 14851.841532 9619 120 0.000000 2078.777494 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u96:0 43279 64172.021365 14656 120 0.000000 308.346262 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u96:2 46403 65081.317006 10215 120 0.000000 322.225578 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/33:1 47572 57436.057739 2 120 0.000000 0.039083 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#34, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 217883 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 247 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.937570 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4272531.279641 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4271793.214807 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[34]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 23085.552402 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -79071.421877 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[34]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000251 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[34]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/34 292 3715.829307 21 120 0.000000 0.620203 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/34 293 -11.996313 159 98 0.000000 0.574936 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/34 294 3219.828116 1106 0 0.000000 4.741665 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/34 295 -11.996404 17865 98 0.000000 61.770819 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/34 296 -11.997375 15656 98 0.000000 48.639564 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/34 297 23086.016626 39937 120 0.000000 185.380284 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/34:0H 299 1895.587302 4 100 0.000000 0.065683 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/34:1 550 23074.070156 5015 120 0.000000 56.142594 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/67-xhci_hcd 578 0.000000 3 49 0.000000 0.052806 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/34:1H 1080 23070.640630 3126 100 0.000000 19.866502 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/34:2 1388 3693.470446 7 120 0.000000 0.028723 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-buf/sda2 1530 3742.777517 2 100 0.000000 0.021490 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S xfsaild/sda2 1538 8204.251909 33 120 0.000000 1.087167 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/86-lom_1-Tx 1867 0.000000 10623 49 0.000000 22.003155 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-conv/sda4 41862 20809.406356 2 100 0.000000 0.046427 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#35, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 380781 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967290 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.938046 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4273007.276375 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4272239.322654 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[35]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 29197.188499 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -72960.741038 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 1048576 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 3 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[35]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.051457 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[35]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/35 300 2645.873498 22 120 0.000000 0.683179 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/35 301 -11.995231 160 98 0.000000 0.552089 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/35 302 3311.830787 1102 0 0.000000 658.562542 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/35 303 -11.995933 20376 98 0.000000 131.782390 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/35 304 -11.997385 19650 98 0.000000 67.414797 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/35 305 29197.750585 41112 120 0.000000 180.758931 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/35:0H 307 1405.265669 4 100 0.000000 0.059781 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/35:1 551 29185.801923 91595 120 0.000000 4303.889895 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/68-xhci_hcd 579 0.000000 3 49 0.000000 0.027560 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I scsi_tmf_0 1004 1236.900966 2 100 0.000000 0.017333 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/35:1H 1081 29184.925156 43855 100 0.000000 403.707092 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ipmi-msghandler 1321 2332.179229 2 100 0.000000 0.014276 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I target_completi 1477 2706.718563 2 100 0.000000 0.020368 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/120-lom_3-T 1937 0.000000 2132 49 0.000000 3.744034 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/35:2 42177 25346.030371 186 120 0.000000 3.043757 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#36, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 209087 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 12 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.938480 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4273441.282817 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4272933.504946 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[36]:/system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 57911.543778 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -44247.231317 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 1024 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->exec_start : 4272495.547592 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->vruntime : 51007.747416 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->sum_exec_runtime : 29718.648945 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->load.weight : 36242 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .se->avg.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[36]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 51007.747416 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -51151.371647 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[36]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[36]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/36 308 4149.960392 22 120 0.000000 1.426444 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/36 309 -12.000000 273 98 0.000000 0.878149 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/36 310 3403.832822 1112 0 0.000000 4.911184 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/36 311 -12.000000 22205 98 0.000000 709.071873 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/36 312 -12.000000 4520 98 0.000000 25.500950 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/36 313 50996.486681 19579 120 0.000000 73.081237 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/36:1 552 50994.824684 3275 120 0.000000 70.886278 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/69-xhci_hcd 580 0.000000 3 49 0.000000 0.027320 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/36:1H 1171 50994.794818 13656 100 0.000000 174.871473 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/149-bnxt_qp 1405 0.000000 9704 49 0.000000 19.770340 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S dbus-broker 1595 57887.587497 14380 120 0.000000 371.933192 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/127-lom_4 1981 0.000000 3 49 0.000000 0.050004 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/131-lom_4-T 1985 0.000000 2132 49 0.000000 3.927149 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/36:0 41095 26628.927421 5 120 0.000000 0.048311 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/36:2H 41769 26989.319136 4 100 0.000000 0.035366 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S opensm 48457 57911.543778 1 120 0.000000 0.030246 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#37, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 132418 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.939127 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4274083.308034 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4273799.717125 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[37]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[37]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/37 316 2887.328223 21 120 0.000000 0.489514 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/37 317 -11.996314 167 98 0.000000 0.632005 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/37 318 3495.832789 1102 0 0.000000 661.525081 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/37 319 -11.996173 12852 98 0.000000 108.128706 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/37 320 -11.996925 5602 98 0.000000 23.421521 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/37 321 19379.271861 16777 120 0.000000 60.954159 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/37:0H 323 45.036253 4 100 0.000000 0.036389 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I cryptd 464 49.260344 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/70-xhci_hcd 581 0.000000 3 49 0.000000 0.027779 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/37:1H 946 17950.957595 56 100 0.000000 0.675587 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/37:2 1658 19379.186270 841 120 0.000000 21.370255 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S tuned 1683 15184.972067 1060 120 0.000000 237.352779 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/37:0 31965 13684.799187 4 120 0.000000 0.064992 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S run_plugins 47447 11249.374637 31 120 0.000000 30.837707 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#38, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 161372 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 12 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.939434 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4274395.323804 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4273840.449786 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[38]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 29480.987058 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -72679.684871 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[38]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[38]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/38 324 6053.025528 21 120 0.000000 0.537418 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/38 325 -11.995051 174 98 0.000000 0.673862 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/38 326 3587.832754 1108 0 0.000000 663.653709 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/38 327 -11.995953 13348 98 0.000000 55.411278 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/38 328 -11.996674 7160 98 0.000000 36.408754 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/38 329 29481.603393 32764 120 0.000000 180.459242 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/38:0H 331 488.563078 4 100 0.000000 0.034755 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I blkcg_punt_bio 468 27.221398 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/38:1 553 29413.118012 1349 120 0.000000 40.873683 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/71-xhci_hcd 582 0.000000 3 49 0.000000 0.044630 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/38:1H 874 21615.210466 828 100 0.000000 4.842055 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/151-bnxt_qp 1409 0.000000 961 49 0.000000 1.881651 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-blockgc/sda 1533 6630.186565 2 100 0.000000 0.045174 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S dbus-broker-lau 1594 20950.841498 141 120 0.000000 29.981251 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S systemd-logind 1607 21401.636564 4702 120 0.000000 279.136427 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/91-bnxt_roc 2039 0.000000 109 49 0.000000 0.699775 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/38:3 30648 17680.208871 15 120 0.000000 0.268412 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-blockgc/sda 41864 20931.221909 2 100 0.000000 0.027200 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42029 20989.391220 478 120 0.000000 88.120319 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#39, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 132368 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967290 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.939967 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4274925.302233 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4274488.406276 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[39]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 43409.443734 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -58752.360944 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 4 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[39]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000631 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[39]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/39 332 2551.979476 21 120 0.000000 0.546082 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/39 333 -11.996143 272 98 0.000000 0.854091 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/39 334 3679.834820 1101 0 0.000000 664.559715 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/39 335 -11.996143 19131 98 0.000000 575.111262 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/39 336 -11.997055 3245 98 0.000000 15.259011 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/39 337 43409.955284 19159 120 0.000000 80.749385 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/39:0 338 8756.225662 6 120 0.000000 0.053909 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/39:0H 339 2495.579828 4 100 0.000000 0.024164 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/72-xhci_hcd 583 0.000000 3 49 0.000000 0.043648 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/39:1H 1366 43397.379279 3168 100 0.000000 50.569322 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/134-lom_4-T 1988 0.000000 2130 49 0.000000 2.076812 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S crond 2701 68752.192074 107 120 0.000000 24.961571 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 2865 15789.003878 14 120 0.000000 1.054445 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/39:2 15445 43395.467491 1822 120 0.000000 46.989614 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42026 28077.029052 414 120 0.000000 94.205634 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S exportfs 43325 15800.859758 2 120 0.000000 1.577398 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#40, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 101810 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 20 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.940423 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4275378.304973 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4275100.710597 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[40]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 19005.178807 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -83157.495927 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[40]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.001753 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[40]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/40 340 3435.803414 21 120 0.000000 0.527198 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/40 341 -11.996013 135 98 0.000000 0.453776 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/40 342 3771.834785 1104 0 0.000000 666.598294 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/40 343 -11.996153 10929 98 0.000000 85.419699 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/40 344 -11.997115 1818 98 0.000000 6.483849 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/40 345 18994.884097 12681 120 0.000000 49.690271 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/40:0H 347 1652.358052 4 100 0.000000 0.035044 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I tpm_dev_wq 471 88.107038 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/40:1 555 18993.111582 1036 120 0.000000 26.649296 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/73-xhci_hcd 584 0.000000 3 49 0.000000 0.043550 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs_mru_cache 1098 1644.779624 2 100 0.000000 0.018315 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-buf/sda6 1099 1656.798240 2 100 0.000000 0.020158 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/40:1H 1137 18993.179068 3148 100 0.000000 46.888270 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/154-bnxt_qp 1415 0.000000 95 49 0.000000 0.299663 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-conv/sda2 1531 3774.723981 2 100 0.000000 0.043712 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-cil/sda2 1537 3786.763023 2 100 0.000000 0.041118 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/40:2 1552 3798.808575 2 120 0.000000 0.016251 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/128-lom_4-T 1982 0.000000 2131 49 0.000000 6.939245 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/129-lom_4-T 1983 0.000000 2130 49 0.000000 3.963184 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/u96:7 31746 18994.161138 46839 120 0.000000 1262.862193 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#41, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 242130 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 21 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.940966 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4275918.345830 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4275371.169276 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[41]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 23021.344206 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -79142.368305 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[41]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[41]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/41 348 3395.780051 21 120 0.000000 0.548640 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/41 349 -11.995793 277 98 0.000000 0.754909 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/41 350 3863.838678 1119 0 0.000000 667.599412 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/41 351 -11.995983 12088 98 0.000000 71.479488 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/41 352 -11.997055 3223 98 0.000000 14.733736 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/41 353 23013.286683 15648 120 0.000000 59.046401 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/41:0H 355 168.360821 4 100 0.000000 0.069786 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/41:1 556 23009.369262 1169 120 0.000000 29.577144 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/8-rtc0 589 0.000000 4 49 0.000000 0.080145 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/41:1H 590 22731.564942 1288 100 0.000000 3.709935 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I zswap-shrink 606 216.504383 2 100 0.000000 0.016329 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/41:2 1075 3841.689956 5 120 0.000000 0.049974 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I bnxt_qplib_nq 1412 3431.802658 2 100 0.000000 0.016150 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1680 49.790524 8 120 0.000000 0.590536 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S tuned 2036 258.223135 1 120 0.000000 0.244659 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/95-bnxt_roc 2043 0.000000 70219 49 0.000000 82.580742 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42025 21194.815798 416 120 0.000000 92.052446 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#42, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 153925 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967292 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.941419 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4276379.319425 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4275704.596985 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 996436 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[42]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 40332.803265 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -61831.582414 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[42]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.006040 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[42]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/42 356 3444.651038 22 120 0.000000 0.585903 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/42 357 -11.996032 248 98 0.000000 0.911259 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/42 358 3955.840706 1114 0 0.000000 669.456681 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/42 359 -11.995883 18216 98 0.000000 430.727888 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/42 360 -11.996494 1408 98 0.000000 7.117670 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/42 361 40333.507918 36084 120 0.000000 217.345873 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/42:0H 363 -9.578106 4 100 0.000000 0.047861 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/42:1 557 40244.988056 1264 120 0.000000 50.295067 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/42:1H 729 40317.480103 3036 100 0.000000 42.345876 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 1667 55829.803964 1127 120 0.000000 76.275304 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S (sd-pam) 1661 -1.048576 1 120 0.000000 0.375003 0.000000 0.000000 /user.slice/user-0.slice/user@0.service/init.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gssproxy 1691 56.699634 1 120 0.000000 0.038312 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/114-lom_2-T 1906 0.000000 2130 49 0.000000 2.129004 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S agetty 2206 594.574881 38 120 0.000000 46.312153 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/42:2 43296 31928.370546 2 120 0.000000 0.016591 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#43, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 143414 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 7 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.941903 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4276864.325501 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4276314.007550 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[43]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 26993.079849 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -75172.062296 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[43]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[43]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/43 364 4256.372629 21 120 0.000000 0.516633 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/43 365 -11.996043 192 98 0.000000 0.794091 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/43 366 4047.840671 1113 0 0.000000 671.733271 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/43 367 -11.996123 15220 98 0.000000 53.944967 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/43 368 -11.996934 4111 98 0.000000 19.891494 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/43 369 26993.595953 34787 120 0.000000 193.586882 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/43:0H 371 140.897295 4 100 0.000000 0.023294 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kcompactd0 462 26981.290475 8484 120 0.000000 221.689861 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I edac-poller 473 89.075472 2 100 0.000000 0.000000 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/43:1 558 26914.752613 1356 120 0.000000 49.298571 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/43:1H 799 26865.241832 207 100 0.000000 1.699230 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/76-psp-1 1001 0.000000 3 49 0.000000 0.031659 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S JS Helper 1676 -12.264856 7 120 0.000000 0.890090 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S chronyd 1657 32878.419254 696 120 0.000000 67.440651 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S tuned 2045 246.108047 3 120 0.000000 1.043978 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S sshd 11172 31065.489606 82 120 0.000000 36.587937 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/43:0 42047 26364.069315 2 120 0.000000 0.014657 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#44, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 169850 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 3 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.942364 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4277326.330861 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4276712.357853 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[44]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 26402.768510 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -75763.086520 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[44]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[44]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/44 372 4430.706797 22 120 0.000000 0.572203 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/44 373 -11.995522 199 98 0.000000 0.790267 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/44 374 4139.842776 1116 0 0.000000 672.787427 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/44 375 -11.996013 17127 98 0.000000 76.114213 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/44 376 -11.997064 4419 98 0.000000 23.557837 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/44 377 26403.298276 38954 120 0.000000 214.321825 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/44:0H 379 726.970424 4 100 0.000000 0.049153 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/44:1 559 26385.327146 1548 120 0.000000 121.491178 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kmpath_rdacd 564 218.908905 2 100 0.000000 0.016321 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ipv6_addrconf 593 242.965480 2 100 0.000000 0.025767 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/44:1H 846 26389.907480 2529 100 0.000000 27.670126 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/136-0000:c2 1325 0.000000 3 49 0.000000 0.024745 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/81-lom_1-Tx 1862 0.000000 3057 49 0.000000 8.740459 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S NFSv4 callback 3607 5837.156983 2 120 0.000000 0.043442 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S opensm-launch 15623 25200.375930 287 120 0.000000 96.386894 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/44:0 39672 24118.215968 3 120 0.000000 0.018454 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-inodegc/sda 41865 24740.099858 2 100 0.000000 0.045876 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: D nfsd 42024 25686.286771 177 120 0.000000 42.637507 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#45, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 148432 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 13 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.942882 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4277842.375875 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4277120.852137 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[45]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 79610.396752 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -22556.196424 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[45]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.013636 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[45]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/45 380 2399.504938 21 120 0.000000 0.610612 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/45 381 -11.995823 248 98 0.000000 0.759587 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/45 382 4231.844845 1103 0 0.000000 4.811953 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/45 383 -11.995963 25199 98 0.000000 907.809910 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/45 384 -11.997034 5172 98 0.000000 22.380832 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/45 385 79610.708858 27758 120 0.000000 133.908131 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/45:0H 387 54.158122 4 100 0.000000 0.035476 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksmd 463 42.092108 2 125 0.000000 0.003276 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/45:1 560 79556.403428 1750 120 0.000000 53.259753 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/45:1H 785 79597.202570 3291 100 0.000000 44.919530 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S xfsaild/sda6 1106 79600.567317 86119 120 0.000000 2228.243055 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/138-0000:c3 1326 0.000000 3 49 0.000000 0.029394 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/121-lom_3-T 1938 0.000000 2131 49 0.000000 2.104929 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/45:2 7975 6958.544654 2 120 0.000000 0.038102 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#46, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 227762 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967271 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.943304 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4278263.344762 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4277568.472607 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[46]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 98654.212370 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -3513.023548 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 1048576 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[46]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.106172 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[46]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/46 388 3233.390253 21 120 0.000000 0.521909 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/46 389 -11.996083 267 98 0.000000 0.830607 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/46 390 4323.844813 1102 0 0.000000 675.393057 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/46 391 -11.996273 23005 98 0.000000 773.842541 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/46 392 -11.997095 6299 98 0.000000 24.166122 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/46 393 98654.758182 31384 120 0.000000 152.275866 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/46:0H 395 886.390133 4 100 0.000000 0.038021 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/46:1 561 98642.783931 5668 120 0.000000 271.223796 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/46:1H 990 98639.529904 4665 100 0.000000 52.546764 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S scsi_eh_0 1003 1122.836716 2 120 0.000000 0.023083 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/139-0000:82 1328 0.000000 3 49 0.000000 0.033614 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I ib-comp-wq 1372 3240.370918 2 100 0.000000 0.017602 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/82-lom_1-Tx 1863 0.000000 3479 49 0.000000 10.222434 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/46:2 7696 6963.668611 2 120 0.000000 0.040535 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cpu#47, 2794.923 MHz Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_switches : 180713 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_uninterruptible : 4294967276 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .next_balance : 4298.943768 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .curr->pid : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock : 4278728.356178 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .clock_task : 4278101.404680 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .avg_idle : 1000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_idle_balance_cost : 500000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: cfs_rq[47]:/ Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .exec_clock : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .MIN_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .min_vruntime : 39886.809566 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .max_vruntime : 0.000001 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .spread0 : -62281.097440 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_spread_over : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .idle_h_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .runnable_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_avg : 1 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .util_est_enqueued : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.util_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .removed.runnable_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg_contrib : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .tg_load_avg : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .throttle_count : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_rq[47]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_throttled : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_time : 0.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .rt_runtime : 950.000000 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: dl_rq[47]: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_running : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_nr_migratory : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->bw : 996147 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: .dl_bw->total_bw : 0 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: runnable tasks: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S task PID tree-key switches prio wait-time sum-exec sum-sleep Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ------------------------------------------------------------------------------------------------------------- Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S cpuhp/47 396 2898.560221 22 120 0.000000 0.603008 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq_work/47 397 -11.995411 124 98 0.000000 0.430767 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S migration/47 398 4415.846962 1096 0 0.000000 677.545047 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rcuc/47 399 -11.996063 16479 98 0.000000 216.694799 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ktimers/47 400 -11.997104 5358 98 0.000000 23.077058 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S ksoftirqd/47 401 39887.065557 32801 120 0.000000 178.486311 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/47:0H 403 1450.570915 4 100 0.000000 0.032030 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S kauditd 454 39064.841763 650 120 0.000000 20.710280 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kthrotld 496 35.108314 2 100 0.000000 0.037797 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kaluad 565 59.140955 2 100 0.000000 0.015700 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kstrp 594 83.196428 2 100 0.000000 0.024634 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/47:1H 1072 39874.995700 4715 100 0.000000 64.673610 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/141-0000:81 1329 0.000000 3 49 0.000000 0.034596 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I xfs-reclaim/sda 1532 3061.018642 2 100 0.000000 0.041197 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S gmain 1668 24.712017 2 120 0.000000 0.118791 0.000000 0.000000 /system.slice Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S irq/132-lom_4-T 1986 0.000000 2133 49 0.000000 1.957686 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: S rstrnt-sync 20113 12876.222424 92 120 0.000000 13.123990 0.000000 0.000000 /user.slice/user-0.slice/session-2.scope Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/47:0 31966 39817.475465 2754 120 0.000000 97.305101 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: I kworker/47:3 39509 19476.864192 5 120 0.000000 0.054010 0.000000 0.000000 / Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Showing busy workqueues and worker pools: Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: workqueue events_highpri: flags=0x10 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pwq 33: cpus=16 node=0 flags=0x0 nice=-20 active=1/256 refcnt=2 Dec 29 13:58:52 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: pending: mix_interrupt_randomness Dec 29 13:58:56 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com logger[48500]: List of t Tasks: Stop Dec 29 13:58:58 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com logger[48504]: List of w Tasks: Start Dec 29 13:58:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: sysrq: Show Blocked State Dec 29 13:58:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42024 ppid: 2 flags:0x00004000 Dec 29 13:58:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:58:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:58:59 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42025 ppid: 2 flags:0x00004000 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: wait_for_completion_killable+0x20/0x40 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_sendto+0x1f7/0x380 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_send+0x49/0x210 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xd5/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42026 ppid: 2 flags:0x00004000 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: wait_for_completion_killable+0x20/0x40 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_sendto+0x1f7/0x380 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_send+0x49/0x210 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xd5/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42027 ppid: 2 flags:0x00004000 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42029 ppid: 2 flags:0x00004000 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:nfsd state:D stack: 0 pid:42030 ppid: 2 flags:0x00004000 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_process_read_list+0x103/0x300 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_rdma_recvfrom+0x217/0x470 [rpcrdma] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_handle_xprt+0x350/0x400 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_recv+0xa1/0x1d0 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? nfsd_shutdown_threads+0xa0/0xa0 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd+0xc3/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread+0x106/0x130 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? kthread_complete_and_exit+0x20/0x20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ret_from_fork+0x22/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:rpc.nfsd state:D stack: 0 pid:42233 ppid: 1 flags:0x00000006 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule_timeout+0x151/0x190 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? resched_curr+0x20/0xe0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x70/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __wait_for_common+0x8e/0x1c0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? usleep_range_state+0x90/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: kthread_stop+0x62/0x1d0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: svc_set_num_threads+0x10d/0x200 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsd_svc+0x123/0x190 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_threads+0x95/0x100 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? _copy_from_user+0x3a/0x60 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? simple_transaction_get+0xc4/0xf0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? write_pool_threads+0x230/0x230 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: nfsctl_transaction_write+0x46/0x80 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7fbc26a37be7 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffe615eb898 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007fbc26a37be7 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 0000000000000002 RSI: 000055b890ce8c20 RDI: 0000000000000003 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: 00007ffe615eb730 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 000055b890ce8c20 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 00007fbc268f66c0 R14: 00007ffe615eb960 R15: 00000000ffffffff Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: task:exportfs state:D stack: 0 pid:42783 ppid: 1 flags:0x00000006 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Call Trace: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: __schedule+0x25b/0x660 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: schedule+0x5d/0xd0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock_block.constprop.0+0x33/0x170 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: rt_mutex_slowlock.constprop.0+0xd9/0x150 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: expkey_flush+0x11/0x40 [nfsd] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: write_flush.constprop.0+0xdd/0x120 [sunrpc] Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? selinux_file_permission+0x108/0x150 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: proc_reg_write+0x55/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? preempt_count_add+0x4d/0xa0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: vfs_write+0xb5/0x2e0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ksys_write+0x62/0xe0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: do_syscall_64+0x5c/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? migrate_enable+0xd5/0x150 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_sys_openat2+0x85/0x160 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? syscall_exit_to_user_mode+0x12/0x30 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? do_syscall_64+0x69/0x90 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: ? exc_page_fault+0x65/0x180 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RIP: 0033:0x7f93cd117be7 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RSP: 002b:00007ffdf38f9ae8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RAX: ffffffffffffffda RBX: 000055b4b4c2ea50 RCX: 00007f93cd117be7 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RDX: 000000000000000b RSI: 00007ffdf38f9af0 RDI: 0000000000000004 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: RBP: 00007ffdf38f9b10 R08: 0000000000000000 R09: 00007f93cd18a4e0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffdf38f9af0 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: R13: 000000000000000b R14: 000055b4b4c2b526 R15: 0000000000000004 Dec 29 13:59:00 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com kernel: Dec 29 13:59:03 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com logger[48516]: List of w Tasks: Stop Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Dumping slabinfo - Start - 2022-12-29 13:59:05 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: slabinfo - version: 2.1 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: # name : tunables : slabdata Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd_file_mark 78 78 104 39 1 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd_file 78 78 104 39 1 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd_drc 5472 5472 128 32 1 : tunables 0 0 0 : slabdata 171 171 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs4_layout_stateid 0 0 352 46 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs4_layout 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_odstate 0 0 40 102 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_delegations 0 0 280 29 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_stateids 0 0 216 37 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_files 0 0 336 48 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_lockowners 0 0 392 41 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_openowners 0 0 432 37 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfsd4_clients 22 22 1432 22 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: tcmu_cmd_cache 0 0 80 51 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs4_xattr_cache_cache 0 0 3688 8 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_direct_cache 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_commit_data 42 42 768 42 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_write_data 34 34 960 34 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_read_data 0 0 960 34 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_inode_cache 54 54 1192 27 8 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nfs_page 0 0 128 32 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fscache_cookie_jar 0 0 208 39 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_groupinfo_4k 210 210 192 42 2 : tunables 0 0 0 : slabdata 5 5 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_fc_dentry_update 0 0 96 42 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_inode_cache 22 22 1472 22 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_free_data 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_allocation_context 0 0 144 28 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_prealloc_space 0 0 128 32 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_system_zone 102 102 40 102 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_io_end_vec 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_io_end 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_bio_post_read_ctx 170 170 48 85 1 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_pending_reservation 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ext4_extent_status 102 102 40 102 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fat_inode_cache 70 70 912 35 8 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fat_cache 0 0 40 102 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: mbcache 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_transaction_s 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_inode 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_journal_handle 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_journal_head 0 0 152 53 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_revoke_table_s 256 256 16 256 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: jbd2_revoke_record_s 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: rpc_inode_cache 156 156 832 39 8 : tunables 0 0 0 : slabdata 4 4 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: rpc_buffers 480 480 2048 16 8 : tunables 0 0 0 : slabdata 30 30 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: rpc_tasks 992 992 256 32 2 : tunables 0 0 0 : slabdata 31 31 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lio_r2t_cache 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lio_ooo_cache 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lio_dr_cache 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lio_qr_cache 256 256 32 128 1 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_alua_lba_map_mem_cache 0 0 24 170 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_alua_lba_map_cache 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_alua_tg_pt_gp_cache 52 52 312 52 4 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_alua_lu_gp_mem_cache 56 56 72 56 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_alua_lu_gp_cache 37 37 216 37 2 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: t10_pr_reg_cache 0 0 704 46 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: se_ua_cache 0 0 24 170 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: se_sess_cache 30 30 272 30 2 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: iser_descriptors 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:02:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:01:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:42:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:41:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:81:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:82:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:c3:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: 0000:c2:00.2-dmaengine-desc-cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fuse_request 0 0 176 46 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fuse_inode 0 0 1024 32 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_dqtrx 0 0 528 31 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_dquot 0 0 520 31 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_buf 4416 4428 448 36 4 : tunables 0 0 0 : slabdata 123 123 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_bui_item 1720 1800 200 40 2 : tunables 0 0 0 : slabdata 45 45 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_bud_item 2064 2112 168 48 2 : tunables 0 0 0 : slabdata 44 44 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_cui_item 1710 1862 424 38 4 : tunables 0 0 0 : slabdata 49 49 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_cud_item 2160 2352 168 48 2 : tunables 0 0 0 : slabdata 49 49 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_rui_item 0 0 680 48 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_rud_item 0 0 168 48 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_icr 0 0 176 46 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_ili 3985 3996 224 36 2 : tunables 0 0 0 : slabdata 111 111 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_inode 37800 37800 1152 28 8 : tunables 0 0 0 : slabdata 1350 1350 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_efi_item 1824 1976 424 38 4 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_efd_item 1776 1924 432 37 4 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_buf_item 1488 1612 264 31 2 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_trans 1680 1680 232 35 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_ifork 49744 49776 40 102 1 : tunables 0 0 0 : slabdata 488 488 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_da_state 1564 1564 480 34 4 : tunables 0 0 0 : slabdata 46 46 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_extfree_intent 4896 4896 40 102 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_bmap_intent 2752 2752 64 64 1 : tunables 0 0 0 : slabdata 43 43 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_refc_intent 5760 5760 32 128 1 : tunables 0 0 0 : slabdata 45 45 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_rmap_intent 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_defer_pending 3504 3504 56 73 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_refcbt_cur 1800 1800 200 40 2 : tunables 0 0 0 : slabdata 45 45 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_rmapbt_cur 0 0 248 33 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_bmbt_cur 165 165 248 33 2 : tunables 0 0 0 : slabdata 5 5 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_inobt_cur 1920 1920 200 40 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_bnobt_cur 1776 1776 216 37 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfs_log_ticket 2112 2112 184 44 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bio-136 2016 2016 192 42 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sd_ext_cdb 128 128 32 128 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: scsi_sense_cache 64 64 128 32 1 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: zswap_entry 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: MPTCPv6 0 0 2432 13 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip6-frags 0 0 232 35 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fib6_nodes 640 640 64 64 1 : tunables 0 0 0 : slabdata 10 10 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip6_dst_cache 864 864 256 32 2 : tunables 0 0 0 : slabdata 27 27 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip6_mrt_cache 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: PINGv6 184 184 1408 23 8 : tunables 0 0 0 : slabdata 8 8 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: RAWv6 304 345 1408 23 8 : tunables 0 0 0 : slabdata 15 15 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UDPLITEv6 0 0 1536 21 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UDPv6 609 609 1536 21 8 : tunables 0 0 0 : slabdata 29 29 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: tw_sock_TCPv6 310 310 264 31 2 : tunables 0 0 0 : slabdata 10 10 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: request_sock_TCPv6 612 612 320 51 4 : tunables 0 0 0 : slabdata 12 12 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: TCPv6 220 220 2752 11 8 : tunables 0 0 0 : slabdata 20 20 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: uhci_urb_priv 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sgpool-128 168 168 4096 8 8 : tunables 0 0 0 : slabdata 21 21 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sgpool-64 16 16 2048 16 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sgpool-32 1536 1536 1024 32 8 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sgpool-16 1504 1504 512 32 4 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sgpool-8 1536 1536 256 32 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: btree_node 0 0 128 32 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bfq_io_cq 0 0 232 35 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bfq_queue 0 0 568 28 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bio-264 51 51 320 51 4 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: mqueue_inode_cache 28 28 1152 28 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kioctx 0 0 640 51 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: aio_kiocb 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: userfaultfd_ctx_cache 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fanotify_perm_event 0 0 72 56 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fanotify_path_event 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fanotify_fid_event 0 0 72 56 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fsnotify_mark 0 0 96 42 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dnotify_mark 0 0 104 39 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dnotify_struct 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dio 0 0 704 46 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fasync_cache 0 0 88 46 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: audit_tree_mark 0 0 104 39 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: pid_namespace 0 0 168 48 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: posix_timers_cache 495 495 296 55 4 : tunables 0 0 0 : slabdata 9 9 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UNIX-STREAM 1104 1104 1408 23 8 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UNIX 1081 1081 1408 23 8 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip4-frags 0 0 248 33 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip_mrt_cache 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UDP-Lite 0 0 1344 24 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: MPTCP 0 0 2304 14 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: request_sock_subflow 0 0 392 41 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: tcp_bind_bucket 1184 1184 128 32 1 : tunables 0 0 0 : slabdata 37 37 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: inet_peer_cache 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfrm_dst_cache 0 0 320 51 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: xfrm_state 0 0 832 39 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip_fib_trie 850 850 48 85 1 : tunables 0 0 0 : slabdata 10 10 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip_fib_alias 730 730 56 73 1 : tunables 0 0 0 : slabdata 10 10 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ip_dst_cache 1974 1974 192 42 2 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: PING 182 182 1216 26 8 : tunables 0 0 0 : slabdata 7 7 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: RAW 286 312 1216 26 8 : tunables 0 0 0 : slabdata 12 12 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: UDP 1104 1104 1344 24 8 : tunables 0 0 0 : slabdata 46 46 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: tw_sock_TCP 775 775 264 31 2 : tunables 0 0 0 : slabdata 25 25 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: request_sock_TCP 1071 1071 320 51 4 : tunables 0 0 0 : slabdata 21 21 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: TCP 480 480 2560 12 8 : tunables 0 0 0 : slabdata 40 40 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: hugetlbfs_inode_cache 160 160 816 40 8 : tunables 0 0 0 : slabdata 4 4 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dquot 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bio-256 2448 2448 320 51 4 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ep_head 12288 12288 16 256 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: eventpoll_pwq 3078 3136 64 64 1 : tunables 0 0 0 : slabdata 49 49 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: eventpoll_epi 1562 1664 128 32 1 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: inotify_inode_mark 1674 1677 104 39 1 : tunables 0 0 0 : slabdata 43 43 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dax_cache 34 34 960 34 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: request_queue_srcu 0 0 1616 20 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: request_queue 27 27 1184 27 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: blkdev_ioc 420 420 144 28 1 : tunables 0 0 0 : slabdata 15 15 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bio-200 1536 1632 256 32 2 : tunables 0 0 0 : slabdata 51 51 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: biovec-max 420 456 4096 8 8 : tunables 0 0 0 : slabdata 57 57 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: biovec-128 0 0 2048 16 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: biovec-64 1408 1408 1024 32 8 : tunables 0 0 0 : slabdata 44 44 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: biovec-16 1504 1504 256 32 2 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bio_integrity_payload 42 42 192 42 2 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ksm_mm_slot 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ksm_stable_node 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ksm_rmap_item 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: user_namespace 52 52 624 52 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: uid_cache 544 544 128 32 1 : tunables 0 0 0 : slabdata 17 17 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: iommu_iova 121472 121472 64 64 1 : tunables 0 0 0 : slabdata 1898 1898 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dmaengine-unmap-256 15 15 2112 15 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dmaengine-unmap-128 30 30 1088 30 8 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dmaengine-unmap-16 42 42 192 42 2 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dmaengine-unmap-2 64 64 64 64 1 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: audit_buffer 7820 7820 24 170 1 : tunables 0 0 0 : slabdata 46 46 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sock_inode_cache 1671 1792 1024 32 8 : tunables 0 0 0 : slabdata 56 56 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: skbuff_ext_cache 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: skbuff_fclone_cache 1504 1504 512 32 4 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: skbuff_head_cache 1596 1664 256 32 2 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: configfs_dir_cache 746 874 88 46 1 : tunables 0 0 0 : slabdata 19 19 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: file_lock_cache 1564 1564 240 34 2 : tunables 0 0 0 : slabdata 46 46 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: file_lock_ctx 3672 3672 80 51 1 : tunables 0 0 0 : slabdata 72 72 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fsnotify_mark_connector 2688 2688 64 64 1 : tunables 0 0 0 : slabdata 42 42 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: buffer_head 1440 1440 136 30 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: task_delay_info 0 0 112 36 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: taskstats 1980 1980 368 44 4 : tunables 0 0 0 : slabdata 45 45 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: proc_dir_entry 2271 2336 256 32 2 : tunables 0 0 0 : slabdata 73 73 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: pde_opener 4896 4896 40 102 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: proc_inode_cache 6031 6045 824 39 8 : tunables 0 0 0 : slabdata 155 155 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: seq_file 1632 1632 120 34 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sigqueue 2448 2448 80 51 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: bdev_cache 34 34 1856 17 8 : tunables 0 0 0 : slabdata 2 2 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: shmem_inode_cache 2488 2508 984 33 8 : tunables 0 0 0 : slabdata 76 76 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kernfs_iattrs_cache 1728 1728 112 36 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kernfs_node_cache 184377 184512 128 32 1 : tunables 0 0 0 : slabdata 5766 5766 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: mnt_cache 2193 2244 320 51 4 : tunables 0 0 0 : slabdata 44 44 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: filp 3343 4386 320 51 4 : tunables 0 0 0 : slabdata 86 86 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: inode_cache 190233 190275 752 43 8 : tunables 0 0 0 : slabdata 4425 4425 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dentry 240765 240856 240 34 2 : tunables 0 0 0 : slabdata 7084 7084 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: names_cache 384 384 4096 8 8 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: net_namespace 49 49 4672 7 8 : tunables 0 0 0 : slabdata 7 7 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: hashtab_node 17850 17850 24 170 1 : tunables 0 0 0 : slabdata 105 105 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ebitmap_node 46976 46976 64 64 1 : tunables 0 0 0 : slabdata 734 734 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avtab_extended_perms 0 0 40 102 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avtab_node 91120 91120 24 170 1 : tunables 0 0 0 : slabdata 536 536 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avc_xperms_data 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avc_xperms_decision_node 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avc_xperms_node 0 0 56 73 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: avc_node 2726 2856 72 56 1 : tunables 0 0 0 : slabdata 51 51 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: iint_cache 0 0 120 34 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lsm_inode_cache 234189 234276 96 42 1 : tunables 0 0 0 : slabdata 5578 5578 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: lsm_file_cache 12355 12544 16 256 1 : tunables 0 0 0 : slabdata 49 49 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: key_jar 1344 1344 256 32 2 : tunables 0 0 0 : slabdata 42 42 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: uts_namespace 185 185 432 37 4 : tunables 0 0 0 : slabdata 5 5 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: nsproxy 1288 1288 72 56 1 : tunables 0 0 0 : slabdata 23 23 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: vm_area_struct 6174 6265 232 35 2 : tunables 0 0 0 : slabdata 179 179 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: mm_struct 1248 1300 1216 26 8 : tunables 0 0 0 : slabdata 50 50 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: fs_cache 1568 1632 128 32 1 : tunables 0 0 0 : slabdata 51 51 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: files_cache 2254 2300 704 46 8 : tunables 0 0 0 : slabdata 50 50 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: signal_cache 1872 1950 1280 25 8 : tunables 0 0 0 : slabdata 78 78 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: sighand_cache 1420 1515 2176 15 8 : tunables 0 0 0 : slabdata 101 101 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: task_struct 982 1044 7232 4 8 : tunables 0 0 0 : slabdata 261 261 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: cred_jar 2622 2772 192 42 2 : tunables 0 0 0 : slabdata 66 66 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: anon_vma_chain 4690 4800 64 64 1 : tunables 0 0 0 : slabdata 75 75 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: anon_vma 3046 3159 104 39 1 : tunables 0 0 0 : slabdata 81 81 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: pid 2288 2436 192 42 2 : tunables 0 0 0 : slabdata 58 58 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: irq_remap_cache 44 44 8192 4 8 : tunables 0 0 0 : slabdata 11 11 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Acpi-Operand 6160 6160 72 56 1 : tunables 0 0 0 : slabdata 110 110 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Acpi-ParseExt 765 765 80 51 1 : tunables 0 0 0 : slabdata 15 15 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Acpi-Parse 1095 1095 56 73 1 : tunables 0 0 0 : slabdata 15 15 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Acpi-State 816 816 80 51 1 : tunables 0 0 0 : slabdata 16 16 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Acpi-Namespace 2380 2380 48 85 1 : tunables 0 0 0 : slabdata 28 28 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: shared_policy_node 0 0 48 85 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: numa_policy 55 55 296 55 4 : tunables 0 0 0 : slabdata 1 1 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: perf_event 1175 1175 1264 25 8 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: trace_event_file 3036 3036 88 46 1 : tunables 0 0 0 : slabdata 66 66 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: ftrace_event_field 6545 6545 48 85 1 : tunables 0 0 0 : slabdata 77 77 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: pool_workqueue 576 576 256 32 2 : tunables 0 0 0 : slabdata 18 18 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: radix_tree_node 11185 11424 584 28 4 : tunables 0 0 0 : slabdata 408 408 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: task_group 2024 2024 704 46 8 : tunables 0 0 0 : slabdata 44 44 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: vmap_area 65215 65216 64 64 1 : tunables 0 0 0 : slabdata 1019 1019 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: page->ptl 6191 6656 32 128 1 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-8k 0 0 8192 4 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-4k 0 0 4096 8 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-2k 0 0 2048 16 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-1k 0 0 1024 32 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-512 0 0 512 32 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-256 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-128 0 0 128 32 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-64 0 0 64 64 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-32 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-16 0 0 16 256 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-8 0 0 8 512 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-192 0 0 192 42 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: dma-kmalloc-96 0 0 96 42 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-8k 0 0 8192 4 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-4k 0 0 4096 8 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-2k 0 0 2048 16 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-1k 0 0 1024 32 8 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-512 0 0 512 32 4 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-256 0 0 256 32 2 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-192 168 168 192 42 2 : tunables 0 0 0 : slabdata 4 4 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-128 480 480 128 32 1 : tunables 0 0 0 : slabdata 15 15 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-96 1890 1890 96 42 1 : tunables 0 0 0 : slabdata 45 45 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-64 5588 5632 64 64 1 : tunables 0 0 0 : slabdata 88 88 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-32 0 0 32 128 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-16 0 0 16 256 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-rcl-8 0 0 8 512 1 : tunables 0 0 0 : slabdata 0 0 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-8k 24 24 8192 4 8 : tunables 0 0 0 : slabdata 6 6 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-4k 384 384 4096 8 8 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-2k 768 768 2048 16 8 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-1k 1607 1664 1024 32 8 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-512 1536 1536 512 32 4 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-256 1536 1536 256 32 2 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-192 1218 1218 192 42 2 : tunables 0 0 0 : slabdata 29 29 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-128 384 384 128 32 1 : tunables 0 0 0 : slabdata 12 12 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-96 2016 2016 96 42 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-64 3072 3072 64 64 1 : tunables 0 0 0 : slabdata 48 48 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-32 6583 6656 32 128 1 : tunables 0 0 0 : slabdata 52 52 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-16 12032 12032 16 256 1 : tunables 0 0 0 : slabdata 47 47 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-cg-8 19456 19456 8 512 1 : tunables 0 0 0 : slabdata 38 38 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-8k 720 720 8192 4 8 : tunables 0 0 0 : slabdata 180 180 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-4k 1427 1448 4096 8 8 : tunables 0 0 0 : slabdata 181 181 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-2k 1729 1808 2048 16 8 : tunables 0 0 0 : slabdata 113 113 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-1k 50057 50176 1024 32 8 : tunables 0 0 0 : slabdata 1568 1568 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-512 19645 19968 512 32 4 : tunables 0 0 0 : slabdata 624 624 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-256 6254 6304 256 32 2 : tunables 0 0 0 : slabdata 197 197 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-192 2918 2940 192 42 2 : tunables 0 0 0 : slabdata 70 70 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-128 8883 8896 128 32 1 : tunables 0 0 0 : slabdata 278 278 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-96 5917 5922 96 42 1 : tunables 0 0 0 : slabdata 141 141 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-64 110126 110336 64 64 1 : tunables 0 0 0 : slabdata 1724 1724 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-32 50949 51072 32 128 1 : tunables 0 0 0 : slabdata 399 399 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-16 57829 57856 16 256 1 : tunables 0 0 0 : slabdata 226 226 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmalloc-8 217346 220160 8 512 1 : tunables 0 0 0 : slabdata 430 430 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmem_cache_node 736 736 128 32 1 : tunables 0 0 0 : slabdata 23 23 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: kmem_cache 736 736 256 32 2 : tunables 0 0 0 : slabdata 23 23 0 Dec 29 13:59:05 rdma-qe-31.rdma.lab.eng.rdu2.redhat.com SlabCacheInfo[48521]: Dumping slabinfo - Stop - 2022-12-29 13:59:05