[ 174.962405] run blktests nvmeof-mp/011 at 2023-01-10 06:53:34 [ 175.083971] null_blk: module loaded [ 175.132654] null_blk: disk nullb0 created [ 175.136757] null_blk: disk nullb1 created [ 175.156227] TECH PREVIEW: Software iWARP Driver may not be fully supported. Please review provided documentation for limitations. [ 175.157455] SoftiWARP attached [ 175.165446] enp1s0 speed is unknown, defaulting to 1000 [ 175.165849] enp1s0 speed is unknown, defaulting to 1000 [ 175.166240] enp1s0 speed is unknown, defaulting to 1000 [ 175.166615] enp1s0 speed is unknown, defaulting to 1000 [ 175.291762] nvmet: adding nsid 1 to subsystem nvme-test [ 175.294885] enp1s0 speed is unknown, defaulting to 1000 [ 175.304626] nvmet_rdma: enabling port 1 (10.8.3.53:7777) [ 175.352208] enp1s0 speed is unknown, defaulting to 1000 [ 175.359078] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: address resolved (0): status 0 id 00000000186dfa3d [ 175.359400] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: route resolved (2): status 0 id 00000000186dfa3d [ 175.359585] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: connect request (4): status 0 id 00000000301e0cf1 [ 175.359594] nvmet_rdma:nvmet_rdma_find_get_device: nvmet_rdma: added enp1s0_siw. [ 175.359796] nvmet_rdma:nvmet_rdma_create_queue_ib: nvmet_rdma: nvmet_rdma_create_queue_ib: max_cqe= 4096 max_sge= 6 sq_size = 129 cm_id= 00000000301e0cf1 [ 175.359922] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: established (9): status 0 id 00000000301e0cf1 [ 175.359935] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: established (9): status 0 id 00000000186dfa3d [ 175.360519] nvmet:nvmet_start_keep_alive_timer: nvmet: ctrl 1 start keep-alive timer for 5 secs [ 175.360524] nvmet: creating nvm controller 1 for subsystem nvme-test for NQN nqn.2014-08.org.nvmexpress:uuid:befddc8b-facc-4906-a134-fc0a51b0247c. [ 175.361996] nvme nvme0: creating 4 I/O queues. [ 175.362702] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: address resolved (0): status 0 id 00000000fec104e4 [ 175.362966] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: route resolved (2): status 0 id 00000000fec104e4 [ 175.363049] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: connect request (4): status 0 id 00000000235cff62 [ 175.363054] nvmet_rdma:nvmet_rdma_find_get_device: nvmet_rdma: added enp1s0_siw. [ 175.363389] nvmet_rdma:nvmet_rdma_create_queue_ib: nvmet_rdma: nvmet_rdma_create_queue_ib: max_cqe= 4096 max_sge= 6 sq_size = 513 cm_id= 00000000235cff62 [ 175.363442] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: established (9): status 0 id 00000000235cff62 [ 175.363447] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: established (9): status 0 id 00000000fec104e4 [ 175.363494] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: address resolved (0): status 0 id 00000000c038c549 [ 175.363748] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: route resolved (2): status 0 id 00000000c038c549 [ 175.363825] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: connect request (4): status 0 id 00000000f0dcc7f3 [ 175.363829] nvmet_rdma:nvmet_rdma_find_get_device: nvmet_rdma: added enp1s0_siw. [ 175.364134] nvmet_rdma:nvmet_rdma_create_queue_ib: nvmet_rdma: nvmet_rdma_create_queue_ib: max_cqe= 4096 max_sge= 6 sq_size = 513 cm_id= 00000000f0dcc7f3 [ 175.364182] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: established (9): status 0 id 00000000f0dcc7f3 [ 175.364189] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: established (9): status 0 id 00000000c038c549 [ 175.364216] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: address resolved (0): status 0 id 000000003c8ad5b0 [ 175.364464] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: route resolved (2): status 0 id 000000003c8ad5b0 [ 175.364527] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: connect request (4): status 0 id 00000000fcec013d [ 175.364530] nvmet_rdma:nvmet_rdma_find_get_device: nvmet_rdma: added enp1s0_siw. [ 175.364814] nvmet_rdma:nvmet_rdma_create_queue_ib: nvmet_rdma: nvmet_rdma_create_queue_ib: max_cqe= 4096 max_sge= 6 sq_size = 513 cm_id= 00000000fcec013d [ 175.364859] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: established (9): status 0 id 00000000fcec013d [ 175.364867] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: established (9): status 0 id 000000003c8ad5b0 [ 175.364903] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: address resolved (0): status 0 id 00000000bc27054d [ 175.365134] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: route resolved (2): status 0 id 00000000bc27054d [ 175.365202] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: connect request (4): status 0 id 000000002eb678e3 [ 175.365204] nvmet_rdma:nvmet_rdma_find_get_device: nvmet_rdma: added enp1s0_siw. [ 175.365496] nvmet_rdma:nvmet_rdma_create_queue_ib: nvmet_rdma: nvmet_rdma_create_queue_ib: max_cqe= 4096 max_sge= 6 sq_size = 513 cm_id= 000000002eb678e3 [ 175.365542] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: established (9): status 0 id 000000002eb678e3 [ 175.365550] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: established (9): status 0 id 00000000bc27054d [ 175.365579] nvme nvme0: mapped 4/0/0 default/read/poll queues. [ 175.366251] nvmet:nvmet_execute_io_connect: nvmet: adding queue 1 to ctrl 1. [ 175.366402] nvmet:nvmet_execute_io_connect: nvmet: adding queue 2 to ctrl 1. [ 175.366469] nvmet:nvmet_execute_io_connect: nvmet: adding queue 3 to ctrl 1. [ 175.366520] nvmet:nvmet_execute_io_connect: nvmet: adding queue 4 to ctrl 1. [ 175.366601] nvme nvme0: new ctrl: NQN "nvme-test", addr 10.8.3.53:7777 [ 175.367133] nvmet:nvmet_req_cns_error_complete: nvmet: unhandled identify cns 6 on qid 0 [ 180.390214] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 185.429732] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 190.469901] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 195.509667] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 200.549632] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 205.589602] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 205.745611] enp1s0 speed is unknown, defaulting to 1000 [ 206.758849] enp1s0 speed is unknown, defaulting to 1000 [ 207.769440] enp1s0 speed is unknown, defaulting to 1000 [ 208.779993] enp1s0 speed is unknown, defaulting to 1000 [ 209.790483] enp1s0 speed is unknown, defaulting to 1000 [ 210.629563] nvmet:nvmet_keep_alive_timer: nvmet: ctrl 1 reschedule traffic based keep-alive timer [ 210.845516] nvme nvme0: Removing ctrl: NQN "nvme-test" [ 215.669518] nvmet: ctrl 1 keep-alive timer (5 seconds) expired! [ 215.670192] nvmet: ctrl 1 fatal error occurred! [ 215.670499] nvmet_rdma:__nvmet_rdma_queue_disconnect: nvmet_rdma: cm_id= 00000000301e0cf1 queue->state= 1 [ 215.670530] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: disconnected (10): status 0 id 00000000301e0cf1 [ 215.670581] nvmet_rdma:__nvmet_rdma_queue_disconnect: nvmet_rdma: cm_id= 00000000235cff62 queue->state= 1 [ 215.670610] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnected (10): status 0 id 00000000186dfa3d [ 215.670613] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnect received - connection closed [ 215.670615] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: disconnected (10): status 0 id 00000000235cff62 [ 215.670627] nvmet_rdma:__nvmet_rdma_queue_disconnect: nvmet_rdma: cm_id= 00000000f0dcc7f3 queue->state= 1 [ 215.670651] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnected (10): status 0 id 00000000fec104e4 [ 215.670652] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnect received - connection closed [ 215.670654] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: disconnected (10): status 0 id 00000000f0dcc7f3 [ 215.670665] nvmet_rdma:__nvmet_rdma_queue_disconnect: nvmet_rdma: cm_id= 00000000fcec013d queue->state= 1 [ 215.670686] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnected (10): status 0 id 00000000c038c549 [ 215.670688] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnect received - connection closed [ 215.670689] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: disconnected (10): status 0 id 00000000fcec013d [ 215.670699] nvmet_rdma:__nvmet_rdma_queue_disconnect: nvmet_rdma: cm_id= 000000002eb678e3 queue->state= 1 [ 215.670720] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnected (10): status 0 id 000000003c8ad5b0 [ 215.670721] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnect received - connection closed [ 215.670723] nvmet_rdma:nvmet_rdma_cm_handler: nvmet_rdma: disconnected (10): status 0 id 000000002eb678e3 [ 215.670732] nvmet_rdma:nvmet_rdma_free_queue: nvmet_rdma: freeing queue 0 [ 215.670735] nvmet_rdma: post_recv cmd failed [ 215.670769] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnected (10): status 0 id 00000000bc27054d [ 215.671039] nvmet_rdma: sending cmd response failed [ 215.671040] nvme_rdma:nvme_rdma_cm_handler: nvme nvme0: disconnect received - connection closed [ 215.671376] nvmet_rdma:nvmet_rdma_free_queue: nvmet_rdma: freeing queue 1 [ 215.671382] nvmet_rdma:nvmet_rdma_free_queue: nvmet_rdma: freeing queue 2 [ 215.671386] nvmet_rdma:nvmet_rdma_free_queue: nvmet_rdma: freeing queue 3 [ 215.671390] nvmet_rdma:nvmet_rdma_free_queue: nvmet_rdma: freeing queue 4 [ 215.711141] nvmet:nvmet_stop_keep_alive_timer: nvmet: ctrl 1 stop keep-alive [ 221.329484] nvme nvme0: I/O 90 QID 1 timeout [ 221.330111] nvme0n1: Read(0x2) @ LBA 65472, 8 blocks, Host Aborted Command (sct 0x3 / sc 0x71) [ 221.330711] device-mapper: multipath: 253:3: Failing path 259:0. [ 284.679046] nvme nvme0: I/O 14 QID 0 timeout [ 284.679657] nvme nvme0: Property Set error: 881, offset 0x14 [ 405.270714] enp1s0 speed is unknown, defaulting to 1000 [ 405.275656] SoftiWARP detached