** Fetching task: 7 [/mnt/tests/gitlab.cee.redhat.com/kernel-qe/kernel/-/archive/master/kernel-master.zip/infiniband/cki/sanity] ** Extracting infiniband/cki/sanity/ ** Extracting infiniband/cki/sanity/Makefile ** Extracting infiniband/cki/sanity/runtest.sh ** Extracting infiniband/cki/sanity/setup.sh ** Fetch Summary: Match 4, Nonmatch 51346 ** Preparing metadata use_pty:FALSE make testinfo.desc rhts-lint testinfo.desc ** Updating env vars ** Updating external watchdog: 5400 seconds ** Installing dependencies ** Extracting infiniband/sanity/ ** Extracting infiniband/sanity/Makefile ** Extracting infiniband/sanity/PURPOSE ** Extracting infiniband/sanity/runtest.sh ** Extracting infiniband/sanity/sanity.xml ** Extracting infiniband/sanity/sanity.xsl ** Extracting infiniband/sanity/tier1.sh ** Extracting infiniband/sanity/_all_hca/ ** Extracting infiniband/sanity/_all_hca/Makefile ** Extracting infiniband/sanity/_all_hca/PURPOSE ** Extracting infiniband/sanity/_all_hca/runtest.sh ** Extracting infiniband/sanity/_all_hca/sanity_all_hca.xml ** Extracting infiniband/sanity/_all_hca/sanity_all_hca.xsl use_pty:FALSE make testinfo.desc rhts-lint testinfo.desc ** Extracting infiniband/env_setup/ ** Extracting infiniband/env_setup/Makefile ** Extracting infiniband/env_setup/PURPOSE ** Extracting infiniband/env_setup/clean_env.sh ** Extracting infiniband/env_setup/host_data_parser.py ** Extracting infiniband/env_setup/json/ ** Extracting infiniband/env_setup/json/_template.json ** Extracting infiniband/env_setup/json/rdma-cki-04.json ** Extracting infiniband/env_setup/json/rdma-cki-05.json ** Extracting infiniband/env_setup/json/rdma-dev-00.json ** Extracting infiniband/env_setup/json/rdma-dev-01.json ** Extracting infiniband/env_setup/json/rdma-dev-02.json ** Extracting infiniband/env_setup/json/rdma-dev-03.json ** Extracting infiniband/env_setup/json/rdma-dev-04.json ** Extracting infiniband/env_setup/json/rdma-dev-05.json ** Extracting infiniband/env_setup/json/rdma-dev-06.json ** Extracting infiniband/env_setup/json/rdma-dev-07.json ** Extracting infiniband/env_setup/json/rdma-dev-08.json ** Extracting infiniband/env_setup/json/rdma-dev-09.json ** Extracting infiniband/env_setup/json/rdma-dev-10.json ** Extracting infiniband/env_setup/json/rdma-dev-11.json ** Extracting infiniband/env_setup/json/rdma-dev-12.json ** Extracting infiniband/env_setup/json/rdma-dev-13.json ** Extracting infiniband/env_setup/json/rdma-dev-14.json ** Extracting infiniband/env_setup/json/rdma-dev-15.json ** Extracting infiniband/env_setup/json/rdma-dev-16.json ** Extracting infiniband/env_setup/json/rdma-dev-18.json ** Extracting infiniband/env_setup/json/rdma-dev-19.json ** Extracting infiniband/env_setup/json/rdma-dev-20.json ** Extracting infiniband/env_setup/json/rdma-dev-21.json ** Extracting infiniband/env_setup/json/rdma-dev-22.json ** Extracting infiniband/env_setup/json/rdma-dev-25.json ** Extracting infiniband/env_setup/json/rdma-dev-26.json ** Extracting infiniband/env_setup/json/rdma-dev-30.json ** Extracting infiniband/env_setup/json/rdma-dev-31.json ** Extracting infiniband/env_setup/json/rdma-perf-00.json ** Extracting infiniband/env_setup/json/rdma-perf-01.json ** Extracting infiniband/env_setup/json/rdma-perf-02.json ** Extracting infiniband/env_setup/json/rdma-perf-03.json ** Extracting infiniband/env_setup/json/rdma-perf-04.json ** Extracting infiniband/env_setup/json/rdma-perf-05.json ** Extracting infiniband/env_setup/json/rdma-perf-06.json ** Extracting infiniband/env_setup/json/rdma-perf-07.json ** Extracting infiniband/env_setup/json/rdma-qe-04.json ** Extracting infiniband/env_setup/json/rdma-qe-05.json ** Extracting infiniband/env_setup/json/rdma-qe-06.json ** Extracting infiniband/env_setup/json/rdma-qe-07.json ** Extracting infiniband/env_setup/json/rdma-qe-08.json ** Extracting infiniband/env_setup/json/rdma-qe-09.json ** Extracting infiniband/env_setup/json/rdma-qe-10.json ** Extracting infiniband/env_setup/json/rdma-qe-11.json ** Extracting infiniband/env_setup/json/rdma-qe-12.json ** Extracting infiniband/env_setup/json/rdma-qe-13.json ** Extracting infiniband/env_setup/json/rdma-qe-14.json ** Extracting infiniband/env_setup/json/rdma-qe-15.json ** Extracting infiniband/env_setup/json/rdma-qe-16.json ** Extracting infiniband/env_setup/json/rdma-qe-17.json ** Extracting infiniband/env_setup/json/rdma-qe-20.json ** Extracting infiniband/env_setup/json/rdma-qe-21.json ** Extracting infiniband/env_setup/json/rdma-qe-22.json ** Extracting infiniband/env_setup/json/rdma-qe-23.json ** Extracting infiniband/env_setup/json/rdma-qe-24.json ** Extracting infiniband/env_setup/json/rdma-qe-25.json ** Extracting infiniband/env_setup/json/rdma-qe-30.json ** Extracting infiniband/env_setup/json/rdma-qe-31.json ** Extracting infiniband/env_setup/json/rdma-storage-02.json ** Extracting infiniband/env_setup/json/rdma-storage-03.json ** Extracting infiniband/env_setup/json/rdma-storage-04.json ** Extracting infiniband/env_setup/json/rdma-virt-00.json ** Extracting infiniband/env_setup/json/rdma-virt-01.json ** Extracting infiniband/env_setup/json/rdma-virt-02.json ** Extracting infiniband/env_setup/json/rdma-virt-03.json ** Extracting infiniband/env_setup/json/rdma01.json ** Extracting infiniband/env_setup/json/rdma02.json ** Extracting infiniband/env_setup/json/rdma03.json ** Extracting infiniband/env_setup/json/rdma04.json ** Extracting infiniband/env_setup/json/rdma05.json ** Extracting infiniband/env_setup/json/rdma06.json ** Extracting infiniband/env_setup/multihost.xml ** Extracting infiniband/env_setup/multihost.xsl ** Extracting infiniband/env_setup/runtest.sh ** Extracting infiniband/env_setup/singlehost.xml ** Extracting infiniband/env_setup/singlehost.xsl ** Extracting infiniband/env_setup/_dynamic/ ** Extracting infiniband/env_setup/_dynamic/Makefile ** Extracting infiniband/env_setup/_dynamic/PURPOSE ** Extracting infiniband/env_setup/_dynamic/clean_env.sh ** Extracting infiniband/env_setup/_dynamic/env_dynamic_json.sh ** Extracting infiniband/env_setup/_dynamic/host_data_parser.py ** Extracting infiniband/env_setup/_dynamic/json/ ** Extracting infiniband/env_setup/_dynamic/json/_template.json ** Extracting infiniband/env_setup/_dynamic/multihost.xml ** Extracting infiniband/env_setup/_dynamic/multihost.xsl ** Extracting infiniband/env_setup/_dynamic/nfs-mounts ** Extracting infiniband/env_setup/_dynamic/runtest.sh ** Extracting infiniband/env_setup/_dynamic/singlehost.xml ** Extracting infiniband/env_setup/_dynamic/singlehost.xsl use_pty:FALSE make testinfo.desc rhts-lint testinfo.desc use_pty:FALSE rstrnt-package install rhel7 Last metadata expiration check: 0:09:50 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:09:53 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:09:55 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:09:58 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:10:00 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 use_pty:FALSE rstrnt-package install rhel7 Last metadata expiration check: 0:10:02 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:10:05 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:10:07 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:10:09 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 Last metadata expiration check: 0:10:12 ago on Sun 01 Jan 2023 11:27:39 AM EST. No match for argument: rhel7 Error: Unable to find a match: rhel7 ** Running task: 7 [RDMA Sanity Test - RoCE - Server] use_pty:FALSE /usr/share/restraint/plugins/run_task_plugins /usr/share/restraint/plugins/run_plugins Uploading dmesg.log .done Uploading avc.log .done *** Current Time: Sun Jan 01 11:38:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:39:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:40:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:41:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:42:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:43:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:44:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:45:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 use_pty:FALSE /usr/share/restraint/plugins/run_task_plugins /usr/share/restraint/plugins/run_plugins Uploading avc.log .done *** Current Time: Sun Jan 01 11:46:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:47:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:48:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:49:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:50:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:51:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:52:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:53:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:54:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:55:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:56:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:57:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:58:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 11:59:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:00:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:01:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:02:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:03:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:04:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:05:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:06:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:07:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:08:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:09:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:10:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:11:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:12:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:13:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:14:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:15:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:16:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:17:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:18:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:19:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:20:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:21:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:22:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:23:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:24:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:25:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:26:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:27:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:28:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:29:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:30:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:31:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:32:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:33:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:34:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:35:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:36:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 *** Current Time: Sun Jan 01 12:37:52 2023 Localwatchdog at: Sun Jan 01 12:37:52 2023 use_pty:FALSE /usr/share/restraint/plugins/run_task_plugins /usr/share/restraint/plugins/run_plugins Uploading test_console.log .done Multihost synchronization for Servers=rdma-qe-31 Clients=rdma-qe-30 /usr/bin/rstrnt-sync-set -s DONE -- State set = 13_DONE /usr/bin/rstrnt-sync-block -s DONE --retry 30 rdma-qe-31 rdma-qe-30 -- Blocking state(s) = 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 5 bytes, ret 0 [1, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 0 bytes, ret 0 [0, 0] Retrying rstrnt-sync-block for state 13_DONE Server rdma-qe-30 not reported state 13_DONE for Multihost Sync rcvd 5 bytes, ret 0 [1, 0] Retrying rstrnt-sync-block for state 13_DONE ** /10_localwatchdog WARN Score:0 Uploading resultoutputfile.log ..done /usr/bin/journalctl Uploading ps-lwd.log .done Uploading journalctl ...............done ** /99_reboot WARN Score:0