Attachment 1739897 Details for Bug 1638889 – Test scenarios

Test scenarios

TestScenarios.txt (text/plain), 17.60 KB, created by Fangge Jin on 2020-12-17 08:29:25 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Fangge Jin

Created: 2020-12-17 08:29:25 UTC

Size: 17.60 KB

patch

obsolete

>Background:
>In CNV the container libvirt is running in does not have network access. All we have for communication is unix sockets. So we're tunnelling out of that libvirt container with the unix socket and then streaming in another environment that unix socket over tcp.
>
>so it conceptually looks like this.
>---------- SOURCE NODE ------ | ------ DESTINATION NODE -----
>Libvirt <-> unix socket <-> TCP <-> unix socket <-> libvirt
>qemu <-> unix socket <-> TCP <-> unix socket <-> qemu
>
>How to use it:
>Set up proxy between source and dest host, specify the --desturi/--migrateuri/--disks-uri as listening unix socket of the source proxy
>
>Upper product impact:
>CNV
>
>Need to be reviewed with devel or not:
>Devel can review the test scenarios by himself, and give me suggestions if any
>
>Need to be selected into the gating list or not:
>Yes
>
>Need to sync with kvm qe or not:
>This feature does not need any change in qemu-kvm, but we can inform kvm about this feature qe anyway.
>
>Test scenarios:
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Without copy storage~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>[root@dell-per740-03 diff-cover]# virsh start avocado-vt-vm1
>Domain avocado-vt-vm1 started
>
>P2P - critical
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock 
>Migration: [100 %]
>
>P2P+Postcopy - critical
>[root@dell-per740-03  diff-cover]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p  --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy
>Migration: [100 %]
>
>[root@dell-per740-03  diff-cover]# virsh migrate-postcopy avocado-vt-vm1
>
>Non-p2p - medium
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose  --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock 
>Migration: [100 %]
>
>Tunnelled - medium
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --p2p --tunnelled
>Migration: [100 %]
>
>P2P+TLS - negative - low
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --tls
>error: Operation not supported: Explicit destination hostname is required for TLS migration over UNIX socket
>
>P2P+TLS -positive - medium
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com
>
>P2P+TLS+Postcopy - medium
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy --bandwidth 2 --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com
>Migration: [100 %]
>
>P2P+TLS+Postcopy+Compression - medium - extended scenario
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy --bandwidth 2 --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com --compressed
>Migration: [100 %]
>
>P2P+TLS+Postcopy+Compression mt - medium - extended scenario
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy --bandwidth 2 --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com --compressed --comp-methods mt
>Migration: [100 %]
>
>P2P+TLS+Postcopy+Compression xbzrle - medium - extended scenario
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy --bandwidth 2 --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com --compressed --comp-methods xbzrle
>Migration: [100 %]
>
>[root@dell-per740-03 diff-cover]# virsh shutdown avocado-vt-vm1
>Domain avocado-vt-vm1 is being shutdown
>
>domabort job, and do migration again
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~With copy storage~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>Add case in "virtual disks" test plan by fjin?
>[root@dell-per740-03 diff-cover]# virsh edit avocado-vt-vm1
>Domain avocado-vt-vm1 XML configuration edited.
>
>[root@dell-per740-03 diff-cover]# virsh start avocado-vt-vm1
>Domain avocado-vt-vm1 started
>
>P2P - critical
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock  --compressed --comp-methods xbzrle --copy-storage-all --disks-uri unix:///var/lib/libvirt/qemu/test-49152.sock
>Migration: [100 %]
>
>P2P+Multiple disks - critical
>[root@dell-per740-03 diff-cover]# virsh attach-disk avocado-vt-vm1 --source /var/lib/libvirt/images/a.qcow2 --target vdb --driver qemu --subdriver qcow2
>Disk attached successfully
>
>[root@dell-per740-03 diff-cover]# virsh attach-disk avocado-vt-vm1 --source /var/lib/libvirt/images/b.qcow2 --target vdc --driver qemu --subdriver qcow2
>Disk attached successfully
>
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock  --compressed --comp-methods xbzrle --copy-storage-all --disks-uri unix:///var/lib/libvirt/qemu/test-49152.sock
>
>P2P+Compression xbzrle+AutoConverge - medium - extended scenario - low
>[root@dell-per740-03 diff-cover]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock  --compressed --comp-methods xbzrle --copy-storage-all --auto-converge --disks-uri unix:///var/lib/libvirt/qemu/test-49152.sock
>Migration: [100 %]
>
>
>TLS - negative - low
>[root@dell-per740-03  diff-cover]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p  --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy  --bandwidth 2 --tls --tls-destination  dell-per740-04.dell2.lab.eng.bos.redhat.com --compressed --comp-methods  xbzrle --copy-storage-all --disks-uri  unix:///var/lib/libvirt/qemu/test-49152.sock
>error: internal error: unable to execute QEMU command 'nbd-server-start': TLS is only supported with IPv4/IPv6
>
>Without --disk-uri, with --migrateuri(unix) - negative - low
>[root@dell-per740-03   diff-cover]# virsh migrate avocado-vt-vm1   qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p   --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --postcopy   --bandwidth 2 --tls --tls-destination   dell-per740-04.dell2.lab.eng.bos.redhat.com --compressed --comp-methods   xbzrle --copy-storage-all
>error: invalid argument: NBD URI must be supplied when migration URI uses UNIX transport method
>
>migrateuri is unix socket, disks-uri is tcp socket - extended scenario - low
>[root@dell-per740-03 tls]# virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose  --compressed --p2p    --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock --bandwidth 200 --copy-storage-all --disks-uri tcp://dell-per740-04.dell2.lab.eng.bos.redhat.com:49210 --tls --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com
>Migration: [  100 %]
>
>domabort job, and do migration again
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Parallel migration w/o copy storage~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>According to kvm qe, parallel migration can not be tested with other features for now, and it doesnot work well with migraiton over unix socket, so I will not add test cases for it.
>1) Without copy storage, precopy+P2P (fails at high possibility, may be proxy issue)
># virsh migrate rhel8-min qemu+unix:///system?socket=/tmp/22222.sock --live --verbose --p2p --migrateuri unix:///tmp/49152-forward.sock --parallel --parallel-connections 4
>error from dest qemu log:
>2020-11-26T10:23:07.648598Z qemu-kvm: failed to receive packet via multifd channel 0: multifd: received packet magic 5145564d expected 11223344
>2020-11-26 10:23:19.604+0000: shutting down, reason=failed
>2020-11-26T10:23:19.605835Z qemu-kvm: terminating on signal 15 from pid 11076 (/usr/sbin/libvirtd)
>
>2) Without copy storage, postcopy+P2P(Blocked by bug)
># virsh migrate rhel8-min qemu+unix:///system?socket=/tmp/22222.sock --live --verbose --p2p --migrateuri unix:///tmp/49152-forward.sock --parallel --parallel-connections 4 --postcopy; virsh migrate-postcopy rhel8-min
>
>3) With copy storage, precopy+P2P(it succeeds)
>
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Split daemon mode~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>1. On src, start virtqemud, virtstoraged; on dest, start virtproxyd, virtqemud, virtstoraged - dest proxy connects to /var/run/libvirt/virtproxyd-sock
># virsh -c qemu:///system migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///tmp/test-49152.sock --copy-storage-all --disks-uri unix:///tmp/test-49153.sock
>Migration: [100 %]
>
>2. On both src and dest host, start virtqemud, virtstoraged - dest proxy connects to /var/run/libvirt/virtqemud-sock
># virsh -c qemu:///system migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p --migrateuri unix:///tmp/test-49152.sock --copy-storage-all --disks-uri unix:///tmp/test-49153.sock
>Migration: [100 %]
>
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Following scenarios are not related to migration over unix socket~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Test --disks-uri~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>Add test cases in virtual disks by fjin?
>schema: tcp: ip+port - high(should use a different ip from listen-address/migrate-uri)
># virsh migrate  avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock --live  --verbose  --compressed --copy-storage-all  --disks-uri  tcp://10.16.218.252:56891 --listen-address 192.168.100.6 --migrateuri  tcp://192.168.100.6:49159
>Migration: [100 %]
>
>schema: tcp: hostname - high(should use a different ip from listen-address/migrate-uri)
>[root@dell-per740-04   libvirt-6.6.0-8.virtcov.el8.x86_64]# virsh migrate avocado-vt-vm1   qemu+ssh://dell-per740-03.dell2.lab.eng.bos.redhat.com/system --live   --verbose   --listen-address  0.0.0.0 --migrateuri   rdma://192.168.100.5:49155 --p2p --disks-uri   tcp://dell-per740-03.dell2.lab.eng.bos.redhat.com --copy-storage-all
>Migration: [100 %]
>
>schema: tcp: hostname+port - high(should use a different ip from listen-address/migrate-uri)
>#   virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock   --live --verbose  --compressed --p2p    --migrateuri   rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all   --disks-uri tcp://dell-per740-04.dell2.lab.eng.bos.redhat.com:49210
>
>schema: tcp: no server ip/hostname - negative
>[root@dell-per740-03  tls]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --compressed   --listen-address 0 --migrateuri  rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all  --disks-uri tcp://
>error: invalid argument: URI with tcp scheme did not provide a server part: tcp://
>
>schema: tcp: unknown hostname - negative - low
>[root@dell-per740-03  tls]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --compressed   --listen-address 0 --migrateuri  rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all  --disks-uri tcp://fjieke
>error:  internal error: unable to execute QEMU command 'nbd-server-start':  address resolution failed for fjieke:49153: Name or service not known
>
>schema: tcp: hostname + unparsable port - negative - low
>[root@dell-per740-03  tls]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --compressed   --listen-address 0 --migrateuri  rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all  --disks-uri tcp://dell-per740-03.dell2.lab.eng.bos.redhat.com:fje
>error: internal error: Unable to parse URI tcp://dell-per740-03.dell2.lab.eng.bos.redhat.com:fje
>
>schema: tcp: hostname+unavailable port - high
>[root@dell-per740-03  tls]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --compressed   --listen-address 0 --migrateuri  rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all  --disks-uri tcp://dell-per740-04.dell2.lab.eng.bos.redhat.com:49153
>error: internal error: unable to execute QEMU command 'nbd-server-start': Failed to find an available port: Address already in use
>
>schema: unix, no socket path - negative - low
>[root@dell-per740-03   tls]# virsh migrate avocado-vt-vm1   qemu+unix:///system?socket=/tmp/test.sock --live --verbose    --compressed   --listen-address 0 --migrateuri   rdma://192.168.100.6:49155 --bandwidth 200 --copy-storage-all   --disks-uri unix://
>error: invalid argument: UNIX disks URI does not include path
>
>No valid schema
>[root@dell-per740-03  libvirt-rhel]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose  --compressed  --copy-storage-all  --disks-uri fjeifeke
>error: invalid argument: No URI scheme specified: fjie
>
>[root@cross-migration-8-3-1 tls]# virsh migrate vm qemu+unix:///system?socket=/tmp/22222.sock --live --verbose  --p2p --migrateuri tcp://10.0.155.106 --copy-storage-all --listen-address 0 --disks-uri fjie://
>error: invalid argument: Unsupported scheme in disks URI: fjie
>
>schema: rdma - medium
>[root@dell-per740-03    libvirt-rhel]# virsh migrate avocado-vt-vm1    qemu+ssh://<dest host>/system --live --verbose  --copy-storage-all  --disks-uri   rdma://192.168.100.6:56891  --listen-address  10.16.218.252
>error: invalid argument: Unsupported scheme in disks URI: rdma
>
>Without --disks-uri, with --migrateuri(TCP: ip+port), disks-uri will reuse the schema and ip of migrateuri - positive - high (not related to this bug)
>#    virsh migrate avocado-vt-vm1   qemu+unix:///system?socket=/tmp/test.sock   --live --verbose    --compressed --copy-storage-all  --listen-address 0   --migrateuri   tcp://192.168.100.6:49155
>
>Without --disks-uri, with --migrateuri(TCP: ip+port) and --disks-port - positive - high (not related to this bug)
>#    virsh migrate avocado-vt-vm1    qemu+unix:///system?socket=/tmp/test.sock   --live --verbose     --compressed --copy-storage-all  --listen-address 0   --migrateuri    tcp://192.168.100.6:49155 --disks-port 49156
>
>Without --disks-uri, with --migrateuri(RDMA: ip), disks-uri will reuse the schema and ip of migrateuri, test failed for now - positive - medium (not related to this bug)
>#    virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock   --live --verbose   --compressed --copy-storage-all  --listen-address 0   --migrateuri  rdma://192.168.100.6
>
>exclusive options - negative - low
>#  virsh migrate avocado-vt-vm1 qemu+unix:///system?socket=/tmp/test.sock  --live --verbose --p2p --migrateuri  unix:///var/lib/libvirt/qemu/test-49151.sock  --compressed  --comp-methods xbzrle --copy-storage-all --disks-uri  unix:///var/lib/libvirt/qemu/test-49152.sock --disks-port 12345
>error: invalid argument: Both port and URI requested for disk migration while being mutually exclusive
>
>exclusive options - negative - low
>[root@dell-per740-03  diff-cover]# virsh migrate avocado-vt-vm1  qemu+unix:///system?socket=/tmp/test.sock --live --verbose --p2p  --migrateuri unix:///var/lib/libvirt/qemu/test-49151.sock  --compressed  --comp-methods xbzrle --copy-storage-all --listen-address  tcp://127.0.0.1
>error: invalid argument: Usage of listen-address is forbidden when migration URI uses UNIX transport method
>
>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~The following  scenarios are not related to this bug at all~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>Add test cases in virtual disks test plan by fjin?
>
>TLS+copy storage, invalid server-cert.pem - mismached  hostname in cert
>[root@dell-per740-03     tls]# virsh migrate avocado-vt-vm1     qemu+unix:///system?socket=/tmp/test.sock --live --verbose     --compressed  --p2p    --migrateuri    unix:///var/lib/libvirt/qemu/test-49151.sock  --bandwidth 200    --copy-storage-all --disks-uri     tcp://dell-per740-04.dell2.lab.eng.bos.redhat.com:49210 --tls     --tls-destination dell-per740-04.dell2.lab.eng.bos.redhat.com
>error:     internal error: unable to execute QEMU command 'blockdev-add':     Certificate does not match the hostname     dell-per740-04.dell2.lab.eng.bos.redhat.com
>
>TLS+copy storage, invalid server-cert.pem - wrong format in cert
>[root@dell-per740-03     tls]# virsh migrate avocado-vt-vm1     qemu+unix:///system?socket=/tmp/test.sock --live --verbose     --compressed  --p2p    --migrateuri    unix:///var/lib/libvirt/qemu/test-49151.sock  --bandwidth 200    --copy-storage-all --disks-uri     tcp://dell-per740-04.dell2.lab.eng.bos.redhat.com:49210 --tls     --tls-destination ggg
>error:     internal error: unable to execute QEMU command 'object-add': Unable   to   import server certificate /etc/pki/qemu/server-cert.pem: Base64     unexpected header error.
>
>--tls-destination doesn't work for --disks-uri, Bug 1901394  - --tls-destination doesn't take effect for disk migration:
>[root@dell-per740-03   tls]# virsh migrate avocado-vt-vm1   qemu+unix:///system?socket=/tmp/test.sock --live --verbose   --compressed  --p2p --migrateuri tcp://10.16.218.252:49156 --bandwidth  200  --tls  --tls-destination  dell-per740-04.dell2.lab.eng.bos.redhat.com  --copy-storage-all  --disks-uri tcp://192.168.100.6:49156
>error: internal error: unable to execute QEMU command 'blockdev-add': Certificate does not match the hostname 192.168.100.6
>
>
>

Actions: View

Attachments on bug 1638889: 1729265 | 1729364 | 1739897