CLOUDSTACK-9893 / CLOUDSTACK-8239 fix test_deploy_virtio_scsi_vm.py

[nathanejohnson]

Fix issue where unsupported hypervisors were not skipping tests

Fix issue where the template referenced no longer existed on openvm.eu

@karuturi @DaanHoogland @serg38 @kiwiflyer

[nathanejohnson]

test results on kvm:

Test that libvirt properly created domain with scsi controller ... === TestName: test_01_verify_libvirt | Status : SUCCESS ===
ok
Verify that libvirt settings are as expected after a VM stop / start ... === TestName: test_02_verify_libvirt_after_restart | Status : SUCCESS ===
ok
Verify that libvirt settings are expected after a disk add ... === TestName: test_03_verify_libvirt_attach_disk | Status : SUCCESS ===
ok
Verify that guest sees scsi controller and disks ... === TestName: test_04_verify_guest_lspci | Status : SUCCESS ===
ok
Update os type to Ubuntu, change vm details rootdiskController ... === TestName: test_05_change_vm_ostype_restart | Status : SUCCESS ===
ok
Verify that guest sees scsi controller and disks after switching ostype and rdc ... === TestName: test_06_verify_guest_lspci_again | Status : SUCCESS ===
ok

----------------------------------------------------------------------
Ran 6 tests in 1110.727s

OK

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

[DaanHoogland]

code LGTM, i'll be kicking tests on vmware to make sure ;)

[blueorangutan]

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-677

[DaanHoogland]

@blueorangutan test centos7 vmware-55u3

[blueorangutan]

@DaanHoogland a Trillian-Jenkins test job (centos7 mgmt + vmware-55u3) has been kicked to run smoke tests

[karuturi]

code LGTM. will merge once the tests are ok.

[rohityadavcloud]

LGTM. @nathanejohnson does this also affect 4.9, if so please change the base branch to 4.9 thanks.

[kiwiflyer]

@rhtyd The original PR was only pulled into master (4.10) as far as I'm aware.

[rohityadavcloud]

Thanks @kiwiflyer

[blueorangutan]

Trillian test result (tid-1039)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 49142 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2066-t1039-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_ssvm.py
Test completed. 49 look ok, 2 have error(s)

Test	Result	Time (s)	Test File
test_04_rvpc_privategw_static_routes	Failure	962.36	test_privategw_acl.py
ContextSuite context=TestDeployVirtioSCSIVM>:teardown	Error	0.00	test_deploy_virtio_scsi_vm.py
test_01_vpc_site2site_vpn	Success	446.04	test_vpc_vpn.py
test_01_vpc_remote_access_vpn	Success	176.38	test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn	Success	696.71	test_vpc_vpn.py
test_02_VPC_default_routes	Success	428.74	test_vpc_router_nics.py
test_01_VPC_nics_after_destroy	Success	800.07	test_vpc_router_nics.py
test_05_rvpc_multi_tiers	Success	694.35	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	Success	1672.70	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	Success	711.75	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	Success	739.75	test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	Success	1433.43	test_vpc_redundant.py
test_09_delete_detached_volume	Success	30.81	test_volumes.py
test_06_download_detached_volume	Success	95.65	test_volumes.py
test_05_detach_volume	Success	105.27	test_volumes.py
test_04_delete_attached_volume	Success	20.19	test_volumes.py
test_03_download_attached_volume	Success	20.24	test_volumes.py
test_02_attach_volume	Success	53.76	test_volumes.py
test_01_create_volume	Success	520.63	test_volumes.py
test_change_service_offering_for_vm_with_snapshots	Success	564.77	test_vm_snapshots.py
test_03_delete_vm_snapshots	Success	280.24	test_vm_snapshots.py
test_02_revert_vm_snapshots	Success	232.08	test_vm_snapshots.py
test_01_create_vm_snapshots	Success	161.74	test_vm_snapshots.py
test_deploy_vm_multiple	Success	252.25	test_vm_life_cycle.py
test_deploy_vm	Success	0.02	test_vm_life_cycle.py
test_advZoneVirtualRouter	Success	0.02	test_vm_life_cycle.py
test_10_attachAndDetach_iso	Success	26.77	test_vm_life_cycle.py
test_09_expunge_vm	Success	125.21	test_vm_life_cycle.py
test_08_migrate_vm	Success	65.79	test_vm_life_cycle.py
test_07_restore_vm	Success	0.07	test_vm_life_cycle.py
test_06_destroy_vm	Success	5.08	test_vm_life_cycle.py
test_03_reboot_vm	Success	5.10	test_vm_life_cycle.py
test_02_start_vm	Success	20.18	test_vm_life_cycle.py
test_01_stop_vm	Success	10.12	test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName	Success	351.78	test_templates.py
test_08_list_system_templates	Success	0.03	test_templates.py
test_07_list_public_templates	Success	0.03	test_templates.py
test_05_template_permissions	Success	0.05	test_templates.py
test_04_extract_template	Success	20.32	test_templates.py
test_03_delete_template	Success	5.13	test_templates.py
test_02_edit_template	Success	90.08	test_templates.py
test_01_create_template	Success	170.90	test_templates.py
test_10_destroy_cpvm	Success	266.61	test_ssvm.py
test_09_destroy_ssvm	Success	304.56	test_ssvm.py
test_08_reboot_cpvm	Success	156.36	test_ssvm.py
test_07_reboot_ssvm	Success	158.23	test_ssvm.py
test_06_stop_cpvm	Success	176.57	test_ssvm.py
test_05_stop_ssvm	Success	178.41	test_ssvm.py
test_04_cpvm_internals	Success	1.02	test_ssvm.py
test_03_ssvm_internals	Success	2.94	test_ssvm.py
test_02_list_cpvm_vm	Success	0.20	test_ssvm.py
test_01_list_sec_storage_vm	Success	0.10	test_ssvm.py
test_02_list_snapshots_with_removed_data_store	Success	237.32	test_snapshots.py
test_01_snapshot_root_disk	Success	71.22	test_snapshots.py
test_04_change_offering_small	Success	97.31	test_service_offerings.py
test_03_delete_service_offering	Success	0.03	test_service_offerings.py
test_02_edit_service_offering	Success	0.07	test_service_offerings.py
test_01_create_service_offering	Success	0.08	test_service_offerings.py
test_02_sys_template_ready	Success	0.11	test_secondary_storage.py
test_01_sys_vm_start	Success	0.14	test_secondary_storage.py
test_09_reboot_router	Success	160.85	test_routers.py
test_08_start_router	Success	155.82	test_routers.py
test_07_stop_router	Success	25.19	test_routers.py
test_06_router_advanced	Success	0.04	test_routers.py
test_05_router_basic	Success	0.03	test_routers.py
test_04_restart_network_wo_cleanup	Success	5.54	test_routers.py
test_03_restart_network_cleanup	Success	186.00	test_routers.py
test_02_router_internal_adv	Success	0.89	test_routers.py
test_01_router_internal_basic	Success	0.55	test_routers.py
test_router_dns_guestipquery	Success	80.13	test_router_dns.py
test_router_dns_externalipquery	Success	0.07	test_router_dns.py
test_router_dhcphosts	Success	140.59	test_router_dhcphosts.py
test_router_dhcp_opts	Success	21.33	test_router_dhcphosts.py
test_01_updatevolumedetail	Success	0.07	test_resource_detail.py
test_01_reset_vm_on_reboot	Success	35.33	test_reset_vm_on_reboot.py
test_createRegion	Success	0.03	test_regions.py
test_create_pvlan_network	Success	5.17	test_pvlan.py
test_dedicatePublicIpRange	Success	0.31	test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup	Success	1146.58	test_privategw_acl.py
test_02_vpc_privategw_static_routes	Success	740.53	test_privategw_acl.py
test_01_vpc_privategw_acl	Success	197.09	test_privategw_acl.py
test_03_migration_options_storage_tags	Success	36.61	test_primary_storage.py
test_02_edit_primary_storage_tags	Success	0.08	test_primary_storage.py
test_01_primary_storage_nfs	Success	37.01	test_primary_storage.py
test_01_deploy_vms_storage_tags	Success	41.16	test_primary_storage.py
test_createPortablePublicIPRange	Success	15.14	test_portable_publicip.py
test_createPortablePublicIPAcquire	Success	15.33	test_portable_publicip.py
test_isolate_network_password_server	Success	90.01	test_password_server.py
test_UpdateStorageOverProvisioningFactor	Success	0.11	test_over_provisioning.py
test_oobm_zchange_password	Success	30.56	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	Success	16.29	test_outofbandmanagement.py
test_oobm_issue_power_status	Success	5.16	test_outofbandmanagement.py
test_oobm_issue_power_soft	Success	15.27	test_outofbandmanagement.py
test_oobm_issue_power_reset	Success	15.24	test_outofbandmanagement.py
test_oobm_issue_power_on	Success	15.29	test_outofbandmanagement.py
test_oobm_issue_power_off	Success	15.27	test_outofbandmanagement.py
test_oobm_issue_power_cycle	Success	15.27	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	Success	72.18	test_outofbandmanagement.py
test_oobm_enable_feature_valid	Success	5.12	test_outofbandmanagement.py
test_oobm_enable_feature_invalid	Success	0.08	test_outofbandmanagement.py
test_oobm_disable_feature_valid	Success	0.13	test_outofbandmanagement.py
test_oobm_disable_feature_invalid	Success	0.09	test_outofbandmanagement.py
test_oobm_configure_invalid_driver	Success	0.06	test_outofbandmanagement.py
test_oobm_configure_default_driver	Success	0.07	test_outofbandmanagement.py
test_oobm_background_powerstate_sync	Success	29.36	test_outofbandmanagement.py
test_extendPhysicalNetworkVlan	Success	15.24	test_non_contigiousvlan.py
test_01_nic	Success	499.02	test_nic.py
test_releaseIP	Success	272.44	test_network.py
test_reboot_router	Success	699.28	test_network.py
test_public_ip_user_account	Success	10.18	test_network.py
test_public_ip_admin_account	Success	40.23	test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule	Success	76.69	test_network.py
test_network_rules_acquired_public_ip_2_nat_rule	Success	61.38	test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule	Success	124.54	test_network.py
test_delete_account	Success	367.47	test_network.py
test_02_port_fwd_on_non_src_nat	Success	55.53	test_network.py
test_01_port_fwd_on_src_nat	Success	111.72	test_network.py
test_nested_virtualization_vmware	Success	348.13	test_nested_virtualization.py
test_nic_secondaryip_add_remove	Success	297.55	test_multipleips_per_nic.py
test_list_zones_metrics	Success	0.20	test_metrics_api.py
test_list_volumes_metrics	Success	5.38	test_metrics_api.py
test_list_vms_metrics	Success	186.34	test_metrics_api.py
test_list_pstorage_metrics	Success	0.19	test_metrics_api.py
test_list_infrastructure_metrics	Success	0.29	test_metrics_api.py
test_list_hosts_metrics	Success	0.27	test_metrics_api.py
test_list_clusters_metrics	Success	0.28	test_metrics_api.py
login_test_saml_user	Success	17.89	test_login.py
test_assign_and_removal_lb	Success	148.60	test_loadbalance.py
test_02_create_lb_rule_non_nat	Success	207.35	test_loadbalance.py
test_01_create_lb_rule_src_nat	Success	207.92	test_loadbalance.py
test_03_list_snapshots	Success	0.10	test_list_ids_parameter.py
test_02_list_templates	Success	0.03	test_list_ids_parameter.py
test_01_list_volumes	Success	0.02	test_list_ids_parameter.py
test_07_list_default_iso	Success	0.05	test_iso.py
test_05_iso_permissions	Success	0.06	test_iso.py
test_04_extract_Iso	Success	5.26	test_iso.py
test_03_delete_iso	Success	95.18	test_iso.py
test_02_edit_iso	Success	0.06	test_iso.py
test_01_create_iso	Success	20.70	test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces	Success	649.89	test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces	Success	413.43	test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80	Success	1203.15	test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80	Success	892.73	test_internal_lb.py
test_dedicateGuestVlanRange	Success	10.20	test_guest_vlan_range.py
test_UpdateConfigParamWithScope	Success	0.10	test_global_settings.py
test_rolepermission_lifecycle_update	Success	5.79	test_dynamicroles.py
test_rolepermission_lifecycle_list	Success	5.71	test_dynamicroles.py
test_rolepermission_lifecycle_delete	Success	5.59	test_dynamicroles.py
test_rolepermission_lifecycle_create	Success	5.60	test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates	Success	5.79	test_dynamicroles.py
test_role_lifecycle_update_role_inuse	Success	5.63	test_dynamicroles.py
test_role_lifecycle_update	Success	10.70	test_dynamicroles.py
test_role_lifecycle_list	Success	5.64	test_dynamicroles.py
test_role_lifecycle_delete	Success	10.65	test_dynamicroles.py
test_role_lifecycle_create	Success	5.62	test_dynamicroles.py
test_role_inuse_deletion	Success	5.61	test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers	Success	7.04	test_dynamicroles.py
test_role_account_acls	Success	7.28	test_dynamicroles.py
test_default_role_deletion	Success	5.70	test_dynamicroles.py
test_04_create_fat_type_disk_offering	Success	0.07	test_disk_offerings.py
test_03_delete_disk_offering	Success	0.03	test_disk_offerings.py
test_02_edit_disk_offering	Success	0.04	test_disk_offerings.py
test_02_create_sparse_type_disk_offering	Success	0.06	test_disk_offerings.py
test_01_create_disk_offering	Success	0.07	test_disk_offerings.py
test_deployvm_userdispersing	Success	55.59	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated	Success	110.92	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit	Success	201.27	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post	Success	50.58	test_deploy_vm_with_userdata.py
test_deployvm_userdata	Success	176.62	test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize	Success	5.63	test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize	Success	5.59	test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize	Success	5.67	test_deploy_vm_root_resize.py
test_deploy_vm_from_iso	Success	412.84	test_deploy_vm_iso.py
test_3d_gpu_support	Success	1544.21	test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup	Success	221.59	test_affinity_groups.py
test_08_resize_volume	Skipped	5.08	test_volumes.py
test_07_resize_fail	Skipped	10.22	test_volumes.py
test_06_copy_template	Skipped	0.00	test_templates.py
test_static_role_account_acls	Skipped	0.02	test_staticroles.py
test_11_ss_nfs_version_on_ssvm	Skipped	0.02	test_ssvm.py
test_01_scale_vm	Skipped	66.37	test_scale_vm.py
test_01_primary_storage_iscsi	Skipped	0.03	test_primary_storage.py
test_06_copy_iso	Skipped	0.00	test_iso.py
test_06_verify_guest_lspci_again	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm	Skipped	0.77	test_deploy_vgpu_enabled_vm.py

[nathanejohnson]

@DaanHoogland could you kick this off one more time? I should have the issue with the class teardown resolved with the latest rebase

[DaanHoogland]

@blueorangutan package

[blueorangutan]

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-681

[rohityadavcloud]

@blueorangutan test centos7 vmware-55u3

[blueorangutan]

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-55u3) has been kicked to run smoke tests

[blueorangutan]

Trillian test result (tid-1043)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 49329 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2066-t1043-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 49 look ok, 2 have error(s)

Test	Result	Time (s)	Test File
test_04_rvpc_privategw_static_routes	Failure	1114.80	test_privategw_acl.py
test_01_vpc_privategw_acl	Failure	186.97	test_privategw_acl.py
test_05_rvpc_multi_tiers	Error	111.59	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	Error	282.40	test_vpc_redundant.py
test_01_vpc_site2site_vpn	Success	452.10	test_vpc_vpn.py
test_01_vpc_remote_access_vpn	Success	171.67	test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn	Success	637.67	test_vpc_vpn.py
test_02_VPC_default_routes	Success	334.98	test_vpc_router_nics.py
test_01_VPC_nics_after_destroy	Success	826.48	test_vpc_router_nics.py
test_04_rvpc_network_garbage_collector_nics	Success	1559.38	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	Success	708.23	test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	Success	1405.28	test_vpc_redundant.py
test_09_delete_detached_volume	Success	31.02	test_volumes.py
test_06_download_detached_volume	Success	65.54	test_volumes.py
test_05_detach_volume	Success	105.22	test_volumes.py
test_04_delete_attached_volume	Success	15.30	test_volumes.py
test_03_download_attached_volume	Success	25.33	test_volumes.py
test_02_attach_volume	Success	53.85	test_volumes.py
test_01_create_volume	Success	515.66	test_volumes.py
test_change_service_offering_for_vm_with_snapshots	Success	469.48	test_vm_snapshots.py
test_03_delete_vm_snapshots	Success	275.27	test_vm_snapshots.py
test_02_revert_vm_snapshots	Success	224.14	test_vm_snapshots.py
test_01_create_vm_snapshots	Success	161.66	test_vm_snapshots.py
test_deploy_vm_multiple	Success	297.79	test_vm_life_cycle.py
test_deploy_vm	Success	0.03	test_vm_life_cycle.py
test_advZoneVirtualRouter	Success	0.02	test_vm_life_cycle.py
test_10_attachAndDetach_iso	Success	26.77	test_vm_life_cycle.py
test_09_expunge_vm	Success	125.22	test_vm_life_cycle.py
test_08_migrate_vm	Success	66.00	test_vm_life_cycle.py
test_07_restore_vm	Success	0.10	test_vm_life_cycle.py
test_06_destroy_vm	Success	10.17	test_vm_life_cycle.py
test_03_reboot_vm	Success	5.13	test_vm_life_cycle.py
test_02_start_vm	Success	20.21	test_vm_life_cycle.py
test_01_stop_vm	Success	10.14	test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName	Success	281.71	test_templates.py
test_08_list_system_templates	Success	0.03	test_templates.py
test_07_list_public_templates	Success	0.04	test_templates.py
test_05_template_permissions	Success	0.05	test_templates.py
test_04_extract_template	Success	15.21	test_templates.py
test_03_delete_template	Success	5.09	test_templates.py
test_02_edit_template	Success	90.17	test_templates.py
test_01_create_template	Success	115.83	test_templates.py
test_10_destroy_cpvm	Success	261.75	test_ssvm.py
test_09_destroy_ssvm	Success	243.68	test_ssvm.py
test_08_reboot_cpvm	Success	156.56	test_ssvm.py
test_07_reboot_ssvm	Success	158.34	test_ssvm.py
test_06_stop_cpvm	Success	201.81	test_ssvm.py
test_05_stop_ssvm	Success	238.83	test_ssvm.py
test_04_cpvm_internals	Success	1.13	test_ssvm.py
test_03_ssvm_internals	Success	4.53	test_ssvm.py
test_02_list_cpvm_vm	Success	0.11	test_ssvm.py
test_01_list_sec_storage_vm	Success	0.12	test_ssvm.py
test_02_list_snapshots_with_removed_data_store	Success	202.52	test_snapshots.py
test_01_snapshot_root_disk	Success	66.51	test_snapshots.py
test_04_change_offering_small	Success	103.02	test_service_offerings.py
test_03_delete_service_offering	Success	0.04	test_service_offerings.py
test_02_edit_service_offering	Success	0.07	test_service_offerings.py
test_01_create_service_offering	Success	0.11	test_service_offerings.py
test_02_sys_template_ready	Success	0.12	test_secondary_storage.py
test_01_sys_vm_start	Success	0.17	test_secondary_storage.py
test_09_reboot_router	Success	181.12	test_routers.py
test_08_start_router	Success	156.03	test_routers.py
test_07_stop_router	Success	25.24	test_routers.py
test_06_router_advanced	Success	0.06	test_routers.py
test_05_router_basic	Success	0.04	test_routers.py
test_04_restart_network_wo_cleanup	Success	5.63	test_routers.py
test_03_restart_network_cleanup	Success	181.17	test_routers.py
test_02_router_internal_adv	Success	0.98	test_routers.py
test_01_router_internal_basic	Success	0.53	test_routers.py
test_router_dns_guestipquery	Success	76.65	test_router_dns.py
test_router_dns_externalipquery	Success	0.06	test_router_dns.py
test_router_dhcphosts	Success	147.53	test_router_dhcphosts.py
test_router_dhcp_opts	Success	21.61	test_router_dhcphosts.py
test_01_updatevolumedetail	Success	5.10	test_resource_detail.py
test_01_reset_vm_on_reboot	Success	30.33	test_reset_vm_on_reboot.py
test_createRegion	Success	0.04	test_regions.py
test_create_pvlan_network	Success	5.19	test_pvlan.py
test_dedicatePublicIpRange	Success	0.44	test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup	Success	1309.83	test_privategw_acl.py
test_02_vpc_privategw_static_routes	Success	728.95	test_privategw_acl.py
test_03_migration_options_storage_tags	Success	38.88	test_primary_storage.py
test_02_edit_primary_storage_tags	Success	0.10	test_primary_storage.py
test_01_primary_storage_nfs	Success	37.43	test_primary_storage.py
test_01_deploy_vms_storage_tags	Success	51.97	test_primary_storage.py
test_createPortablePublicIPRange	Success	15.19	test_portable_publicip.py
test_createPortablePublicIPAcquire	Success	15.45	test_portable_publicip.py
test_isolate_network_password_server	Success	92.29	test_password_server.py
test_UpdateStorageOverProvisioningFactor	Success	0.14	test_over_provisioning.py
test_oobm_zchange_password	Success	30.78	test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership	Success	16.42	test_outofbandmanagement.py
test_oobm_issue_power_status	Success	10.25	test_outofbandmanagement.py
test_oobm_issue_power_soft	Success	15.36	test_outofbandmanagement.py
test_oobm_issue_power_reset	Success	15.35	test_outofbandmanagement.py
test_oobm_issue_power_on	Success	15.40	test_outofbandmanagement.py
test_oobm_issue_power_off	Success	10.41	test_outofbandmanagement.py
test_oobm_issue_power_cycle	Success	15.36	test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones	Success	92.53	test_outofbandmanagement.py
test_oobm_enable_feature_valid	Success	5.17	test_outofbandmanagement.py
test_oobm_enable_feature_invalid	Success	0.15	test_outofbandmanagement.py
test_oobm_disable_feature_valid	Success	5.22	test_outofbandmanagement.py
test_oobm_disable_feature_invalid	Success	0.13	test_outofbandmanagement.py
test_oobm_configure_invalid_driver	Success	0.07	test_outofbandmanagement.py
test_oobm_configure_default_driver	Success	0.07	test_outofbandmanagement.py
test_oobm_background_powerstate_sync	Success	23.39	test_outofbandmanagement.py
test_extendPhysicalNetworkVlan	Success	15.30	test_non_contigiousvlan.py
test_01_nic	Success	590.72	test_nic.py
test_releaseIP	Success	323.25	test_network.py
test_reboot_router	Success	835.98	test_network.py
test_public_ip_user_account	Success	10.27	test_network.py
test_public_ip_admin_account	Success	40.32	test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule	Success	76.81	test_network.py
test_network_rules_acquired_public_ip_2_nat_rule	Success	61.66	test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule	Success	124.89	test_network.py
test_delete_account	Success	292.90	test_network.py
test_02_port_fwd_on_non_src_nat	Success	55.72	test_network.py
test_01_port_fwd_on_src_nat	Success	111.78	test_network.py
test_nested_virtualization_vmware	Success	398.62	test_nested_virtualization.py
test_nic_secondaryip_add_remove	Success	212.52	test_multipleips_per_nic.py
test_list_zones_metrics	Success	0.22	test_metrics_api.py
test_list_volumes_metrics	Success	5.48	test_metrics_api.py
test_list_vms_metrics	Success	397.81	test_metrics_api.py
test_list_pstorage_metrics	Success	0.24	test_metrics_api.py
test_list_infrastructure_metrics	Success	0.48	test_metrics_api.py
test_list_hosts_metrics	Success	0.44	test_metrics_api.py
test_list_clusters_metrics	Success	0.43	test_metrics_api.py
login_test_saml_user	Success	19.33	test_login.py
test_assign_and_removal_lb	Success	148.38	test_loadbalance.py
test_02_create_lb_rule_non_nat	Success	207.21	test_loadbalance.py
test_01_create_lb_rule_src_nat	Success	208.06	test_loadbalance.py
test_03_list_snapshots	Success	0.08	test_list_ids_parameter.py
test_02_list_templates	Success	0.04	test_list_ids_parameter.py
test_01_list_volumes	Success	0.03	test_list_ids_parameter.py
test_07_list_default_iso	Success	0.06	test_iso.py
test_05_iso_permissions	Success	0.06	test_iso.py
test_04_extract_Iso	Success	5.19	test_iso.py
test_03_delete_iso	Success	95.19	test_iso.py
test_02_edit_iso	Success	0.05	test_iso.py
test_01_create_iso	Success	21.00	test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces	Success	540.19	test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces	Success	485.11	test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80	Success	1058.20	test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80	Success	852.55	test_internal_lb.py
test_dedicateGuestVlanRange	Success	10.28	test_guest_vlan_range.py
test_UpdateConfigParamWithScope	Success	0.13	test_global_settings.py
test_rolepermission_lifecycle_update	Success	6.28	test_dynamicroles.py
test_rolepermission_lifecycle_list	Success	6.01	test_dynamicroles.py
test_rolepermission_lifecycle_delete	Success	5.96	test_dynamicroles.py
test_rolepermission_lifecycle_create	Success	5.88	test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates	Success	6.16	test_dynamicroles.py
test_role_lifecycle_update_role_inuse	Success	5.96	test_dynamicroles.py
test_role_lifecycle_update	Success	10.98	test_dynamicroles.py
test_role_lifecycle_list	Success	5.89	test_dynamicroles.py
test_role_lifecycle_delete	Success	10.93	test_dynamicroles.py
test_role_lifecycle_create	Success	5.87	test_dynamicroles.py
test_role_inuse_deletion	Success	5.85	test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers	Success	8.17	test_dynamicroles.py
test_role_account_acls	Success	8.66	test_dynamicroles.py
test_default_role_deletion	Success	5.98	test_dynamicroles.py
test_04_create_fat_type_disk_offering	Success	0.07	test_disk_offerings.py
test_03_delete_disk_offering	Success	0.04	test_disk_offerings.py
test_02_edit_disk_offering	Success	0.05	test_disk_offerings.py
test_02_create_sparse_type_disk_offering	Success	0.09	test_disk_offerings.py
test_01_create_disk_offering	Success	0.12	test_disk_offerings.py
test_deployvm_userdispersing	Success	65.89	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated	Success	106.40	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit	Success	236.70	test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post	Success	30.64	test_deploy_vm_with_userdata.py
test_deployvm_userdata	Success	146.74	test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize	Success	5.84	test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize	Success	5.87	test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize	Success	5.98	test_deploy_vm_root_resize.py
test_deploy_vm_from_iso	Success	252.70	test_deploy_vm_iso.py
test_3d_gpu_support	Success	530.48	test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup	Success	312.60	test_affinity_groups.py
test_08_resize_volume	Skipped	10.17	test_volumes.py
test_07_resize_fail	Skipped	15.30	test_volumes.py
test_06_copy_template	Skipped	0.00	test_templates.py
test_static_role_account_acls	Skipped	0.02	test_staticroles.py
test_11_ss_nfs_version_on_ssvm	Skipped	0.02	test_ssvm.py
test_01_scale_vm	Skipped	66.31	test_scale_vm.py
test_01_primary_storage_iscsi	Skipped	0.03	test_primary_storage.py
test_06_copy_iso	Skipped	0.00	test_iso.py
test_06_verify_guest_lspci_again	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt	Skipped	0.00	test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm	Skipped	1.13	test_deploy_vgpu_enabled_vm.py

[nathanejohnson]

thanks @rhtyd and @DaanHoogland

@karuturi looks like kvm tests succeed and other hypervisors should now properly skip the test.
Would you like to run any more tests or do you think this is sufficient for merging?

[rohityadavcloud]

LGTM.
@blueorangutan package

[DaanHoogland]

@karuturi can you merge this?