api,ui: multi arch improvements

[shwstppr]

Description

This PR adds the following changes concerning multi-arch support:

• Allow downloading and seeing of aarch64 systemVM template for KVM
• Improvements in deployments of system VMs including VRs to allow trying deployment with different architecture templates. Operator can now have their routing template with same name for different architectures and CloudStack will attempt deployment with all of them based on the below config. Similarly, now CloudStack will attempt to deploy SSVM and CPVM with different architecture templates available.
• Configuring preferred system VM architecture for a zone using config - system.vm.preferred.architecture
• UI changes to display, select and filter architecture fields for resources.
• API and UI changes to allow filtering resources using arch - listCluster, listHosts, listVirtualMachines

Doc PR: apache/cloudstack-documentation#491

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• build/CI
• test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[codecov]

Codecov Report

Attention: Patch coverage is 48.17073% with 425 lines in your changes missing coverage. Please review.

Project coverage is 16.12%. Comparing base (603cd84) to head (d8da081).
Report is 2 commits behind head on 4.20.

Files with missing lines	Patch %	Lines
...om/cloud/upgrade/SystemVmTemplateRegistration.java	54.21%	114 Missing and 11 partials ⚠️
...om/cloud/consoleproxy/ConsoleProxyManagerImpl.java	28.57%	40 Missing ⚠️
.../network/lb/InternalLoadBalancerVMManagerImpl.java	45.16%	32 Missing and 2 partials ⚠️
...va/com/cloud/network/router/NetworkHelperImpl.java	32.65%	33 Missing ⚠️
...ain/java/com/cloud/storage/StorageManagerImpl.java	0.00%	32 Missing ⚠️
.../java/com/cloud/storage/dao/VMTemplateDaoImpl.java	72.97%	11 Missing and 9 partials ⚠️
.../secondarystorage/SecondaryStorageManagerImpl.java	42.85%	20 Missing ⚠️
...in/java/com/cloud/server/ManagementServerImpl.java	0.00%	12 Missing ⚠️
...ain/java/com/cloud/api/query/QueryManagerImpl.java	0.00%	10 Missing ⚠️
...dstack/storage/datastore/db/ImageStoreDaoImpl.java	0.00%	9 Missing ⚠️
... and 29 more

Additional details and impacted files

@@             Coverage Diff              @@
##               4.20   #10289      +/-   ##
============================================
+ Coverage     16.02%   16.12%   +0.10%     
- Complexity    13128    13211      +83     
============================================
  Files          5652     5652              
  Lines        496021   496467     +446     
  Branches      60065    60120      +55     
============================================
+ Hits          79488    80061     +573     
+ Misses       407665   407494     -171     
- Partials       8868     8912      +44     

Flag	Coverage Δ
uitests	4.00% <ø> (+<0.01%)	⬆️
unittests	16.97% <48.17%> (+0.10%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[shwstppr]

@blueorangutan package

[blueorangutan]

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✖️ el8 ✖️ el9 ✔️ debian ✖️ suse15. SL-JID 13150

[shwstppr]

@blueorangutan package

[blueorangutan]

@shwstppr a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 13153

[github-actions]

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

[kiranchavala]

@blueorangutan test

[blueorangutan]

@kiranchavala a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian Build Failed (tid-13132)

[yadvr]

@blueorangutan test

[blueorangutan]

@rohityadavcloud a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[kiranchavala]

LGTM,

Test Case	Result
Check the label on the following sections (cluster, host, template, iso, iso, cks-iso, vm-instance, systemvm's	Pass
Test the configuration setting system.vm.preferred.architecture" at global and zone level"	Pass
UI: Test the vm deployment form for arch aware template and iso	Pass
UI : Test the filter dropdown on Cluster, Host, template, ISO, CKS-iso, vm's, systemvm's	Pass
Automatic download of systemvtemplate for aarch64 cluster should get triggered	Pass
Test the advanced zone deployment wizard for cluster type	Pass
Test the basic zone deployment wizard for cluster type	Pass
Test the Edge zone deployment wizard for cluster type	Pass
Updating of Cluster architecture should not be allowed if there are active host of different arch type	Pass

Some screenshots

[blueorangutan]

[SF] Trillian test result (tid-13133)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 54835 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10289-t13133-kvm-ol8.zip
Smoke tests completed. 140 look OK, 1 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_restore_vm_strict_tags_failure	Failure	57.42	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Failure	56.55	test_vm_strict_host_tags.py
test_06_deploy_vm_on_any_host_with_strict_tags_failure	Failure	3.68	test_vm_strict_host_tags.py