e2e: plugin compatibility tooling and test cases #84
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
anujc25
reviewed
Mar 3, 2023
test/e2e/plugins_compatibility/plugins_compatibility_helper_test.go
Outdated
Show resolved
Hide resolved
chandrareddyp
force-pushed
the
topic/cpamuluri/plugins_compatibility_tests
branch
from
e02bff6
to
141a2ac
Compare
anujc25
reviewed
Mar 3, 2023
chandrareddyp
force-pushed
the
topic/cpamuluri/plugins_compatibility_tests
branch
4 times, most recently
from
eaecd26
to
11122fe
Compare
anujc25
reviewed
Mar 7, 2023
There was a problem hiding this comment.
Seems like we are missing tests for the tanzu plugin list command.
One option is to organize tests in following way:
tanzu plugin list # should not have any plugins installed
tanzu plugin install <>
tanzu plugin list # verify plugins installed are listed and status are correct
tanzu plugin uninstall <>
tanzu plugin list # verify plugins uninstalled are not listed
3d172d4
to
f5cbd05
Compare
anujc25
reviewed
Mar 7, 2023
anujc25
reviewed
Mar 7, 2023
chandrareddyp
force-pushed
the
topic/cpamuluri/plugins_compatibility_tests
branch
4 times, most recently
from
1022686
to
0622e9f
Compare
chandrareddyp
force-pushed
the
topic/cpamuluri/plugins_compatibility_tests
branch
from
721bb75
to
20f6d66
Compare
vuil
pushed a commit
that referenced
this pull request
Mar 20, 2023
Co-authored-by: Chandra Pamuluri <cpamuluri@cpamuluri-a01.vmware.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What this PR does / why we need it
This PR is to implement end-to-end test framework tooling for the plugin compatibility use cases and test cases implementation for the same.
The plugin compatibility end-to-end test cases aim to validate that the plugins built from different https://github.com/vmware-tanzu/tanzu-plugin-runtime supported versions can co-exist and operate in the https://github.com/vmware-tanzu/tanzu-cli environment.
New Github code repository https://github.com/chandrareddyp/tanzu-cli-test-plugins is created to store the test plugins code and tooling to build and publish the plugin artifacts to remote test central repository.
The test plugins are published in the remote test central repository. To execute these plugin compatibility tests, we must set
the environment variable TANZU_CLI_E2E_TEST_CENTRAL_REPO_URL with the remote central repo URL otherwise, these test cases will be skipped. Currently, the TANZU_CLI_E2E_TEST_CENTRAL_REPO_URL is set "gcr.io/eminent-nation-87317/tanzu-cli/test/v1/plugins/plugin-inventory:latest" in Makefile if the user not provided, the TANZU_CLI_E2E_TEST_CENTRAL_REPO_URL value updated to TANZU_CLI_PRE_RELEASE_REPO_IMAGE.
These plugin compatibility test cases search for all the test plugins (prefix with "test-plugin-"), install all test plugins and execute basic plugin commands, and finally, uninstall all test plugins.
Which issue(s) this PR fixes
Fixes #NA
Describe testing done for PR
Tests are executed locally by pointing local central reop and GitHub pipeline is successfully
Release note
Additional information
Special notes for your reviewer