Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add github workflow to run non-cloud tests with no approval [wip - do not review] #7400

Closed
wants to merge 5 commits into from

Conversation

vinayada1
Copy link
Contributor

Description

Please explain the changes you've made.

Type of change

  • This pull request fixes a bug in Radius and has an approved issue (issue link required).
  • This pull request adds or changes features of Radius and has an approved issue (issue link required).
  • This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).

Fixes: #issue_number

@vinayada1 vinayada1 requested review from a team as code owners March 27, 2024 00:25
@vinayada1 vinayada1 changed the title Add github workflow to run non-cloud tests with no approval [wip] Add github workflow to run non-cloud tests with no approval [wip - do not review] Mar 27, 2024
@radius-functional-tests
Copy link

radius-functional-tests bot commented Mar 27, 2024

Radius functional test overview

🔍 Go to test action run

Name Value
Repository test-org-admin/radius-main
Commit ref 50566ce
Unique ID func17eb1c930d
Image tag pr-func17eb1c930d
Click here to see the list of tools in the current test run
  • gotestsum 1.10.0
  • KinD: v0.20.0
  • Dapr: 1.12.0
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.1.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func17eb1c930d
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func17eb1c930d
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-func17eb1c930d
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func17eb1c930d
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting ucp functional tests...
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ daprrp functional tests succeeded
✅ ucp functional tests succeeded
✅ cli functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

@vinayada1 vinayada1 force-pushed the separate-test branch 2 times, most recently from 34dfce5 to ccbfc84 Compare March 27, 2024 18:19
@radius-functional-tests
Copy link

radius-functional-tests bot commented Mar 27, 2024

Radius functional test overview

🔍 Go to test action run

Name Value
Repository test-org-admin/radius-main
Commit ref ccbfc84
Unique ID func9926820db6
Image tag pr-func9926820db6
Click here to see the list of tools in the current test run
  • gotestsum 1.10.0
  • KinD: v0.20.0
  • Dapr: 1.12.0
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.1.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func9926820db6
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func9926820db6
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-func9926820db6
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func9926820db6
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting cli functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting samples functional tests...
⌛ Starting datastoresrp functional tests...
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ ucp functional tests succeeded
✅ daprrp functional tests succeeded
✅ cli functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

# ------------------------------------------------------------

name: Functional tests with no cloud resources

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we consolidate this with some of the other workflows? (why or why not?). Without adding more complexity we're going to have at least 3 flavors:

  • Scheduled Azure tests
  • PR-based non-cloud functional tests
  • PR-based functional tests

I'm just thinking about how we can make this more maintainable. Do you have ideas?

Copy link

codecov bot commented Apr 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 61.00%. Comparing base (ea316f3) to head (e181140).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #7400   +/-   ##
=======================================
  Coverage   61.00%   61.00%           
=======================================
  Files         517      517           
  Lines       26514    26514           
=======================================
  Hits        16176    16176           
  Misses       8916     8916           
  Partials     1422     1422           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@radius-functional-tests
Copy link

radius-functional-tests bot commented May 16, 2024

Radius functional test overview

🔍 Go to test action run

Name Value
Repository test-org-admin/radius-main
Commit ref cc53b3a
Unique ID funce2d9e31876
Image tag pr-funce2d9e31876
Click here to see the list of tools in the current test run
  • gotestsum 1.10.0
  • KinD: v0.20.0
  • Dapr: 1.12.0
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.1.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funce2d9e31876
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funce2d9e31876
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-funce2d9e31876
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funce2d9e31876
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting shared functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting samples functional tests...
✅ ucp functional tests succeeded
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ samples functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ cli functional tests succeeded
✅ shared functional tests succeeded

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>
Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>
Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>
@ytimocin
Copy link
Contributor

ytimocin commented Aug 1, 2024

Fixed in this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants