Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update purge test resources (both azure and aws) workflows #7551

Merged
merged 1 commit into from
May 7, 2024

Conversation

ytimocin
Copy link
Contributor

Description

Update purge test resources (both azure and aws) workflows

Type of change

@ytimocin ytimocin requested review from a team as code owners April 26, 2024 01:00
@radius-functional-tests
Copy link

radius-functional-tests bot commented Apr 26, 2024

Radius functional test overview

🔍 Go to test action run

Name Value
Repository radius-project/radius
Commit ref ca3688d
Unique ID funcce8026c39e
Image tag pr-funcce8026c39e
Click here to see the list of tools in the current test run
  • gotestsum 1.10.0
  • KinD: v0.20.0
  • Dapr: 1.12.0
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.1.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funcce8026c39e
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funcce8026c39e
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-funcce8026c39e
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funcce8026c39e
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting cli functional tests...
⌛ Starting ucp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting shared functional tests...
✅ msgrp functional tests succeeded
✅ ucp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ daprrp functional tests succeeded
✅ samples functional tests succeeded
✅ cli functional tests succeeded
✅ shared functional tests succeeded

@@ -93,5 +93,17 @@ jobs:
cat ${{ env.AZURE_RG_DELETE_LIST_FILE}} | while read line
do
echo " * $line" >> $GITHUB_STEP_SUMMARY
az group delete --resource-group $line --yes --verbose
az group delete --resource-group $line --yes --verbose --no-wait
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that because we have a lot of resource groups, it takes more than 5 minutes to delete them. Within that 5 minutes, the session loses its access because login is only granted for 5 minutes. Please see: Azure/login#372.

I may be wrong about this. Open to suggestions. cc/ @youngbupark

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is a similar issue to this one: #7494. There was a regression in the az cli with the login expiration so they provided some workarounds here: Azure/azure-cli#28737 (comment)

But we already use a service principal and that still seems to be failing for us. I think they plan to release a fix on 4/30 so we may need to revisit this once that version is out

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like az login issues 5 mins expiry token. I am ok to add --no-wait. The fix will be released in 2.60 CLI.

Copy link

github-actions bot commented Apr 26, 2024

Test Results

3 148 tests  ±0   3 142 ✅ ±0   3m 56s ⏱️ +2s
  259 suites ±0       6 💤 ±0 
    1 files   ±0       0 ❌ ±0 

Results for commit 66d38a2. ± Comparison against base commit 1f24aa9.

♻️ This comment has been updated with latest results.

Copy link

codecov bot commented Apr 26, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 60.32%. Comparing base (1f24aa9) to head (66d38a2).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #7551      +/-   ##
==========================================
- Coverage   60.33%   60.32%   -0.02%     
==========================================
  Files         517      517              
  Lines       26432    26432              
==========================================
- Hits        15948    15945       -3     
- Misses       9138     9139       +1     
- Partials     1346     1348       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@@ -40,3 +40,15 @@ jobs:
- name: Delete old AWS resources
run: |
./.github/scripts/delete-aws-resources.sh ${{ env.AWS_RESOURCE_TYPES }}
- name: Create issue for failing purge aws test resources run

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't you think it is too verbose?

done
- name: Create issue for failing purge test resources run

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do not think we need this.. it is too verbose and noisy.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't you think that we should know if this workflow fails? Otherwise, we may only understand when we hit resource limits. Happy to discuss further and listen to other ideas.

@youngbupark
Copy link

youngbupark commented Apr 28, 2024

@ytimocin I do not think we need to create the issue for the deletion failure. It seems too noisy. other than this, lgtm.

@ytimocin ytimocin force-pushed the ytimocin/updatePurgeWorkflows branch from ca3688d to cd230b2 Compare May 4, 2024 14:54
@ytimocin ytimocin temporarily deployed to functional-tests May 4, 2024 14:54 — with GitHub Actions Inactive
@radius-functional-tests

This comment has been minimized.

@radius-functional-tests
Copy link

radius-functional-tests bot commented May 6, 2024

⌛ Building Radius and pushing container images for functional tests...

✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting shared functional tests...
⌛ Starting samples functional tests...
⌛ Starting cli functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting datastoresrp functional tests...
✅ samples functional tests succeeded
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ ucp functional tests succeeded
✅ daprrp functional tests succeeded
✅ cli functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

Signed-off-by: ytimocin <ytimocin@microsoft.com>
@ytimocin ytimocin force-pushed the ytimocin/updatePurgeWorkflows branch from cd230b2 to 66d38a2 Compare May 7, 2024 00:27
@ytimocin ytimocin temporarily deployed to functional-tests May 7, 2024 00:27 — with GitHub Actions Inactive
@radius-functional-tests
Copy link

radius-functional-tests bot commented May 7, 2024

Radius functional test overview

🔍 Go to test action run

Name Value
Repository radius-project/radius
Commit ref 66d38a2
Unique ID func0a0cd50f76
Image tag pr-func0a0cd50f76
Click here to see the list of tools in the current test run
  • gotestsum 1.10.0
  • KinD: v0.20.0
  • Dapr: 1.12.0
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.1.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func0a0cd50f76
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func0a0cd50f76
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-func0a0cd50f76
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func0a0cd50f76
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting cli functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting shared functional tests...
⌛ Starting ucp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
✅ kubernetes functional tests succeeded
✅ msgrp functional tests succeeded
✅ ucp functional tests succeeded
✅ samples functional tests succeeded
✅ cli functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ shared functional tests succeeded

@ytimocin ytimocin merged commit eb8fa2d into main May 7, 2024
19 checks passed
@ytimocin ytimocin deleted the ytimocin/updatePurgeWorkflows branch May 7, 2024 05:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AADSTS700024: Client assertion is not within its valid time range error in Purge Test Resources workflow
4 participants