Workflow failure: cron

[pulumi-bot]

Workflow Failure

cron has failed. See the list of failures below:

• 2024-04-18T07:52:21.000Z

• 2024-04-18T14:09:14.000Z

[t0yv0]

It's consistently failing looks like, and blocking everything. I see you're taking a look @flostadler any discoveries? If not we can skip it for now to unblock other work.

[flostadler]

Yes, found that this is caused by AWS setting an environment variable by default now to auto discover reports (CODEBUILD_CONFIG_AUTO_DISCOVER).

As a workaround for the test I'm creating a PR that sets this env variable.
But I'm worried that this will lead to users ending up with a drift until they re-run pulumi up once

[flostadler]

I was also able to replicate this with Terraform. Intentionally used an old aws provider (5.6.1) to ensure it was not caused by a recent upstream change.
And the environment variable (CODEBUILD_CONFIG_AUTO_DISCOVER) is also showing up in the CloudTrail audit events so everything points to AWS being the culprit here.

resource "aws_codebuild_project" "this" {
  name           = "florian-tf-sample"
  build_timeout  = 30

  service_role = "arn:aws:iam::616138583583:role/CICD-sample-Role-5b38997"

  artifacts {
    type = "NO_ARTIFACTS"
  }

  environment {
    compute_type                = "BUILD_GENERAL1_SMALL"
    image                       = "aws/codebuild/amazonlinux2-x86_64-standard:4.0"
    type                        = "LINUX_CONTAINER"
    image_pull_credentials_type = "CODEBUILD"
  }

  source {
    type            = "GITHUB"
    location        = "https://github.com/edalongeville/pulumi_sample_codebuild.git"
    git_clone_depth = 1
  }

  tags = {
    Owner = "florian"
  }
}

Tracing the AWS API calls shows that the env variable is not present in the create request, but shows up in the response automatically:

Request:

{
    "artifacts": {
        "over************Name": false,
        "type": "NO_ARTIFACTS"
    },
    "environment": {
        "computeType": "BUILD_GENERAL1_SMALL",
        "image": "aws/******************nux2-x86_64-standard:4.0",
        "imag****************Type": "CODEBUILD",
        "privilegedMode": false,
        "type": "LINUX_CONTAINER"
    },
    "logsConfig": {
        "cloudWatchLogs": {
            "status": "ENABLED"
        },
        "s3Logs": {
            "status": "DISABLED"
        }
    },
    "name": "florian-tf-sample",
    "queu**************utes": 480,
    "serviceRole": "arn:aws:iam::616138583583:role/CICD-sample-Role-9662d80",
    "source": {
        "buildspec": "",
        "gitCloneDepth": 1,
        "insecureSsl": false,
        "location": "https://github.com/****************lumi_sample_codebuild.git",
        "repo*********atus": false,
        "type": "GITHUB"
    },
    "tags": [
        {
            "key": "Owner",
            "value": "florian"
        }
    ],
    "time********utes": 30
}

Response:

{
    "project": {
        "arn": "arn:aws:codebuild:us-west-2:616138583583:project/florian-tf-sample",
        "artifacts": {
            "over************Name": false,
            "type": "NO_ARTIFACTS"
        },
        "badge": {
            "badgeEnabled": false
        },
        "cache": {
            "type": "NO_CACHE"
        },
        "created": 1.713517789859E9,
        "encryptionKey": "arn:aws:kms:us-west-2:616138583583:alias/aws/s3",
        "environment": {
            "computeType": "BUILD_GENERAL1_SMALL",
            "envi************bles": [
                {
                    "name": "CODEBUILD_CONFIG_AUTO_DISCOVER",
                    "type": "PLAINTEXT",
                    "value": "true"
                }
            ],
            "image": "aws/******************nux2-x86_64-standard:4.0",
            "imag****************Type": "CODEBUILD",
            "privilegedMode": false,
            "type": "LINUX_CONTAINER"
        },
        "lastModified": 1.713517789859E9,
        "logsConfig": {
            "cloudWatchLogs": {
                "status": "ENABLED"
            },
            "s3Logs": {
                "encr**********bled": false,
                "status": "DISABLED"
            }
        },
        "name": "florian-tf-sample",
        "proj*********lity": "PRIVATE",
        "queu**************utes": 480,
        "serviceRole": "arn:aws:iam::616138583583:role/CICD-sample-Role-9662d80",
        "source": {
            "buildspec": "",
            "gitCloneDepth": 1,
            "insecureSsl": false,
            "location": "https://github.com/****************lumi_sample_codebuild.git",
            "repo*********atus": false,
            "type": "GITHUB"
        },
        "tags": [
            {
                "key": "Owner",
                "value": "florian"
            }
        ],
        "time********utes": 30
    }
}

[flostadler]

Opened #3844 to track the UX implications