Kibana tests can fail on Cloud if deleting index during snapshotting

[LeeDr]

We need to be able to run Kibana tests against a Cloud instance. But Cloud takes snapshots of indices very often and our tests try to delete an index very often. If we try to delete an index during a snapshot they currently fail as shown below.

We need to have a retry with long enough timeout to keep trying this until successful. Then the tests can continue.

Do we need to check the response and only retry for this case? Or perhaps there's other reasons for it to fail that we would want to retry for?

   └- × fail: "visualize app "before all" hook"
   │        [illegal_argument_exception] Cannot delete indices that are being snapshotted: [[.kibana/210lkQ2oRcqbQsryc7Zqsw]]. Try again after snapshot finishes or cancel the currently running snapshot.
   │         :: {"path":"/.kibana","query":{},"statusCode":400,"response":"{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Cannot delete indices that are being snapshotted: [[.kibana/210lkQ2oRcqbQsryc7Zqsw]]. Try again after snapshot finishes or cancel the currently running snapshot.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Cannot delete indices that are being snapshotted: [[.kibana/210lkQ2oRcqbQsryc7Zqsw]]. Try again after snapshot finishes or cancel the currently running snapshot.\"},\"status\":400}"}

[LeeDr]

@spalger please help