[kots] remove cert-manager from Gitpod package

[Pothulapati]

Description

Currently, We include cert-manager instance into the
Gitpod kots package, and install it whenever Gitpod installation
is requested.

This causes the following problems:

• cert-manager is a separate beast on its own, There are numerous
  configurations that might be needed to be set to make it run correctly
  based on the cluster config.
• A lot users could have already have it installed, and have to
  struggle to get Gitpod up and running in those cases.

To solve them, We could either provide all the configurations of
cert-manager into the Gitpod package to cater users with all
config needs or remove the package and expect cert-manager as a
pre-requisite and make sure its documented.

The latter feels better as it removes the maintenance of cert-manager for
us while also allowing users to have specific configuration. The install
path for cert-manager is also pretty well documented
with all the changes needed based on the cluster environment.

This PR also removes the cert-manager issuers and updates the config to allow
users to use pre-configured resources

Signed-off-by: Tarun Pothulapati tarun@gitpod.io

Related Issue(s)

Fixes #8749

How to test

• Install Gitpod using k kots install gitpod-pov/dev-tar

Release Notes

[kots] Remove `cert-manager` from the Gitpod package

Documentation

[codecov]

Codecov Report

Merging #8785 (7bc9e11) into main (77a3414) will not change coverage.
The diff coverage is n/a.

❗ Current head 7bc9e11 differs from pull request most recent head c904a6a. Consider uploading reports for the commit c904a6a to get more accurate results

@@           Coverage Diff           @@
##             main    #8785   +/-   ##
=======================================
  Coverage   11.17%   11.17%           
=======================================
  Files          18       18           
  Lines         993      993           
=======================================
  Hits          111      111           
  Misses        880      880           
  Partials        2        2           

Flag	Coverage Δ
components-gitpod-cli-app	11.17% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

[mrsimonemms]

Good start, but a couple of thoughts on it

[Pothulapati]

Updated the PR to not mention the pre-requisite requirement of cert-manager as we have multiple ways to do that, and are discussing with replicated folks on the best way to have it i.e either a pre-flight check, or in the config itself.

Will raise a PR once we take a decision there. We can review and merge this removal meanwhile.

[mrsimonemms]

/hold

This is good work @Pothulapati. I'd like to get the work in to remove the (cluster)issuer setup as well which is why I've put this on hold - if you want me to do it, remove the hold and we'll merge yours in. If you want to add it to this PR, please do so and I'll add that to the review.

[Pothulapati]

@mrsimonemms I've updated the commit log to include a single commit for both this and the other PR that got merged into this.

[mrsimonemms]

LGTM

[mrsimonemms]

/unhold