Specify resource limits for audit and controller pod separately using helm values

[RnkeZ]

What this PR does / why we need it:

• Seperates resources value in values.yaml for audit and controller-manager deployment

Which issue(s) this PR fixes (optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged):
Closes #869

Special notes for your reviewer:

[maxsmythe]

Thanks for the submission!

Can you sign the DCO (the link to do so is in the failed DCO check above).

Also, in order to prevent this change from being clobbered the next time we generate a config, you'll need to update these three bits of code:

gatekeeper/cmd/build/helmify/kustomize-for-helm.yaml

Line 69 in 2cbba72

resources: HELMSUBST_DEPLOYMENT_CONTAINER_RESOURCES

gatekeeper/cmd/build/helmify/kustomize-for-helm.yaml

Line 96 in 2cbba72

resources: HELMSUBST_DEPLOYMENT_CONTAINER_RESOURCES

gatekeeper/cmd/build/helmify/replacements.go

Lines 4 to 5 in 2cbba72

	"HELMSUBST_DEPLOYMENT_CONTAINER_RESOURCES": `
	{{ toYaml .Values.resources | indent 10 }}`,

@sozercan this change in the schema of the values fields for Helm strikes me as a breaking change from the previous chart. Is that an issue?

[codecov-io]

Codecov Report

Merging #874 into master will decrease coverage by 0.22%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #874      +/-   ##
==========================================
- Coverage   43.56%   43.34%   -0.23%     
==========================================
  Files          47       47              
  Lines        3170     3170              
==========================================
- Hits         1381     1374       -7     
- Misses       1594     1598       +4     
- Partials      195      198       +3     

Flag	Coverage Δ
#unittests	43.34% <ø> (-0.23%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...onstrainttemplate/constrainttemplate_controller.go	52.76% <0.00%> (-2.94%)	⬇️
pkg/readiness/object_tracker.go	79.14% <0.00%> (+1.22%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 469f747...9637c10. Read the comment docs.

[maxsmythe]

Looks like linting is failing with this error:

cmd/build/helmify/replacements.go:7: File is not `gofmt`-ed with `-s` (gofmt)

goimports -w cmd/build/helmify/replacements.go

should clean up that file

[maxsmythe]

LGTM

I'll leave it to @sozercan to weigh in on the backwards compatibility question.

[sozercan]

@RnkeZ can you run make manifests, it'll generate changes in manifests_staging/charts and commit those

[sozercan]

LGTM

[mveitas]

One thing to note is that it looks like the docs in the README are missing these changes: https://github.com/open-policy-agent/gatekeeper/tree/master/charts/gatekeeper

If I can get around to it, I'll submit a PR