improve oom pod error handling

[sagor999]

Description

Handle pod failed with out of memory error correctly.
This is the status of the pod with out of memory error:

status:
  message: 'Pod Node didn''t have enough resource: memory, requested: 2097152000,
    used: 65865462583, capacity: 66388008960'
  phase: Failed
  reason: OutOfmemory
  startTime: "2022-02-25T14:26:36Z"

Related Issue(s)

Fixes #8238
Improves #8372

How to test

Release Notes

Improve handling of an error when pod fails to start due to out of memory error on the node

Documentation

[codecov]

Codecov Report

Merging #8463 (d1a75cb) into main (84128c3) will increase coverage by 21.03%.
The diff coverage is 0.00%.

@@             Coverage Diff             @@
##             main    #8463       +/-   ##
===========================================
+ Coverage   12.31%   33.34%   +21.03%     
===========================================
  Files          20       31       +11     
  Lines        1161     4579     +3418     
===========================================
+ Hits          143     1527     +1384     
- Misses       1014     2936     +1922     
- Partials        4      116      +112     

Flag	Coverage Δ
components-gitpod-cli-app	11.17% <ø> (ø)
components-local-app-app-darwin-amd64	?
components-local-app-app-darwin-arm64	?
components-local-app-app-linux-amd64	?
components-local-app-app-linux-arm64	?
components-local-app-app-windows-386	?
components-local-app-app-windows-amd64	?
components-local-app-app-windows-arm64	?
components-ws-manager-app	39.48% <0.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
components/ws-manager/pkg/manager/manager.go	20.41% <0.00%> (ø)
components/local-app/pkg/auth/auth.go
components/local-app/pkg/auth/pkce.go
components/ws-manager/pkg/clock/clock.go	68.62% <0.00%> (ø)
components/ws-manager/pkg/manager/manager_ee.go	0.00% <0.00%> (ø)
components/ws-manager/pkg/manager/monitor.go	9.46% <0.00%> (ø)
components/ws-manager/pkg/manager/probe.go	0.00% <0.00%> (ø)
components/ws-manager/pkg/manager/metrics.go	11.11% <0.00%> (ø)
components/ws-manager/pkg/manager/annotations.go	65.11% <0.00%> (ø)
components/ws-manager/pkg/manager/imagespec.go	0.00% <0.00%> (ø)
... and 6 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 84128c3...d1a75cb. Read the comment docs.

[aledbf]

LGTM