[Tests] Ensure functional test cases pass

[kavilla]

This issues is to track and ensure all the fucntional test cases are being passed.

• Run yarn test:ftr and list down all broken test cases
• Fix test cases / remove if not relevant anymore.

[kavilla]

Current failures locally:

1)    dashboard app
                           │       using current data
                           │         dashboard filtering
                           │           disabling a filter unfilters the data on
                           │             vega:
                           │
                           │      retry.try timeout: Error: expected -1 to be above -1
                           │     at Assertion.assert (/home/avillk/repos/OpenSearch-Dashboards/packages/osd-expect/expect.js:100:11)
                           │     at Assertion.greaterThan.Assertion.above (/home/avillk/repos/OpenSearch-Dashboards/packages/osd-expect/expect.js:317:8)
                           │     at Function.greaterThan (/home/avillk/repos/OpenSearch-Dashboards/packages/osd-expect/expect.js:531:15)
                           │     at forEach (/home/avillk/repos/OpenSearch-Dashboards/test/functional/services/dashboard/expectations.ts:115:38)
                           │     at Array.forEach (<anonymous>)
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/services/dashboard/expectations.ts:113:15)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │   Error: retry.try timeout: Error: expected -1 to be above -1
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.greaterThan.Assertion.above (packages/osd-expect/expect.js:317:8)
                           │       at Function.greaterThan (packages/osd-expect/expect.js:531:15)
                           │       at forEach (test/functional/services/dashboard/expectations.ts:115:38)
                           │       at Array.forEach (<anonymous>)
                           │       at retry.try (test/functional/services/dashboard/expectations.ts:113:15)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │2)    dashboard app
                           │       using current data
                           │         dashboard snapshots
                           │           compare TSVB snapshot:
                           │
                           │      Error: ENOENT: no such file or directory, open '/home/avillk/repos/OpenSearch-Dashboards/test/functional/screenshots/baseline/tsvb_dashboard.png'
                           │   
                           │ 
                           │ 
                           │3)    dashboard app
                           │       using current data
                           │         dashboard snapshots
                           │           compare area chart snapshot:
                           │
                           │      Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, a[href="#/list"])
                           │ Wait timed out after 10014ms
                           │     at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │4)    dashboard app
                           │       using legacy data
                           │         dashboard state
                           │           Tile map with no changes will update with visualization changes:
                           │
                           │      Error: expected 1 to not equal 1
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.equal (packages/osd-expect/expect.js:227:8)
                           │       at Context.it (test/functional/apps/dashboard/dashboard_state.js:187:48)
                           │ 
                           │ 
                           │5)    management
                           │       
                           │         index pattern empty view
                           │           shows empty views:
                           │
                           │      Error: expected testSubject(createAnyway) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │6)    management
                           │       
                           │         index pattern empty view
                           │           "after all" hook for "doesn't show read-only badge":
                           │
                           │      Error: [index_not_found_exception] no such index [logstash-a], with { index="logstash-a" & resource.id="logstash-a" & resource.type="index_or_alias" & index_uuid="_na_" }
                           │       at respond (node_modules/elasticsearch/src/lib/transport.js:349:15)
                           │       at checkRespForFailure (node_modules/elasticsearch/src/lib/transport.js:306:7)
                           │       at HttpConnector.<anonymous> (node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
                           │       at IncomingMessage.wrapper (node_modules/lodash/lodash.js:4949:19)
                           │       at endReadableNT (_stream_readable.js:1145:12)
                           │       at process._tickCallback (internal/process/next_tick.js:63:19)
                           │ 
                           │ 
                           │7)    management
                           │       
                           │         index pattern filter
                           │           should filter indexed fields:
                           │
                           │      TimeoutError: Waiting for element to be located By(xpath, //a[descendant::*[text()='logstash-*']])
                           │ Wait timed out after 10015ms
                           │       at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │8)    management
                           │       
                           │         index pattern filter
                           │           "after each" hook for "should filter indexed fields":
                           │
                           │      retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="deleteIndexPatternButton"])
                           │ Wait timed out after 10041ms
                           │     at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="deleteIndexPatternButton"])
                           │   Wait timed out after 10041ms
                           │       at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │9)    management
                           │       
                           │         import objects
                           │           .ndjson file
                           │             should import saved objects:
                           │
                           │      TypeError: Cannot read property 'objectType' of undefined
                           │       at SavedObjectsPage.getObjectTypeByTitle (test/functional/page_objects/management/saved_objects_page.ts:193:27)
                           │ 
                           │ 
                           │10)    management
                           │       
                           │         import objects
                           │           .ndjson file
                           │             should provide dialog to allow the importing of saved objects with index pattern conflicts:
                           │
                           │      Error: expected false to equal true
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.be.Assertion.equal (packages/osd-expect/expect.js:227:8)
                           │       at Assertion.be (packages/osd-expect/expect.js:69:22)
                           │       at Context.<anonymous> (test/functional/apps/management/_import_objects.js:97:42)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │11)    management
                           │       
                           │         import objects
                           │           .ndjson file
                           │             should import saved objects linked to saved searches:
                           │
                           │      Error: expected testSubject(importSavedObjectsSuccess) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │12)    management
                           │       
                           │         import objects
                           │           .ndjson file
                           │             should import saved objects with index patterns when index patterns already exists:
                           │
                           │      Error: expected false to equal true
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.be.Assertion.equal (packages/osd-expect/expect.js:227:8)
                           │       at Assertion.be (packages/osd-expect/expect.js:69:22)
                           │       at Context.it (test/functional/apps/management/_import_objects.js:195:42)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │13)    management
                           │       
                           │         import objects
                           │           .ndjson file
                           │             should import saved objects with index patterns when index patterns does not exists:
                           │
                           │      Error: expected false to equal true
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.be.Assertion.equal (packages/osd-expect/expect.js:227:8)
                           │       at Assertion.be (packages/osd-expect/expect.js:69:22)
                           │       at Context.it (test/functional/apps/management/_import_objects.js:212:42)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │14)    management
                           │       
                           │         test large number of fields
                           │           "before all" hook for "test_huge data should have expected number of fields":
                           │
                           │      retry.try timeout: Error: Index pattern not created
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/settings_page.ts:362:17)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │   Error: retry.try timeout: Error: Index pattern not created
                           │       at retry.try (test/functional/page_objects/settings_page.ts:362:17)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │15)    visualize app
                           │       
                           │         tile map visualize app
                           │           complete config
                           │             tile map chart
                           │               should show correct tile map data on default zoom level:
                           │
                           │      retry.try timeout: Error: retry.tryForTime timeout: Error: Button not found
                           │     at retry.tryForTime (/home/avillk/repos/OpenSearch-Dashboards/test/functional/services/common/find.ts:420:17)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.try timeout: Error: retry.tryForTime timeout: Error: Button not found
                           │       at retry.tryForTime (test/functional/services/common/find.ts:420:17)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │16)    visualize app
                           │       
                           │         tile map visualize app
                           │           complete config
                           │             tile map chart
                           │               should not be able to zoom out beyond 0:
                           │
                           │      retry.try timeout: Error: Not fully zoomed out yet
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/tile_map_page.ts:98:17)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │   Error: retry.try timeout: Error: Not fully zoomed out yet
                           │       at retry.try (test/functional/page_objects/tile_map_page.ts:98:17)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │17)    visualize app
                           │       
                           │         tile map visualize app
                           │           complete config
                           │             tile map chart
                           │               Fit data bounds should zoom to level 3:
                           │
                           │      SyntaxError: Unexpected token N in JSON at position 0
                           │       at JSON.parse (<anonymous>)
                           │       at map (test/functional/apps/visualize/_tile_map.js:102:31)
                           │       at Array.map (<anonymous>)
                           │       at compareTableData (test/functional/apps/visualize/_tile_map.js:100:38)
                           │       at Context.<anonymous> (test/functional/apps/visualize/_tile_map.js:173:11)
                           │ 
                           │ 
                           │18)    visualize app
                           │       
                           │         tile map visualize app
                           │           complete config
                           │             tile map chart
                           │               Fit data bounds works with pinned filter data:
                           │
                           │      retry.try timeout: Error: Not fully zoomed out yet
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/tile_map_page.ts:98:17)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │   Error: retry.try timeout: Error: Not fully zoomed out yet
                           │       at retry.try (test/functional/page_objects/tile_map_page.ts:98:17)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │19)    visualize app
                           │       
                           │         tile map visualize app
                           │           zoom warning behavior
                           │             should show warning at zoom 10:
                           │
                           │      Error: expected testSubject(maxZoomWarning) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │20)    visualize app
                           │       
                           │         tile map visualize app
                           │           zoom warning behavior
                           │             should continue providing zoom warning if left alone:
                           │
                           │      Error: expected testSubject(maxZoomWarning) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │21)    visualize app
                           │       
                           │         tile map visualize app
                           │           zoom warning behavior
                           │             should suppress zoom warning if suppress warnings button clicked:
                           │
                           │      Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="suppressZoomWarnings"])
                           │ Wait timed out after 10005ms
                           │     at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │22)    visualize app
                           │       
                           │         vector map
                           │           vector map
                           │             should change results after changing layer to world:
                           │
                           │      Error: Unable to find option 'World Countries' in select regionMapOptionsSelectLayer. Available options: 
                           │       at VisualizeEditorPage.setSelectByOptionText (test/functional/page_objects/visualize_editor_page.ts:508:15)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │23)    visualize app
                           │       
                           │         vector map
                           │           vector map
                           │             should contain a dropdown with the default road_map base layer as an option:
                           │
                           │      Error: expected false to equal true
                           │       at Assertion.assert (packages/osd-expect/expect.js:100:11)
                           │       at Assertion.be.Assertion.equal (packages/osd-expect/expect.js:227:8)
                           │       at Assertion.be (packages/osd-expect/expect.js:69:22)
                           │       at Context.it (test/functional/apps/visualize/_region_map.js:122:53)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │24)    visualize app
                           │       
                           │         visual builder
                           │           switch index patterns
                           │             should be able to switch between index patterns:
                           │
                           │      Error: Timeout of 360000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/avillk/repos/OpenSearch-Dashboards/test/functional/apps/visualize/_tsvb_chart.ts)
                           │   
                           │ 
                           │ 
                           │25)    visualize app
                           │       
                           │         visual builder
                           │           "before each" hook for "should activate previous/next chart tab and panel config":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │26)    visualize app
                           │       
                           │         visual builder
                           │           "before each" hook for "should render all necessary components":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │27)    visualize app
                           │       
                           │         visual builder
                           │           markdown
                           │             "before all" hook for "should render subtabs and table variables markdown components":
                           │
                           │      Error: TSVB Time Series tab is not loaded
                           │       at VisualBuilderPage.checkTabIsLoaded (test/functional/page_objects/visual_builder_page.ts:79:15)
                           │ 
                           │ 
                           │28)    visualize app
                           │       
                           │         visual builder
                           │           table
                           │             "before each" hook for "should display correct values on changing group by field and column name":
                           │
                           │      Error: TSVB Time Series tab is not loaded
                           │       at VisualBuilderPage.checkTabIsLoaded (test/functional/page_objects/visual_builder_page.ts:79:15)
                           │ 
                           │ 
                           │29)    visualize app
                           │       
                           │         vega chart in visualize app
                           │           "before all" hook in "vega chart in visualize app":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │
                           │ proc [opensearch-dashboards] �[37m  log  �[39m [12:26:23.052] [�[32minfo�[39m][plugins-system] Stopping all plugins.
                           │ info [opensearch-dashboards] exited with null after 4 hours
                           │ info [o.o.n.Node] [ip-172-31-36-223] stopping ...
                           │ info [o.o.n.Node] [ip-172-31-36-223] stopped
                           │ info [o.o.n.Node] [ip-172-31-36-223] closing ...
                           │ info [o.o.n.Node] [ip-172-31-36-223] closed
                           │ info [opensearch] stopped
                           │ info [opensearch] cleanup complete

29 functional test failures

info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

[kavilla]

Current failures locally:

                           │644 passing (3.0h)
                           │59 pending
                           │11 failing
                           │
                           │1)    management
                           │       
                           │         index pattern empty view
                           │           shows empty views:
                           │
                           │      Error: expected testSubject(createAnyway) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │2)    management
                           │       
                           │         index pattern empty view
                           │           "after all" hook for "doesn't show read-only badge":
                           │
                           │      Error: [index_not_found_exception] no such index [logstash-a], with { index="logstash-a" & resource.id="logstash-a" & resource.type="index_or_alias" & index_uuid="_na_" }
                           │       at respond (node_modules/elasticsearch/src/lib/transport.js:349:15)
                           │       at checkRespForFailure (node_modules/elasticsearch/src/lib/transport.js:306:7)
                           │       at HttpConnector.<anonymous> (node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
                           │       at IncomingMessage.wrapper (node_modules/lodash/lodash.js:4949:19)
                           │       at endReadableNT (_stream_readable.js:1145:12)
                           │       at process._tickCallback (internal/process/next_tick.js:63:19)
                           │ 
                           │ 
                           │3)    management
                           │       
                           │         index pattern filter
                           │           should filter indexed fields:
                           │
                           │      TimeoutError: Waiting for element to be located By(xpath, //a[descendant::*[text()='logstash-*']])
                           │ Wait timed out after 10018ms
                           │       at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │ 
                           │ 
                           │4)    management
                           │       
                           │         index pattern filter
                           │           "after each" hook for "should filter indexed fields":
                           │
                           │      retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="deleteIndexPatternButton"])
                           │ Wait timed out after 10013ms
                           │     at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="deleteIndexPatternButton"])
                           │   Wait timed out after 10013ms
                           │       at /home/avillk/repos/OpenSearch-Dashboards/node_modules/selenium-webdriver/lib/webdriver.js:842:17
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │5)    management
                           │       
                           │         test large number of fields
                           │           "before all" hook for "test_huge data should have expected number of fields":
                           │
                           │      retry.try timeout: Error: Index pattern not created
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/settings_page.ts:362:17)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │   Error: retry.try timeout: Error: Index pattern not created
                           │       at retry.try (test/functional/page_objects/settings_page.ts:362:17)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │6)    visualize app
                           │       
                           │         visual builder
                           │           switch index patterns
                           │             should be able to switch between index patterns:
                           │
                           │      Error: Timeout of 360000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/avillk/repos/OpenSearch-Dashboards/test/functional/apps/visualize/_tsvb_chart.ts)
                           │   
                           │ 
                           │ 
                           │7)    visualize app
                           │       
                           │         visual builder
                           │           "before each" hook for "should activate previous/next chart tab and panel config":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │8)    visualize app
                           │       
                           │         visual builder
                           │           "before each" hook for "should render all necessary components":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │9)    visualize app
                           │       
                           │         visual builder
                           │           markdown
                           │             "before all" hook for "should render subtabs and table variables markdown components":
                           │
                           │      Error: TSVB Time Series tab is not loaded
                           │       at VisualBuilderPage.checkTabIsLoaded (test/functional/page_objects/visual_builder_page.ts:79:15)
                           │ 
                           │ 
                           │10)    visualize app
                           │       
                           │         visual builder
                           │           table
                           │             "before each" hook for "should display correct values on changing group by field and column name":
                           │
                           │      Error: TSVB Time Series tab is not loaded
                           │       at VisualBuilderPage.checkTabIsLoaded (test/functional/page_objects/visual_builder_page.ts:79:15)
                           │ 
                           │ 
                           │11)    visualize app
                           │       
                           │         vega chart in visualize app
                           │           "before all" hook in "vega chart in visualize app":
                           │
                           │      retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │     at retry.try (/home/avillk/repos/OpenSearch-Dashboards/test/functional/page_objects/common_page.ts:280:19)
                           │     at process._tickCallback (internal/process/next_tick.js:68:7)
                           │     at onFailure (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:41:9)
                           │     at retryForSuccess (/home/avillk/repos/OpenSearch-Dashboards/test/common/services/retry/retry_for_success.ts:81:13)
                           │   Error: retry.tryForTime timeout: Error: retry.try timeout: Error: App failed to load: visualize in 10000ms appUrl=http://localhost:5620/app/visualize#/ currentUrl=http://localhost:5620/app/management/opensearch-dashboards/indexPatterns?bannerMessage=To%20visualize%20and%20explore%20data%20in%20OpenSearch%20Dashboards%2C%20you%20must%20create%20an%20index%20pattern%20to%20retrieve%20data%20from%20OpenSearch.
                           │       at retry.try (test/functional/page_objects/common_page.ts:280:19)
                           │       at process._tickCallback (internal/process/next_tick.js:68:7)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │       at onFailure (test/common/services/retry/retry_for_success.ts:41:9)
                           │       at retryForSuccess (test/common/services/retry/retry_for_success.ts:81:13)
                           │ 
                           │ 
                           │
                           │ proc [opensearch-dashboards] �[37m  log  �[39m [00:48:49.284] [�[32minfo�[39m][plugins-system] Stopping all plugins.
                           │ info [opensearch-dashboards] exited with null after 4 hours
                           │ info [o.o.n.Node] [ip-172-31-36-223] stopping ...
                           │ info [o.o.n.Node] [ip-172-31-36-223] stopped
                           │ info [o.o.n.Node] [ip-172-31-36-223] closing ...
                           │ info [o.o.n.Node] [ip-172-31-36-223] closed
                           │ info [opensearch] stopped
                           │ info [opensearch] cleanup complete

11 functional test failures

[kavilla]

1)    management
                           │       
                           │         index pattern empty view
                           │           shows empty views:
                           │
                           │      Error: expected testSubject(createAnyway) to exist
                           │       at TestSubjects.existOrFail (test/functional/services/common/test_subjects.ts:75:15)
                           │ 
                           │ 
                           │2)    management
                           │       
                           │         index pattern empty view
                           │           "after all" hook for "doesn't show read-only badge":
                           │
                           │      Error: [index_not_found_exception] no such index [logstash-a], with { index="logstash-a" & resource.id="logstash-a" & resource.type="index_or_alias" & index_uuid="_na_" }
                           │       at respond (node_modules/elasticsearch/src/lib/transport.js:349:15)
                           │       at checkRespForFailure (node_modules/elasticsearch/src/lib/transport.js:306:7)
                           │       at HttpConnector.<anonymous> (node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
                           │       at IncomingMessage.wrapper (node_modules/lodash/lodash.js:4949:19)
                           │       at endReadableNT (_stream_readable.js:1145:12)
                           │       at process._tickCallback (internal/process/next_tick.js:63:19)

When I run all the groups I get two indices long_window_logstash and shakespeare. In the test it tells you to delete any non-system indices and so once I update this test to specifically remove these indices it works everytime in isolation. Upstream, they have modified the code to completely restart the application to be in a fresh state. Which I recommend us doing but for now I think once it’s in a pipeline in will be ran in isolation anyways so it might be fine so taking note here.