[Enterprise Search] Added a test helper for Kea tests #100134

JasonStoltz · 2021-05-14T15:47:12Z

Summary

This PR adds a test helper to help with test assertions in Kea.

I think I've covered just about every edge case we'd have to consider. I could have missed something though, I only applied this to a subset of tests. If we like this, I'll go through and convert the rest of our tests.

In my opinion, this establishes a clear, repeatable pattern for testing Kea actions.

Pros:

You no longer have to call mount with default values explicitly.
You no longer have to pass DEFAULT_VALUES around and spread them.
Having the from and to state immediately beside each other makes scanning tests a bit easier.

Cons:

All of the typical cons of an abstraction, complexity in the implementation, less clear how to handle edge cases, less knowledge of the lower-level mechanics.

Examples

Typical

A regular action test assertion. expectAction will automatically mount the logic file for you with the values specified in from as the default values. It will assert that the values in to have changed.

It will assert that ONLY those values have changed, so if values other than that have changed, then you will have an assertion error.

      const { expectAction } = new LogicMounter(SearchUILogic);

      it('sets initial field values fetched from API call and sets dataLoading to false', () => {
        expectAction(() => {
          SearchUILogic.actions.onFieldDataLoaded({
            validFields: ['foo'],
            validSortFields: ['bar'],
            validFacetFields: ['baz'],
          });
        }).toChangeState({
          from: {
            dataLoading: true,
            validFields: [],
            validSortFields: [],
            validFacetFields: [],
          },
          to: {
            dataLoading: false,
            validFields: ['foo'],
            validSortFields: ['bar'],
            validFacetFields: ['baz'],
          },
        });
      });

Ignore

By specifying a field name in ignore, we can effectively say "We know this value may change, but it's not relevant to this test so just ignore it". Mostly useful for selectors.

      it('should remove all settings that have been set for each field', () => {
        expectAction(() => {
          ResultSettingsLogic.actions.clearAllFields();
        }).toChangeState({
          from: {
            resultFields: {
              quuz: { raw: false, snippet: false, snippetFallback: false },
              corge: { raw: true, snippet: false, snippetFallback: true },
            },
          },
          to: {
            resultFields: {
              quuz: {},
              corge: {},
            },
          },
          ignore: ['someSelector'],
        });
      });

Keyed logic

The second param of expectAction is props which will be used to mount the logic, which is required for keyed logics.

You can also get reference to the logic instance as it is passed in the callback as the first and only param to the expectAction callback.

      it('edits the value at the specified array index', () => {
        expectAction((logic) => {
          logic.actions.editValue(2, 'z');
        }, DEFAULT_PROPS).toChangeState({
          from: {
            values: ['a', 'b', 'c'],
          },
          to: {
            values: ['a', 'b', 'z'],
          },
        });
      });

Connected logic values

In a situation where a logic uses a connected logic, and you want to default some values...

// schema_logic.ts
export const SchemaLogic = kea<MakeLogicType<SchemaValues, SchemaActions>>({
  path: ['enterprise_search', 'app_search', 'schema_logic'],
  connect: {
    values: [SchemaBaseLogic, ['dataLoading', 'schema']],
    actions: [SchemaBaseLogic, ['loadSchema', 'onSchemaLoad', 'setSchema']],
  }, 
  ....

// schema_logic_test.ts
mount({
  schema: {
    foo: 'text'
  }
})

In the example above, we couldn't previously pass schema to mount to default value. I've added support for that in this PR. It is actually an independent change from the test helper.

Checklist

Delete any items that are not applicable to this PR.

Unit or functional tests were updated or added to match the most common scenarios

For maintainers

This was checked for breaking API changes and was labeled appropriately

JasonStoltz · 2021-05-17T14:40:13Z

@elasticmachine merge upstream

JasonStoltz · 2021-05-24T13:49:02Z

@elasticmachine merge upstream

kibanamachine · 2021-05-24T15:33:01Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 2a6aded
Storybooks Preview
Flaky suites:
- xpack-accessibility

Test Failures

Kibana Pipeline / general / X-Pack Accessibility Tests.x-pack/test/accessibility/apps/ml·ts.ml for user with full ML access with data loaded anomaly detection create single metric job pick fields step

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://github.com/elastic/kibana/issues/100430

[00:00:00]       │
[00:05:10]         └-: ml
[00:05:10]           └-> "before all" hook in "ml"
[00:05:10]           └-> "before all" hook in "ml"
[00:05:10]             │ debg creating role ft_ml_source
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_ml_source]
[00:05:10]             │ debg creating role ft_ml_source_readonly
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_ml_source_readonly]
[00:05:10]             │ debg creating role ft_ml_dest
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_ml_dest]
[00:05:10]             │ debg creating role ft_ml_dest_readonly
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_ml_dest_readonly]
[00:05:10]             │ debg creating role ft_ml_ui_extras
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_ml_ui_extras]
[00:05:10]             │ debg creating role ft_default_space_ml_all
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_default_space_ml_all]
[00:05:10]             │ debg creating role ft_default_space1_ml_all
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_default_space1_ml_all]
[00:05:10]             │ debg creating role ft_all_spaces_ml_all
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_all_spaces_ml_all]
[00:05:10]             │ debg creating role ft_default_space_ml_read
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_default_space_ml_read]
[00:05:10]             │ debg creating role ft_default_space1_ml_read
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_default_space1_ml_read]
[00:05:10]             │ debg creating role ft_all_spaces_ml_read
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_all_spaces_ml_read]
[00:05:10]             │ debg creating role ft_default_space_ml_none
[00:05:10]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added role [ft_default_space_ml_none]
[00:05:10]             │ debg creating user ft_ml_poweruser
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_poweruser]
[00:05:11]             │ debg created user ft_ml_poweruser
[00:05:11]             │ debg creating user ft_ml_poweruser_spaces
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_poweruser_spaces]
[00:05:11]             │ debg created user ft_ml_poweruser_spaces
[00:05:11]             │ debg creating user ft_ml_poweruser_space1
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_poweruser_space1]
[00:05:11]             │ debg created user ft_ml_poweruser_space1
[00:05:11]             │ debg creating user ft_ml_poweruser_all_spaces
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_poweruser_all_spaces]
[00:05:11]             │ debg created user ft_ml_poweruser_all_spaces
[00:05:11]             │ debg creating user ft_ml_viewer
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_viewer]
[00:05:11]             │ debg created user ft_ml_viewer
[00:05:11]             │ debg creating user ft_ml_viewer_spaces
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_viewer_spaces]
[00:05:11]             │ debg created user ft_ml_viewer_spaces
[00:05:11]             │ debg creating user ft_ml_viewer_space1
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_viewer_space1]
[00:05:11]             │ debg created user ft_ml_viewer_space1
[00:05:11]             │ debg creating user ft_ml_viewer_all_spaces
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_viewer_all_spaces]
[00:05:11]             │ debg created user ft_ml_viewer_all_spaces
[00:05:11]             │ debg creating user ft_ml_unauthorized
[00:05:11]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_unauthorized]
[00:05:11]             │ debg created user ft_ml_unauthorized
[00:05:11]             │ debg creating user ft_ml_unauthorized_spaces
[00:05:12]             │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] added user [ft_ml_unauthorized_spaces]
[00:05:12]             │ debg created user ft_ml_unauthorized_spaces
[00:05:12]           └-: for user with full ML access
[00:05:12]             └-> "before all" hook in "for user with full ML access"
[00:05:12]             └-> "before all" hook in "for user with full ML access"
[00:05:12]               │ debg SecurityPage.forceLogout
[00:05:12]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=100
[00:05:12]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:05:12]               │ debg Redirecting to /logout to force the logout
[00:05:12]               │ debg Waiting on the login form to appear
[00:05:12]               │ debg Waiting for Login Page to appear.
[00:05:12]               │ debg Waiting up to 100000ms for login page...
[00:05:12]               │ debg browser[INFO] http://localhost:61181/logout?_t=1621866015452 340 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:05:12]               │
[00:05:12]               │ debg browser[INFO] http://localhost:61181/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:05:12]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:05:15]               │ERROR browser[SEVERE] http://localhost:61181/api/alerts/list_alert_types - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:05:15]               │ debg browser[INFO] http://localhost:61181/43011/bundles/core/core.entry.js 12:151862 "Detected an unhandled Promise rejection.
[00:05:15]               │      Error: Unauthorized"
[00:05:15]               │ERROR browser[SEVERE] http://localhost:61181/43011/bundles/core/core.entry.js 5:2514 
[00:05:15]               │ debg browser[INFO] http://localhost:61181/login?msg=LOGGED_OUT 340 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:05:15]               │
[00:05:15]               │ debg browser[INFO] http://localhost:61181/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:05:15]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:05:15]               │ERROR browser[SEVERE] http://localhost:61181/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:05:16]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:05:16]               │ debg TestSubjects.exists(loginForm)
[00:05:16]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:05:16]               │ debg Waiting for Login Form to appear.
[00:05:16]               │ debg Waiting up to 100000ms for login form...
[00:05:16]               │ debg TestSubjects.exists(loginForm)
[00:05:16]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:05:16]               │ debg TestSubjects.setValue(loginUsername, ft_ml_poweruser)
[00:05:16]               │ debg TestSubjects.click(loginUsername)
[00:05:16]               │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:05:16]               │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:05:17]               │ debg TestSubjects.setValue(loginPassword, mlp001)
[00:05:17]               │ debg TestSubjects.click(loginPassword)
[00:05:17]               │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:05:17]               │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:05:17]               │ debg TestSubjects.click(loginSubmit)
[00:05:17]               │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:05:17]               │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:05:17]               │ debg Waiting for login result, expected: chrome.
[00:05:17]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"] .kbnAppWrapper:not(.kbnAppWrapper--hiddenChrome)') with timeout=20000
[00:05:17]               │ proc [kibana]   log   [14:20:19.999] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:05:21]               │ debg browser[INFO] http://localhost:61181/app/home 340 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:05:21]               │
[00:05:21]               │ debg browser[INFO] http://localhost:61181/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:05:21]               │ debg Finished login process currentUrl = http://localhost:61181/app/home#/
[00:05:21]               │ debg Waiting up to 20000ms for logout button visible...
[00:05:21]               │ debg TestSubjects.exists(userMenuButton)
[00:05:21]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenuButton"]') with timeout=2500
[00:05:21]               │ debg TestSubjects.exists(userMenu)
[00:05:21]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=2500
[00:05:21]               │ERROR browser[SEVERE] http://localhost:61181/api/fleet/epm/packages?experimental=true - Failed to load resource: the server responded with a status of 403 (Forbidden)
[00:05:24]               │ debg --- retry.tryForTime error: [data-test-subj="userMenu"] is not displayed
[00:05:24]               │ debg TestSubjects.click(userMenuButton)
[00:05:24]               │ debg Find.clickByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:05:24]               │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:05:24]               │ debg TestSubjects.exists(userMenu)
[00:05:24]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=120000
[00:05:24]               │ debg TestSubjects.exists(userMenu > logoutLink)
[00:05:24]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"] [data-test-subj="logoutLink"]') with timeout=2500
[00:05:24]               │ debg No indices to delete [pattern=.ml-*]
[00:05:31]             └-: with data loaded
[00:05:31]               └-> "before all" hook for "overview page"
[00:05:31]               └-> "before all" hook for "overview page"
[00:05:31]                 │ info [ml/farequote] Loading "mappings.json"
[00:05:31]                 │ info [ml/farequote] Loading "data.json.gz"
[00:05:31]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [ft_farequote] creating index, cause [api], templates [], shards [1]/[1]
[00:05:31]                 │ info [ml/farequote] Created index "ft_farequote"
[00:05:31]                 │ debg [ml/farequote] "ft_farequote" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:05:38]                 │ info [ml/farequote] Indexed 86274 docs into "ft_farequote"
[00:05:38]                 │ info [ml/ihp_outlier] Loading "mappings.json"
[00:05:38]                 │ info [ml/ihp_outlier] Loading "data.json.gz"
[00:05:38]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [ft_ihp_outlier] creating index, cause [api], templates [], shards [1]/[1]
[00:05:38]                 │ info [ml/ihp_outlier] Created index "ft_ihp_outlier"
[00:05:38]                 │ debg [ml/ihp_outlier] "ft_ihp_outlier" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:05:38]                 │ info [ml/ihp_outlier] Indexed 1460 docs into "ft_ihp_outlier"
[00:05:38]                 │ info [ml/module_sample_ecommerce] Loading "mappings.json"
[00:05:38]                 │ info [ml/module_sample_ecommerce] Loading "data.json.gz"
[00:05:38]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [ft_module_sample_ecommerce] creating index, cause [api], templates [], shards [1]/[1]
[00:05:38]                 │ info [ml/module_sample_ecommerce] Created index "ft_module_sample_ecommerce"
[00:05:38]                 │ debg [ml/module_sample_ecommerce] "ft_module_sample_ecommerce" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:05:38]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [ft_module_sample_ecommerce/4TWjTYisTQKqXoRGd_xOYw] update_mapping [_doc]
[00:05:38]                 │ info [ml/module_sample_ecommerce] Indexed 287 docs into "ft_module_sample_ecommerce"
[00:05:38]                 │ debg Searching for 'index-pattern' with title 'ft_farequote'...
[00:05:38]                 │ debg  > Not found
[00:05:38]                 │ debg Creating index pattern with title 'ft_farequote' and time field '@timestamp'
[00:05:39]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.kibana_8.0.0_001/Ick-z0iFT8WV0YF8ljOXtQ] update_mapping [_doc]
[00:05:39]                 │ debg Waiting up to 5000ms for index-pattern with title 'ft_farequote' to exist...
[00:05:39]                 │ debg Searching for 'index-pattern' with title 'ft_farequote'...
[00:05:39]                 │ debg  > Found '38624850-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:39]                 │ debg  > Created with id '38624850-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:39]                 │ debg Searching for 'index-pattern' with title 'ft_ihp_outlier'...
[00:05:39]                 │ debg  > Not found
[00:05:39]                 │ debg Creating index pattern with title 'ft_ihp_outlier' and time field '@timestamp'
[00:05:40]                 │ debg Waiting up to 5000ms for index-pattern with title 'ft_ihp_outlier' to exist...
[00:05:40]                 │ debg Searching for 'index-pattern' with title 'ft_ihp_outlier'...
[00:05:40]                 │ debg  > Found '38ad5b10-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:40]                 │ debg  > Created with id '38ad5b10-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:40]                 │ debg Searching for 'index-pattern' with title 'ft_module_sample_ecommerce'...
[00:05:40]                 │ debg  > Not found
[00:05:40]                 │ debg Creating index pattern with title 'ft_module_sample_ecommerce' and time field 'order_date'
[00:05:41]                 │ debg Waiting up to 5000ms for index-pattern with title 'ft_module_sample_ecommerce' to exist...
[00:05:41]                 │ debg Searching for 'index-pattern' with title 'ft_module_sample_ecommerce'...
[00:05:41]                 │ debg  > Found '3945a370-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:41]                 │ debg  > Created with id '3945a370-bc9b-11eb-9db8-5b9f7371eb09'
[00:05:41]                 │ debg applying update to kibana config: {"dateFormat:tz":"UTC"}
[00:05:42]                 │ debg Creating anomaly detection job with id 'fq_single_a11y' ...
[00:05:42]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-anomalies-shared] creating index, cause [api], templates [.ml-anomalies-], shards [1]/[1]
[00:05:42]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-anomalies-shared]
[00:05:42]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-annotations-6] creating index, cause [api], templates [], shards [1]/[1]
[00:05:42]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-annotations-6]
[00:05:42]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-anomalies-shared/ehfVcTUCQk6nAsBkKVw8Vg] update_mapping [_doc]
[00:05:42]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-config] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:05:42]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-config]
[00:05:42]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-notifications-000001] creating index, cause [auto(bulk api)], templates [.ml-notifications-000001], shards [1]/[1]
[00:05:42]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-notifications-000001]
[00:05:42]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.kibana_8.0.0_001/Ick-z0iFT8WV0YF8ljOXtQ] update_mapping [_doc]
[00:05:43]                 │ debg Waiting up to 5000ms for 'fq_single_a11y' to exist...
[00:05:43]                 │ debg > AD job created.
[00:05:43]                 │ debg Creating datafeed with id 'datafeed-fq_single_a11y' ...
[00:05:44]                 │ debg Waiting up to 5000ms for 'datafeed-fq_single_a11y' to exist...
[00:05:44]                 │ debg > Datafeed created.
[00:05:44]                 │ debg Opening anomaly detection job 'fq_single_a11y'...
[00:05:44]                 │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] Opening job [fq_single_a11y]
[00:05:44]                 │ info [o.e.x.c.m.u.MlIndexAndAlias] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] About to create first concrete index [.ml-state-000001] with alias [.ml-state-write]
[00:05:44]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-state-000001] creating index, cause [api], templates [.ml-state], shards [1]/[1]
[00:05:44]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-state-000001]
[00:05:44]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-state-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ml-size-based-ilm-policy]
[00:05:44]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-state-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ml-size-based-ilm-policy]
[00:05:44]                 │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] Loading model snapshot [N/A], job latest_record_timestamp [N/A]
[00:05:44]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-state-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ml-size-based-ilm-policy]
[00:05:45]                 │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] [autodetect/139934] [CResourceMonitor.cc@77] Setting model memory limit to 20 MB
[00:05:45]                 │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] Successfully set job state to [opened] for job [fq_single_a11y]
[00:05:45]                 │ debg > AD job opened.
[00:05:45]                 │ debg Starting datafeed 'datafeed-fq_single_a11y' with start: '0', end: '1621866047808'...
[00:05:45]                 │ debg > Datafeed started.
[00:05:45]                 │ debg Waiting up to 120000ms for datafeed state to be stopped...
[00:05:45]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:45]                 │ info [o.e.x.m.d.DatafeedJob] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] Datafeed started (from: 1970-01-01T00:00:00.000Z to: 2021-05-24T14:20:47.808Z) with frequency [600000ms]
[00:05:45]                 │ debg --- retry.waitForWithTimeout error: expected job state to be stopped but got started
[00:05:45]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-anomalies-shared/ehfVcTUCQk6nAsBkKVw8Vg] update_mapping [_doc]
[00:05:45]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:45]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:46]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 10000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:46]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:46]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:46]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:46]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:47]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:47]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:47]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 20000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:47]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:47]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:48]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:48]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:48]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 30000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:48]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:48]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:49]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 40000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:49]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:49]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:49]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:49]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:50]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 50000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:50]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:50]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:50]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:50]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:51]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 60000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:51]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:51]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:51]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:52]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:52]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 70000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:52]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:52]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:53]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:53]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:53]                 │ info [o.e.x.m.j.p.DataCountsReporter] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 80000 records written to autodetect; missingFieldCount=0, invalidDateCount=0, outOfOrderCount=0
[00:05:53]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:53]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:54]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:54]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:54]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:54]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:55]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:55]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:55]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:55]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:55]                 │ info [o.e.x.m.d.DatafeedJob] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] Lookback has finished
[00:05:55]                 │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [no_realtime] attempt to stop datafeed [datafeed-fq_single_a11y] for job [fq_single_a11y]
[00:05:55]                 │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [no_realtime] try lock [20s] to stop datafeed [datafeed-fq_single_a11y] for job [fq_single_a11y]...
[00:05:55]                 │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [no_realtime] stopping datafeed [datafeed-fq_single_a11y] for job [fq_single_a11y], acquired [true]...
[00:05:55]                 │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [no_realtime] datafeed [datafeed-fq_single_a11y] for job [fq_single_a11y] has been stopped
[00:05:55]                 │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] Closing job [fq_single_a11y], because [close job (api)]
[00:05:55]                 │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] [autodetect/139934] [CCmdSkeleton.cc@61] Handled 86274 records
[00:05:55]                 │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] [autodetect/139934] [CAnomalyJob.cc@1578] Pruning all models
[00:05:55]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-anomalies-shared/ehfVcTUCQk6nAsBkKVw8Vg] update_mapping [_doc]
[00:05:55]                 │ info [o.e.x.m.p.AbstractNativeProcess] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] State output finished
[00:05:56]                 │ info [o.e.x.m.j.p.a.o.AutodetectResultProcessor] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] 120 buckets parsed from autodetect output
[00:05:56]                 │ debg Fetching datafeed state for datafeed datafeed-fq_single_a11y
[00:05:56]                 │ debg Waiting up to 120000ms for job state to be closed...
[00:05:56]                 │ debg Fetching anomaly detection job stats for job fq_single_a11y...
[00:05:56]                 │ debg > AD job stats fetched.
[00:05:56]                 │ debg --- retry.waitForWithTimeout error: expected job state to be closed but got closing
[00:05:56]                 │ debg Fetching anomaly detection job stats for job fq_single_a11y...
[00:05:56]                 │ debg > AD job stats fetched.
[00:05:56]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:57]                 │ debg Fetching anomaly detection job stats for job fq_single_a11y...
[00:05:57]                 │ debg > AD job stats fetched.
[00:05:57]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:57]                 │ info [o.e.x.m.j.p.a.AutodetectCommunicator] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [fq_single_a11y] job closed
[00:05:57]                 │ debg Fetching anomaly detection job stats for job fq_single_a11y...
[00:05:57]                 │ debg > AD job stats fetched.
[00:05:57]                 │ debg Creating data frame analytic job with id 'iph_outlier_a11y' ...
[00:05:58]                 │ debg Waiting up to 5000ms for 'iph_outlier_a11y' to exist...
[00:05:58]                 │ debg Fetching data frame analytics job 'iph_outlier_a11y'...
[00:05:58]                 │ debg > DFA job fetched.
[00:05:58]                 │ debg > DFA job created.
[00:05:58]                 │ debg Starting data frame analytics job 'iph_outlier_a11y'...
[00:05:58]                 │ info [o.e.x.m.a.TransportStartDataFrameAnalyticsAction] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Starting data frame analytics from state [stopped]
[00:05:59]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-inference-000003] creating index, cause [api], templates [], shards [1]/[1]
[00:05:59]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-inference-000003]
[00:05:59]                 │ debg > DFA job started.
[00:05:59]                 │ debg Waiting up to 60000ms for 'iph_outlier_a11y' to have training_docs_count > 0...
[00:05:59]                 │ debg Fetching data frame analytics job stats for job iph_outlier_a11y...
[00:05:59]                 │ info [o.e.x.c.m.u.MlIndexAndAlias] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] About to create first concrete index [.ml-stats-000001] with alias [.ml-stats-write]
[00:05:59]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-stats-000001] creating index, cause [api], templates [.ml-stats], shards [1]/[1]
[00:05:59]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-stats-000001]
[00:05:59]                 │ debg > DFA job stats fetched.
[00:05:59]                 │ debg --- retry.waitForWithTimeout error: expected data frame analytics job 'iph_outlier_a11y' to have training_docs_count > 0 (got 0)
[00:05:59]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-stats-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ml-size-based-ilm-policy]
[00:05:59]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-stats-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ml-size-based-ilm-policy]
[00:05:59]                 │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Creating destination index [user-iph_outlier_a11y]
[00:05:59]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [user-iph_outlier_a11y] creating index, cause [api], templates [], shards [1]/[1]
[00:05:59]                 │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Started reindexing
[00:05:59]                 │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] moving index [.ml-stats-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ml-size-based-ilm-policy]
[00:05:59]                 │ debg Fetching data frame analytics job stats for job iph_outlier_a11y...
[00:05:59]                 │ debg > DFA job stats fetched.
[00:05:59]                 │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:05:59]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Started loading data
[00:05:59]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Started analyzing
[00:05:59]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Waiting for result processor to complete
[00:06:00]                 │ debg Fetching data frame analytics job stats for job iph_outlier_a11y...
[00:06:00]                 │ info [o.e.x.m.d.p.AnalyticsResultProcessor] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Started writing results
[00:06:00]                 │ debg > DFA job stats fetched.
[00:06:00]                 │ debg Waiting up to 120000ms for analytics state to be stopped...
[00:06:00]                 │ debg Fetching analytics state for job iph_outlier_a11y
[00:06:00]                 │ debg Fetching data frame analytics job stats for job iph_outlier_a11y...
[00:06:00]                 │ debg > DFA job stats fetched.
[00:06:00]                 │ debg --- retry.waitForWithTimeout error: expected analytics state to be stopped but got started
[00:06:00]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Result processor has completed
[00:06:00]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Closing process
[00:06:00]                 │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] [data_frame_analyzer/140979] [Main.cc@241] [{"name":"E_DFOEstimatedPeakMemoryUsage","description":"The upfront estimate of the peak memory outlier detection would use","value":962304}
[00:06:00]                 │      ,{"name":"E_DFOPeakMemoryUsage","description":"The peak memory outlier detection used","value":639352}
[00:06:00]                 │      ,{"name":"E_DFOTimeToCreateEnsemble","description":"The time it took to create the ensemble used for outlier detection","value":29}
[00:06:00]                 │      ,{"name":"E_DFOTimeToComputeScores","description":"The time it took to compute outlier scores","value":118}
[00:06:00]                 │      ,{"name":"E_DFONumberPartitions","description":"The number of partitions outlier detection used","value":1}
[00:06:00]                 │      ]
[00:06:00]                 │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Closed process
[00:06:00]                 │ info [o.e.x.m.d.DataFrameAnalyticsManager] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [iph_outlier_a11y] Marking task completed
[00:06:00]                 │ debg Fetching analytics state for job iph_outlier_a11y
[00:06:00]                 │ debg Fetching data frame analytics job stats for job iph_outlier_a11y...
[00:06:00]                 │ debg > DFA job stats fetched.
[00:06:00]                 │ debg Creating calendar with id 'calendar_a11y'...
[00:06:00]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] [.ml-meta] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:06:00]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-centos-tests-xxl-1621864183123109831] updating number_of_replicas to [0] for indices [.ml-meta]
[00:06:00]                 │ debg Waiting up to 5000ms for 'calendar_a11y' to exist...
[00:06:00]                 │ debg > Calendar created.
[00:06:00]                 │ debg Creating events for calendar with id 'calendar_a11y'...
[00:06:00]                 │ debg Waiting up to 5000ms for 'calendar_a11y' events to exist...
[00:06:00]                 │ debg > Calendar events created.
[00:06:00]                 │ debg Creating filter with id 'filter_a11y'...
[00:06:00]                 │ debg Waiting up to 5000ms for 'filter_a11y' to exist...
[00:06:00]                 │ debg > Filter created.
[00:06:00]               └-> overview page
[00:06:00]                 └-> "before each" hook: global before each for "overview page"
[00:06:00]                 │ debg navigating to ml url: http://localhost:61181/app/ml
[00:06:00]                 │ debg navigate to: http://localhost:61181/app/ml
[00:06:01]                 │ debg browser[INFO] http://localhost:61181/app/ml?_t=1621866063496 340 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:06:01]                 │
[00:06:01]                 │ debg browser[INFO] http://localhost:61181/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:06:01]                 │ debg ... sleep(700) start
[00:06:01]                 │ debg ... sleep(700) end
[00:06:01]                 │ debg returned from get, calling refresh
[00:06:02]                 │ERROR browser[SEVERE] http://localhost:61181/43011/bundles/core/core.entry.js 12:150934 TypeError: Failed to fetch
[00:06:02]                 │          at fetch_Fetch.fetchResponse (http://localhost:61181/43011/bundles/core/core.entry.js:6:26193)
[00:06:02]                 │          at async http://localhost:61181/43011/bundles/core/core.entry.js:6:24090
[00:06:02]                 │          at async http://localhost:61181/43011/bundles/core/core.entry.js:6:23996
[00:06:02]                 │ debg browser[INFO] http://localhost:61181/app/ml?_t=1621866063496 340 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:06:02]                 │
[00:06:02]                 │ debg browser[INFO] http://localhost:61181/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:06:02]                 │ debg currentUrl = http://localhost:61181/app/ml
[00:06:02]                 │          appUrl = http://localhost:61181/app/ml
[00:06:02]                 │ debg TestSubjects.find(kibanaChrome)
[00:06:02]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:06:03]                 │ debg ... sleep(501) start
[00:06:04]                 │ERROR browser[SEVERE] http://localhost:61181/api/fleet/epm/packages?experimental=true - Failed to load resource: the server responded with a status of 403 (Forbidden)
[00:06:04]                 │ debg ... sleep(501) end
[00:06:04]                 │ debg in navigateTo url = http://localhost:61181/app/ml/overview
[00:06:04]                 │ debg --- retry.tryForTime error: URL changed, waiting for it to settle
[00:06:04]                 │ debg ... sleep(501) start
[00:06:05]                 │ debg ... sleep(501) end
[00:06:05]                 │ debg in navigateTo url = http://localhost:61181/app/ml/overview
[00:06:05]                 │ debg TestSubjects.exists(mlApp)
[00:06:05]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlApp"]') with timeout=2000
[00:06:05]                 │ debg TestSubjects.click(~mlMainTab & ~overview)
[00:06:05]                 │ debg Find.clickByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="overview"]') with timeout=10000
[00:06:05]                 │ debg Find.findByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="overview"]') with timeout=10000
[00:06:05]                 │ debg TestSubjects.exists(~mlMainTab & ~overview & ~selected)
[00:06:05]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="overview"][data-test-subj~="selected"]') with timeout=120000
[00:06:05]                 │ debg TestSubjects.exists(mlPageOverview)
[00:06:05]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageOverview"]') with timeout=120000
[00:06:06]                 └- ✓ pass  (5.4s) "ml for user with full ML access with data loaded overview page"
[00:06:06]               └-> anomaly detection jobs list page
[00:06:06]                 └-> "before each" hook: global before each for "anomaly detection jobs list page"
[00:06:06]                 │ debg TestSubjects.click(~mlMainTab & ~anomalyDetection)
[00:06:06]                 │ debg Find.clickByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="anomalyDetection"]') with timeout=10000
[00:06:06]                 │ debg Find.findByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="anomalyDetection"]') with timeout=10000
[00:06:06]                 │ debg TestSubjects.exists(~mlMainTab & ~anomalyDetection & ~selected)
[00:06:06]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="anomalyDetection"][data-test-subj~="selected"]') with timeout=120000
[00:06:06]                 │ debg TestSubjects.exists(mlPageJobManagement)
[00:06:06]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageJobManagement"]') with timeout=120000
[00:06:06]                 └- ✓ pass  (789ms) "ml for user with full ML access with data loaded anomaly detection jobs list page"
[00:06:06]               └-> anomaly detection create job select index pattern page
[00:06:06]                 └-> "before each" hook: global before each for "anomaly detection create job select index pattern page"
[00:06:06]                 │ debg TestSubjects.clickWhenNotDisabled(mlCreateNewJobButton)
[00:06:06]                 │ debg Find.clickByCssSelectorWhenNotDisabled('[data-test-subj="mlCreateNewJobButton"]') with timeout=10000
[00:06:06]                 │ debg Find.findByCssSelector('[data-test-subj="mlCreateNewJobButton"]') with timeout=10000
[00:06:07]                 │ debg TestSubjects.exists(mlPageSourceSelection)
[00:06:07]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageSourceSelection"]') with timeout=120000
[00:06:07]                 └- ✓ pass  (632ms) "ml for user with full ML access with data loaded anomaly detection create job select index pattern page"
[00:06:07]               └-> anomaly detection create job select type page
[00:06:07]                 └-> "before each" hook: global before each for "anomaly detection create job select type page"
[00:06:07]                 │ debg TestSubjects.setValue(savedObjectFinderSearchInput, ft_farequote)
[00:06:07]                 │ debg TestSubjects.click(savedObjectFinderSearchInput)
[00:06:07]                 │ debg Find.clickByCssSelector('[data-test-subj="savedObjectFinderSearchInput"]') with timeout=10000
[00:06:07]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectFinderSearchInput"]') with timeout=10000
[00:06:07]                 │ debg TestSubjects.exists(savedObjectTitleft_farequote)
[00:06:07]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="savedObjectTitleft_farequote"]') with timeout=120000
[00:06:07]                 │ debg TestSubjects.clickWhenNotDisabled(savedObjectTitleft_farequote)
[00:06:07]                 │ debg Find.clickByCssSelectorWhenNotDisabled('[data-test-subj="savedObjectTitleft_farequote"]') with timeout=10000
[00:06:07]                 │ debg Find.findByCssSelector('[data-test-subj="savedObjectTitleft_farequote"]') with timeout=10000
[00:06:08]                 │ debg TestSubjects.exists(mlPageJobTypeSelection)
[00:06:08]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageJobTypeSelection"]') with timeout=10000
[00:06:08]                 └- ✓ pass  (1.3s) "ml for user with full ML access with data loaded anomaly detection create job select type page"
[00:06:08]               └-> anomaly detection create single metric job time range step
[00:06:08]                 └-> "before each" hook: global before each for "anomaly detection create single metric job time range step"
[00:06:08]                 │ debg TestSubjects.clickWhenNotDisabled(mlJobTypeLinkSingleMetricJob)
[00:06:08]                 │ debg Find.clickByCssSelectorWhenNotDisabled('[data-test-subj="mlJobTypeLinkSingleMetricJob"]') with timeout=10000
[00:06:08]                 │ debg Find.findByCssSelector('[data-test-subj="mlJobTypeLinkSingleMetricJob"]') with timeout=10000
[00:06:09]                 │ debg TestSubjects.exists(mlPageJobWizard single_metric)
[00:06:09]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageJobWizard single_metric"]') with timeout=120000
[00:06:09]                 │ERROR browser[SEVERE] http://localhost:61181/api/ml/jobs/new_job_caps/ft_farequote - Failed to load resource: net::ERR_NETWORK_CHANGED
[00:06:09]                 │ERROR browser[SEVERE] http://localhost:61181/43011/bundles/plugin/ml/8.0.0/ml.chunk.5.js 2:69111 "Unable to load new job capabilities" TypeError: Failed to fetch
[00:06:09]                 │          at fetch_Fetch.fetchResponse (http://localhost:61181/43011/bundles/core/core.entry.js:6:26193)
[00:06:09]                 │          at async http://localhost:61181/43011/bundles/core/core.entry.js:6:24090
[00:06:09]                 │          at async http://localhost:61181/43011/bundles/core/core.entry.js:6:23996
[00:06:09]                 │ debg === TEST STEP === job creation set the time range
[00:06:09]                 │ debg TestSubjects.clickWhenNotDisabled(mlButtonUseFullData)
[00:06:09]                 │ debg Find.clickByCssSelectorWhenNotDisabled('[data-test-subj="mlButtonUseFullData"]') with timeout=10000
[00:06:09]                 │ debg Find.findByCssSelector('[data-test-subj="mlButtonUseFullData"]') with timeout=10000
[00:06:10]                 │ debg TestSubjects.find(mlJobWizardDateRange)
[00:06:10]                 │ debg Find.findByCssSelector('[data-test-subj="mlJobWizardDateRange"]') with timeout=10000
[00:06:10]                 └- ✓ pass  (1.9s) "ml for user with full ML access with data loaded anomaly detection create single metric job time range step"
[00:06:10]               └-> anomaly detection create single metric job pick fields step
[00:06:10]                 └-> "before each" hook: global before each for "anomaly detection create single metric job pick fields step"
[00:06:10]                 │ debg TestSubjects.exists(mlJobWizardNavButtonNext)
[00:06:10]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlJobWizardNavButtonNext"]') with timeout=120000
[00:06:10]                 │ debg TestSubjects.clickWhenNotDisabled(mlJobWizardNavButtonNext)
[00:06:10]                 │ debg Find.clickByCssSelectorWhenNotDisabled('[data-test-subj="mlJobWizardNavButtonNext"]') with timeout=10000
[00:06:10]                 │ debg Find.findByCssSelector('[data-test-subj="mlJobWizardNavButtonNext"]') with timeout=10000
[00:06:11]                 │ debg TestSubjects.exists(mlJobWizardStepTitlePickFields)
[00:06:11]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlJobWizardStepTitlePickFields"]') with timeout=5000
[00:06:11]                 │ debg === TEST STEP === job creation selects field and aggregation
[00:06:11]                 │ debg comboBox.set, comboBoxSelector: mlJobWizardAggSelection > comboBoxInput
[00:06:11]                 │ debg TestSubjects.find(mlJobWizardAggSelection > comboBoxInput)
[00:06:11]                 │ debg Find.findByCssSelector('[data-test-subj="mlJobWizardAggSelection"] [data-test-subj="comboBoxInput"]') with timeout=10000
[00:06:11]                 │ debg comboBox.setElement, value: Mean(responsetime)
[00:06:11]                 │ debg comboBox.isOptionSelected, value: Mean(responsetime)
[00:06:13]                 │ debg TestSubjects.exists(~comboBoxOptionsList)
[00:06:13]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="comboBoxOptionsList"]') with timeout=2500
[00:06:13]                 │ debg Find.allByCssSelector('.euiFilterSelectItem[title^="Mean(responsetime)"]') with timeout=2500
[00:06:16]                 │ debg Find.findByCssSelector('.euiFilterSelectItem') with timeout=5000
[00:06:26]                 │ info Taking screenshot "/dev/shm/workspace/parallel/18/kibana/x-pack/test/functional/screenshots/failure/ml for user with full ML access with data loaded anomaly detection create single metric job pick fields step.png"
[00:06:26]                 │ info Current URL is: http://localhost:61181/app/ml/jobs/new_job/single_metric?index=38624850-bc9b-11eb-9db8-5b9f7371eb09
[00:06:26]                 │ info Saving page source to: /dev/shm/workspace/parallel/18/kibana/x-pack/test/functional/failure_debug/html/ml for user with full ML access with data loaded anomaly detection create single metric job pick fields step.html
[00:06:26]                 └- ✖ fail: ml for user with full ML access with data loaded anomaly detection create single metric job pick fields step
[00:06:26]                 │      TimeoutError: Waiting for element to be located By(css selector, .euiFilterSelectItem)
[00:06:26]                 │ Wait timed out after 10021ms
[00:06:26]                 │       at /dev/shm/workspace/parallel/18/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:06:26]                 │       at runMicrotasks (<anonymous>)
[00:06:26]                 │       at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:06:26]                 │ 
[00:06:26]                 │

Stack Trace

TimeoutError: Waiting for element to be located By(css selector, .euiFilterSelectItem)
Wait timed out after 10021ms
    at /dev/shm/workspace/parallel/18/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5) {
  remoteStacktrace: ''
}

Metrics [docs]

Unknown metric groups

References to deprecated APIs

id	before	after	diff
`canvas`	29	25	-4
`crossClusterReplication`	8	6	-2
`fleet`	22	20	-2
`globalSearch`	4	2	-2
`indexManagement`	12	7	-5
`infra`	261	149	-112
`lens`	67	45	-22
`licensing`	18	15	-3
`maps`	286	208	-78
`ml`	121	115	-6
`monitoring`	109	56	-53
`stackAlerts`	101	95	-6
total			-295

History

💚 Build #126246 succeeded d64c5d6
💔 Build #126104 failed d65d56c
💔 Build #126066 failed c346668
💔 Build #126057 failed c4e3006

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

JasonStoltz force-pushed the test-helper-3 branch from 77b4441 to ce7b2b1 Compare May 14, 2021 16:14

JasonStoltz changed the title ~~Test helper 3~~ [Enterprise Search] Added a test helper for Kea tests May 14, 2021

JasonStoltz added 4 commits May 14, 2021 13:15

Added a kea test helper

1b8954c

Handle connected values

49fe60a

Handle keyed logic

f084195

Ignore certain field changes

c346668

JasonStoltz force-pushed the test-helper-3 branch from c4e3006 to c346668 Compare May 14, 2021 17:15

JasonStoltz marked this pull request as ready for review May 14, 2021 17:25

JasonStoltz requested review from a team May 14, 2021 17:25

JasonStoltz added v7.14.0 auto-backport Deprecated - use backport:version if exact versions are needed release_note:skip Skip the PR/issue when compiling release notes labels May 14, 2021

Fix lint

d65d56c

kibanamachine and others added 2 commits May 17, 2021 10:40

Merge branch 'master' into test-helper-3

d70bd3d

Fix lint

d64c5d6

Merge branch 'master' into test-helper-3

2a6aded

cee-chen mentioned this pull request Jun 1, 2021

[Enterprise Search] Mocks/tests tech debt - avoid hungry mocking #101107

Merged

1 task

JasonStoltz closed this Jun 22, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Enterprise Search] Added a test helper for Kea tests #100134

[Enterprise Search] Added a test helper for Kea tests #100134

JasonStoltz commented May 14, 2021 •

edited

Loading

JasonStoltz commented May 17, 2021

JasonStoltz commented May 24, 2021

kibanamachine commented May 24, 2021

Standard Out

Stack Trace

References to deprecated APIs

[Enterprise Search] Added a test helper for Kea tests #100134

[Enterprise Search] Added a test helper for Kea tests #100134

Conversation

JasonStoltz commented May 14, 2021 • edited Loading

Summary

Examples

Checklist

For maintainers

JasonStoltz commented May 17, 2021

JasonStoltz commented May 24, 2021

kibanamachine commented May 24, 2021

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Metrics [docs]

References to deprecated APIs

History

JasonStoltz commented May 14, 2021 •

edited

Loading