Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack API Integration Tests - ml.x-pack/test/api_integration/apis/ml/trained_models/put_model·ts - Machine Learning trained models PUT trained_models puts trained model by id #189637

Closed
kibanamachine opened this issue Jul 31, 2024 · 5 comments · Fixed by #189697
Closed

Failing test: X-Pack API Integration Tests - ml.x-pack/test/api_integration/apis/ml/trained_models/put_model·ts - Machine Learning trained models PUT trained_models puts trained model by id #189637

kibanamachine opened this issue Jul 31, 2024 · 5 comments · Fixed by #189697
Assignees
@darnautov
Labels
failed-es-promotion failed-test A test failure on a tracked branch, potentially flaky-test :ml

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jul 31, 2024 •
edited
Loading

A test failed on a tracked branch

Error: expected { model_id: 'dfa_regression_model_n_0',
  created_by: 'api_user',
  version: '12.0.0',
  model_size_bytes: 304,
  estimated_operations: 1,
  license_level: 'platinum',
  tags: [],
  input: { field_names: [ 'common_field' ] },
  inference_config: 
   { regression: 
      { results_field: 'predicted_value',
        num_top_feature_importance_values: 0 } } } to sort of equal { model_id: 'dfa_regression_model_n_0',
  model_type: 'tree_ensemble',
  created_by: 'api_user',
  version: '12.0.0',
  model_size_bytes: 304,
  estimated_operations: 1,
  license_level: 'platinum',
  tags: [],
  input: { field_names: [ 'common_field' ] },
  inference_config: 
   { regression: 
      { results_field: 'predicted_value',
        num_top_feature_importance_values: 0 } } }
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context.<anonymous> (put_model.ts:40:55)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16) {
  actual: '{\n' +
    '  "created_by": "api_user"\n' +
    '  "estimated_operations": 1\n' +
    '  "inference_config": {\n' +
    '    "regression": {\n' +
    '      "num_top_feature_importance_values": 0\n' +
    '      "results_field": "predicted_value"\n' +
    '    }\n' +
    '  }\n' +
    '  "input": {\n' +
    '    "field_names": [\n' +
    '      "common_field"\n' +
    '    ]\n' +
    '  }\n' +
    '  "license_level": "platinum"\n' +
    '  "model_id": "dfa_regression_model_n_0"\n' +
    '  "model_size_bytes": 304\n' +
    '  "tags": []\n' +
    '  "version": "12.0.0"\n' +
    '}',
  expected: '{\n' +
    '  "created_by": "api_user"\n' +
    '  "estimated_operations": 1\n' +
    '  "inference_config": {\n' +
    '    "regression": {\n' +
    '      "num_top_feature_importance_values": 0\n' +
    '      "results_field": "predicted_value"\n' +
    '    }\n' +
    '  }\n' +
    '  "input": {\n' +
    '    "field_names": [\n' +
    '      "common_field"\n' +
    '    ]\n' +
    '  }\n' +
    '  "license_level": "platinum"\n' +
    '  "model_id": "dfa_regression_model_n_0"\n' +
    '  "model_size_bytes": 304\n' +
    '  "model_type": "tree_ensemble"\n' +
    '  "tags": []\n' +
    '  "version": "12.0.0"\n' +
    '}',
  showDiff: true
}

First failure: kibana-elasticsearch-snapshot-verify - 8.15
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jul 31, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 31, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 31, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - 8.15

@kibanamachine
Copy link
Contributor Author

New failure: kibana-elasticsearch-snapshot-verify - main

mistic added a commit that referenced this issue Jul 31, 2024
@mistic
skip flaky suite (#189637)
cdf5f5c
mistic added a commit that referenced this issue Jul 31, 2024
@mistic
skip flaky suite (#189637)
da9fc6f
@mistic
Copy link
Member

mistic commented Jul 31, 2024

Skipped.

main: cdf5f5c
8.15: da9fc6f

@darnautov darnautov mentioned this issue Aug 1, 2024
Merged
1 task
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Aug 14, 2024
@darnautov
[ML] Enable PUT trained model API integration tests (elastic#189697)
c7a0a30 
## Summary

Closes elastic#189637

### Checklist

- [x] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed

(cherry picked from commit 0e18fb3)
kibanamachine referenced this issue Aug 14, 2024
@kibanamachine @darnautov
[8.15] [ML] Enable PUT trained model API integration tests (#189697) (#…
715dcdc 
…190507)

# Backport

This will backport the following commits from `main` to `8.15`:
- [[ML] Enable PUT trained model API integration tests
(#189697)](#189697)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dima
Arnautov","email":"dmitrii.arnautov@elastic.co"},"sourceCommit":{"committedDate":"2024-08-14T11:54:19Z","message":"[ML]
Enable PUT trained model API integration tests (#189697)\n\n##
Summary\r\n\r\nCloses
https://github.com/elastic/kibana/issues/189637\r\n\r\n\r\n###
Checklist\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"0e18fb39f3f3f0aa51b553a16023e78434877cf7","branchLabelMapping":{"^v8.16.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","test_api","release_note:skip","Team:ML","v8.15.0","v8.16.0"],"title":"[ML]
Enable PUT trained model API integration tests
","number":189697,"url":"https://github.com/elastic/kibana/pull/189697","mergeCommit":{"message":"[ML]
Enable PUT trained model API integration tests (#189697)\n\n##
Summary\r\n\r\nCloses
https://github.com/elastic/kibana/issues/189637\r\n\r\n\r\n###
Checklist\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"0e18fb39f3f3f0aa51b553a16023e78434877cf7"}},"sourceBranch":"main","suggestedTargetBranches":["8.15"],"targetPullRequestStates":[{"branch":"8.15","label":"v8.15.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.16.0","branchLabelMappingKey":"^v8.16.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/189697","number":189697,"mergeCommit":{"message":"[ML]
Enable PUT trained model API integration tests (#189697)\n\n##
Summary\r\n\r\nCloses
https://github.com/elastic/kibana/issues/189637\r\n\r\n\r\n###
Checklist\r\n\r\n- [x] [Flaky
Test\r\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\r\nused on any tests
changed","sha":"0e18fb39f3f3f0aa51b553a16023e78434877cf7"}}]}]
BACKPORT-->

Co-authored-by: Dima Arnautov <dmitrii.arnautov@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@darnautov darnautov

Labels
failed-es-promotion failed-test A test failure on a tracked branch, potentially flaky-test :ml
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[ML] Enable PUT trained model API integration tests darnautov/kibana
4 participants
@mistic @darnautov @elasticmachine @kibanamachine