[Metrics UI] Remove TSVB dependency from Metrics Explorer APIs

[simianhacker]

Summary

This PR removes the TSVB dependency from Metrics Explorer and introduces a new library called "Metrics API". The goal of this library is to create a replacement backend for both the Metrics Explorer, Snapshot APIs, and alert executors. This new library supports the following features:

• Multiple group bys
• Multiple metrics defined using ES native aggregations
• Optional alignment of the timeseries to the end of the time range. By default ES aligns the buckets to the beginning of the time range
• Drop last bucket, similar to how TSVB works
• Auto bucketing with a floor, this uses the same syntax >=1m as TSVB
• Paginate through groupings
• Everything is Typescript
• Doesn't depend on Metric UI's source or the KIbana request context

Here is an example of how to use this new service.

import { query } from 'server/lib/metrics';
import { MetricsAPIRequest, MetricsAPIResponse } from 'common/http_api';
import { createSearchClient } from 'server/lib/create_search_client';

const options: MetricsAPIRequest = {
  timerange: {
    field: '@timestamp',
    from: new Date('2020-01-01T00:00:00Z').getTime(),
    to: new Date('2020-01-01T01:00:00Z').getTime(),
    interval: '>=1m',
  },
  limit: 9,
  dropLastBucket: true,
  indexPattern: 'metrics-*',
  metrics: [
    { id: 'metric_0', aggregations: { metric_0: { avg: { field: 'system.cpu.user.pct' } } } },
  ],
};

const client = createSearchClient(requestContext, framework);
const response: MetricsAPIResponse = await query(client, options);

One of the goals of this new service is to provide a consistent way to query time series metrics from anywhere with in the Metrics UI app. The search client function can be swapped out with a function (with the same signature, ESSearchClient) that makes calls using a search strategy.

I plan to turn the Metrics API into a Search Strategy in a separate PR which will make using this library even more ubiquitous. I'm also going to submit a follow up PR to use this API for the backend for the Snapshot API.

Testing this PR

The goal of this PR is to go unnoticed by the user. The only change to the integration test was the ID field when the user didn't specify any group by's. Before this change it returned "Everything" as the ID, now it returns * and we display the "Everything" title only in the UI when it matches this value.

• Ingest data from Metricbeat running on your localhost
• Open Metrics Explorer on Master and create a visualization
• Check out this new PR, the visualization and data should be identical.

Checklist

Delete any items that are not applicable to this PR.

• Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
• Unit or functional tests were updated or added to match the most common scenarios

[elasticmachine]

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

[Zacqary]

Couple style nits but looks good overall

[Zacqary]

Small typo in how many days are in a year

[kibanamachine]

💚 Build Succeeded

• continuous-integration/kibana-ci/pull-request
• Commit: 92e9e16

Build metrics

@kbn/optimizer bundle module count

id	value	diff	baseline
infra	1057	+1	1056

async chunks size

id	value	diff	baseline
infra	3.5MB	+3.5KB	3.5MB

page load bundle size

id	value	diff	baseline
infra	275.5KB	+431.0B	275.1KB

History

• 💚 Build #67831 succeeded 1f1206c
• 💔 Build #67830 failed de23105
• 💔 Build #67826 failed db171df
• 💚 Build #67778 succeeded cca2b58
• 💔 Build #67767 failed f15f325

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[Zacqary]

Checked out and tested this and it seems to be working! Thanks for doing this!