Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LLM common metrics for Generative AI #955

Merged
merged 34 commits into from
May 28, 2024
Merged

LLM common metrics for Generative AI #955

merged 34 commits into from
May 28, 2024
+263 −0

Commits on May 23, 2024

  1. Initial LLM metrics

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    da4fb55 View commit details
    Browse the repository at this point in the history

  2. Add link references

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    1169756 View commit details
    Browse the repository at this point in the history

  3. Add LLM Metrics to README

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    383fa1f View commit details
    Browse the repository at this point in the history

  4. Add changelog

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c4308be View commit details
    Browse the repository at this point in the history

  5. Fix yamllint error on chloggen

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    1239fbd View commit details
    Browse the repository at this point in the history

  6. Update reference to LLM

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9565f2c View commit details
    Browse the repository at this point in the history

  7. Change metric name to match semconv

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b579374 View commit details
    Browse the repository at this point in the history

  8. Add gen_ai.system

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    c938263 View commit details
    Browse the repository at this point in the history

  9. Updates for review comments

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d5b59dc View commit details
    Browse the repository at this point in the history

  10. Rename/scope LLM to Gen AI metrics

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    2b942db View commit details
    Browse the repository at this point in the history

  11. Remove trailing spaces

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    5335175 View commit details
    Browse the repository at this point in the history

  12. Update operation examples.

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    4f415b3 View commit details
    Browse the repository at this point in the history

  13. Replace pluralized tokens with token

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    f3e6586 View commit details
    Browse the repository at this point in the history

  14. Update table of contents

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    fd01e65 View commit details
    Browse the repository at this point in the history

  15. Update token type

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b1ccbd6 View commit details
    Browse the repository at this point in the history

  16. Update requirement levels

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    de89866 View commit details
    Browse the repository at this point in the history

  17. Override error.type note

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    cfd8e86 View commit details
    Browse the repository at this point in the history

  18. Allow custom values to true

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    9ac4406 View commit details
    Browse the repository at this point in the history

  19. Add ExplicitBucketBoundaries

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b2828f8 View commit details
    Browse the repository at this point in the history

  20. Make token metric recommended

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    979f732 View commit details
    Browse the repository at this point in the history

  21. Remove trailing space

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    84d78eb View commit details
    Browse the repository at this point in the history

  22. Fix recommended label.

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    72cc2c9 View commit details
    Browse the repository at this point in the history

  23. Update metrics to be for 'client'

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    04c6fb3 View commit details
    Browse the repository at this point in the history

  24. Update title

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    7db4c52 View commit details
    Browse the repository at this point in the history

  25. Update registry table

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    d9ab4d8 View commit details
    Browse the repository at this point in the history

  26. Move error.type from common to duration metric.

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    58b10b3 View commit details
    Browse the repository at this point in the history

  27. Add clarifation on used vs billed tokens.

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b361e4a View commit details
    Browse the repository at this point in the history

  28. Regenerate tables

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    aa02859 View commit details
    Browse the repository at this point in the history

  29. Regenerate tables

    @drewby
    drewby committed May 23, 2024
    Configuration menu
    Copy the full SHA
    b351811 View commit details
    Browse the repository at this point in the history

  30. Merge branch 'main' into drewby/llm_metrics

    @drewby
    drewby authored May 23, 2024
    Configuration menu
    Copy the full SHA
    b90fdc5 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Merge branch 'open-telemetry:main' into drewby/llm_metrics

    @drewby
    drewby authored May 24, 2024
    Configuration menu
    Copy the full SHA
    e48e635 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Remove unnecessary elements

    @drewby
    drewby committed May 25, 2024
    Configuration menu
    Copy the full SHA
    2cd0b90 View commit details
    Browse the repository at this point in the history

  2. Update description for error.type

    @drewby
    drewby committed May 25, 2024
    Configuration menu
    Copy the full SHA
    fa99804 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Merge branch 'main' into drewby/llm_metrics

    @lmolkova
    lmolkova authored May 28, 2024
    Configuration menu
    Copy the full SHA
    a405081 View commit details
    Browse the repository at this point in the history