Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve performance of nvtext::tokenize_with_vocabulary for long strings #14336

Merged
merged 11 commits into from
Nov 3, 2023
Merged

Improve performance of nvtext::tokenize_with_vocabulary for long strings #14336

merged 11 commits into from
Nov 3, 2023

Commits on Oct 26, 2023

  1. Improve performance of nvtext::tokenize_vocabulary for long strings

    @davidwendt
    davidwendt committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    1d4e48e View commit details
    Browse the repository at this point in the history

  2. fix merge conflict

    @davidwendt
    davidwendt committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    e19d0f9 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    febfa58 View commit details
    Browse the repository at this point in the history

  2. fix divide-by-zero error

    @davidwendt
    davidwendt committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    fe74eec View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    dafe06d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    cd2d273 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    1c1ab04 View commit details
    Browse the repository at this point in the history

  2. remove commented out code

    @davidwendt
    davidwendt committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    a10bbb0 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    a27ed1d View commit details
    Browse the repository at this point in the history

  2. simplify count calculation in token counts kernel

    @davidwendt
    davidwendt committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    fe76198 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.12' into vocab-tokenize-perf

    @davidwendt
    davidwendt committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    5aafcc5 View commit details
    Browse the repository at this point in the history