Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve Common Crawl download #82

Merged
merged 9 commits into from
Jun 28, 2024
Merged

Improve Common Crawl download #82

merged 9 commits into from
Jun 28, 2024

Commits on May 24, 2024

  1. Add error for invalid snapshot order 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d51716b View commit details
    Browse the repository at this point in the history

  2. Add error for cc news snapshot order 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed May 24, 2024
    Configuration menu
    Copy the full SHA
    36681ec View commit details
    Browse the repository at this point in the history

  3. Improve error messaging for no urls 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed May 24, 2024
    Configuration menu
    Copy the full SHA
    95effac View commit details
    Browse the repository at this point in the history

  4. Reformat error 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed May 24, 2024
    Configuration menu
    Copy the full SHA
    8ee1d90 View commit details
    Browse the repository at this point in the history

  5. Update documentation 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d321443 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'main' into rywolf/improve-download

    @ryantwolf
    ryantwolf committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    0dde1a7 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Update links 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    6efaed7 View commit details
    Browse the repository at this point in the history

  2. Update download tests 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    01a2d5f View commit details
    Browse the repository at this point in the history

  3. Add output format to test 

    Signed-off-by: Ryan Wolf <rywolf@nvidia.com>
    @ryantwolf
    ryantwolf committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    d320310 View commit details
    Browse the repository at this point in the history