Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: lancedb/lance
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.13.0
Choose a base ref
...
head repository: lancedb/lance
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.13.1-beta.1
Choose a head ref
  • 5 commits
  • 61 files changed
  • 5 contributors

Commits on Jun 24, 2024

  1. Bump version

    Lance Release committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    816a58a View commit details
    Browse the repository at this point in the history
  2. feat: enhance binary array encoding, make it the default (#2521)

    This adds support for the following things to the binary encoding:
     * Nulls
     * Large offsets
     * Different types (e.g. String vs Binary)
    
    In addition, I have changed the row limit on pages from `u32` to `u64`.
    Partly, this is because string arrays larger that 2GB are not unheard of
    and it may be nice in some cases to store them in one page. Also pages
    are infrequent enough that an extra 4 bytes is trivial (actually,
    protobuf already stores u32 and u64 the same). Another reason is that,
    with some encodings (e.g. constant / compressed bitmap / etc.) it's
    possible to have 2^64 rows without occupying a large amount of space.
    
    Note: this is technically a `.proto` change but in protobuf `u32 -> u64`
    is backwards compatible so it is not a huge issue.
    westonpace authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4a114b2 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. refactor: move IVF_HNSW_SQ & IVF_FLAT to new buliding & search path (#…

    …2469)
    
    - IVF_HNSW_SQ for new search/build path
    - IVF_FLAT e2e pass
    - support to train quantizer with new index builder
    - fix partition order broken after building
    - clean IVF related types
    - index builder method chaining for customizing
    - impl merging deltas for new IVF_HNSW_SQ & IVF_FLAT
    
    ---------
    
    Signed-off-by: BubbleCal <bubble-cal@outlook.com>
    BubbleCal authored Jun 25, 2024
    Configuration menu
    Copy the full SHA
    f51c5f0 View commit details
    Browse the repository at this point in the history
  2. docs: artefact_management_doc (#2504)

    Add Deep Learning Artefact Management Docs to Lance Docs.
    tanaymeh authored Jun 25, 2024
    Configuration menu
    Copy the full SHA
    06a6a09 View commit details
    Browse the repository at this point in the history
  3. chore: upgrade aws-config for aarch64-pc-windows support (#2510)

    Upgrades `aws-config` because `aws-config@0.56` has a dependency on
    `ring@0.16` [^1] which does not support `aarch64-pc-windows` [^2].
    
    > error: failed to run custom build command for `ring v0.16.20`.
    
    Support for `aarch64-pc-windows` was added in `ring@0.17` [^3] which
    `aws-config@0.57` uses [^4].
    
    Unfortunately, there's a hideous amount of changes between these two
    version, although no breaking changes are mentioned in the changelog
    [^5]. Does a maintainer here have a suggestion of what kind of testing
    we might need to do?
    
    [^1]:
    https://github.com/awslabs/aws-sdk-rust/blob/d212f8dd428e140b8ff414261f6921b2901a7dbc/sdk/aws-config/Cargo.toml#L98-L100
    [^2]: briansmith/ring#1514
    [^3]:
    briansmith/ring#1167 (comment)
    [^4]:
    https://github.com/awslabs/aws-sdk-rust/blob/511abe92a476c27d1e49758fe54eac0886ecf731/sdk/aws-config/Cargo.toml#L98-L100
    [^5]: https://github.com/awslabs/aws-sdk-rust/compare/d212f8d..511abe9
    NickDarvey authored Jun 25, 2024
    Configuration menu
    Copy the full SHA
    8ccd191 View commit details
    Browse the repository at this point in the history
Loading