Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pass .chunk/rechunk calls through for chunked arrays without ChunkManagers #9286

Open
wants to merge 34 commits into
base: main
Choose a base branch
from
Open

Pass .chunk/rechunk calls through for chunked arrays without ChunkManagers #9286

wants to merge 34 commits into from

Commits on Jul 26, 2024

  1. test that rechunk can be passed through non registered chunked arrays

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    f860ce5 View commit details
    Browse the repository at this point in the history

  2. remove chunks and rechunk from chunkmanager

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    77947c3 View commit details
    Browse the repository at this point in the history

  3. remove now-redundant chunks method from dask chunkmanager

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    da6799a View commit details
    Browse the repository at this point in the history

  4. use is_chunked_array instead of hasattr(chunks)

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    34dadae View commit details
    Browse the repository at this point in the history

  5. add has_chunkmanager function

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    6e26a2d View commit details
    Browse the repository at this point in the history

  6. use has_chunkmanager

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    78e8ff4 View commit details
    Browse the repository at this point in the history

  7. fix errors in other tests

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    6feede3 View commit details
    Browse the repository at this point in the history

  8. improve docs

    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    621ea0c View commit details
    Browse the repository at this point in the history

  9. test that computation proceeds without dask on unregistered chunked a… 

    …rrays
    @TomNicholas
    TomNicholas committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    c305b61 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2024

  1. type hinting fixes

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    4f82d9d View commit details
    Browse the repository at this point in the history

  2. fix other issues revealed by typing

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    a9bd35d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into non_registered_chunkedarrays

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    49e2b5f View commit details
    Browse the repository at this point in the history

  4. ensure tests check that chunks are properly normalized

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    a24489b View commit details
    Browse the repository at this point in the history

  5. remove now-redundant chunks and rechunk methods from DummyChunkManager

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    2cce6a0 View commit details
    Browse the repository at this point in the history

  6. commented-out code indicating problem with chunk normalization

    @TomNicholas
    TomNicholas committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    3cadd53 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. fixed bug with chunks passed as dict

    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    556161d View commit details
    Browse the repository at this point in the history

  2. fix dodgy chunking patterns in tests

    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    0296f92 View commit details
    Browse the repository at this point in the history

  3. Revert "fixed bug with chunks passed as dict" 

    This reverts commit 556161d.
    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    9c2ab5e View commit details
    Browse the repository at this point in the history

  4. fixed bug with chunks passed as dict

    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    665727b View commit details
    Browse the repository at this point in the history

  5. remove outdated comments

    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    54adae7 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into non_registered_chunkedarrays

    @TomNicholas
    TomNicholas committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    5863859 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. refactor to always use the same codepath for chunk normalization

    @TomNicholas
    TomNicholas committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    b1024c9 View commit details
    Browse the repository at this point in the history

  2. also use new codepath when determining preferred_chunks for backends

    @TomNicholas
    TomNicholas committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e926748 View commit details
    Browse the repository at this point in the history

  3. update TODO about what normalization is handled by dask

    @TomNicholas
    TomNicholas committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    def3131 View commit details
    Browse the repository at this point in the history

  4. remove normalize_chunks method from ChunkManagerEntrypoint

    @TomNicholas
    TomNicholas committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    8db961e View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. vendor dask.array.normalize_chunks and its dependencies

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    955c56e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into non_registered_chunkedarrays

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    58d1cc1 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    aa3afff View commit details
    Browse the repository at this point in the history

  4. use Union for python <3.10

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    bd29f79 View commit details
    Browse the repository at this point in the history

  5. some pre-commit fixes

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    7ad5f07 View commit details
    Browse the repository at this point in the history

  6. add __init__.py's to avoid import problems

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    d14b705 View commit details
    Browse the repository at this point in the history

  7. add vendor/__init__.py

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    aac1566 View commit details
    Browse the repository at this point in the history

  8. try to shut mypy up

    @TomNicholas
    TomNicholas committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    a0d1e84 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Merge branch 'main' into non_registered_chunkedarrays

    @dcherian
    dcherian authored Aug 14, 2024
    Configuration menu
    Copy the full SHA
    ce1df3a View commit details
    Browse the repository at this point in the history