Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose pack/unpack API to Python #8153

Merged
merged 44 commits into from
Jun 30, 2021
Merged

Expose pack/unpack API to Python #8153

merged 44 commits into from
Jun 30, 2021

Commits on May 4, 2021

  1. Expose pack/unpack API

    @charlesbluca
    charlesbluca committed May 4, 2021
    Configuration menu
    Copy the full SHA
    21e2e53 View commit details
    Browse the repository at this point in the history

  2. Package resorting

    @charlesbluca
    charlesbluca committed May 4, 2021
    Configuration menu
    Copy the full SHA
    49440ed View commit details
    Browse the repository at this point in the history

  3. Rename pack/unpack function

    @charlesbluca
    charlesbluca committed May 4, 2021
    Configuration menu
    Copy the full SHA
    06d82bc View commit details
    Browse the repository at this point in the history

Commits on May 5, 2021

  1. Add basic Cython function testing

    @charlesbluca
    charlesbluca committed May 5, 2021
    Configuration menu
    Copy the full SHA
    2d826c4 View commit details
    Browse the repository at this point in the history

  2. Split pack/unpack into individual functions

    @charlesbluca
    charlesbluca committed May 5, 2021
    Configuration menu
    Copy the full SHA
    f2ed139 View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary cudf import

    @charlesbluca
    charlesbluca committed May 5, 2021
    Configuration menu
    Copy the full SHA
    878de88 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2021

  1. Additional tests for unpacked dataframes

    @charlesbluca
    charlesbluca committed May 6, 2021
    Configuration menu
    Copy the full SHA
    77dc379 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2021

  1. Add packed columns Python wrapper class

    @charlesbluca
    charlesbluca committed May 7, 2021
    Configuration menu
    Copy the full SHA
    bc3228d View commit details
    Browse the repository at this point in the history

Commits on May 10, 2021

  1. Merge remote-tracking branch 'upstream/branch-0.20' into expose-pack-api

    @charlesbluca
    charlesbluca committed May 10, 2021
    Configuration menu
    Copy the full SHA
    82e0682 View commit details
    Browse the repository at this point in the history

  2. Replace Cython tests with Python

    @charlesbluca
    charlesbluca committed May 10, 2021
    Configuration menu
    Copy the full SHA
    e5e8e8e View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary import

    @charlesbluca
    charlesbluca committed May 10, 2021
    Configuration menu
    Copy the full SHA
    c9094a3 View commit details
    Browse the repository at this point in the history

  4. Run pre-commit hooks

    @charlesbluca
    charlesbluca committed May 10, 2021
    Configuration menu
    Copy the full SHA
    55da00b View commit details
    Browse the repository at this point in the history

Commits on May 13, 2021

  1. First pass at serialization

    @charlesbluca
    charlesbluca committed May 13, 2021
    Configuration menu
    Copy the full SHA
    da27ce8 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2021

  1. Make unique_ptr of metadata instead

    @charlesbluca
    charlesbluca committed May 14, 2021
    Configuration menu
    Copy the full SHA
    7bfad47 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2021

  1. Fix segfaults in pickling/unpickling

    @charlesbluca
    charlesbluca committed May 17, 2021
    Configuration menu
    Copy the full SHA
    d1ae22d View commit details
    Browse the repository at this point in the history

Commits on May 19, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.06' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed May 19, 2021
    Configuration menu
    Copy the full SHA
    82b31dd View commit details
    Browse the repository at this point in the history

Commits on May 20, 2021

  1. Add support for pickle-style serialization

    @charlesbluca
    charlesbluca committed May 20, 2021
    Configuration menu
    Copy the full SHA
    6d4d275 View commit details
    Browse the repository at this point in the history

  2. Expand tests for pack/unpack

    @charlesbluca
    charlesbluca committed May 20, 2021
    Configuration menu
    Copy the full SHA
    6bed65d View commit details
    Browse the repository at this point in the history

  3. Remove potential circular import risk

    @charlesbluca
    charlesbluca committed May 20, 2021
    Configuration menu
    Copy the full SHA
    d57893b View commit details
    Browse the repository at this point in the history

  4. Add logic to pack to decide whether to keep index

    @charlesbluca
    charlesbluca committed May 20, 2021
    Configuration menu
    Copy the full SHA
    674d259 View commit details
    Browse the repository at this point in the history

  5. Check for column data before asserting pointer inequality

    @charlesbluca
    charlesbluca committed May 20, 2021
    Configuration menu
    Copy the full SHA
    681a78a View commit details
    Browse the repository at this point in the history

Commits on May 21, 2021

  1. Add pack tests for list and struct columns

    @charlesbluca
    charlesbluca committed May 21, 2021
    Configuration menu
    Copy the full SHA
    f689d63 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2021

  1. Clarify that input table is Python object

    @charlesbluca
    charlesbluca committed May 24, 2021
    Configuration menu
    Copy the full SHA
    0a64054 View commit details
    Browse the repository at this point in the history

  2. Flesh out docstrings a bit

    @charlesbluca
    charlesbluca committed May 24, 2021
    Configuration menu
    Copy the full SHA
    9b55484 View commit details
    Browse the repository at this point in the history

  3. Add return types

    @charlesbluca
    charlesbluca committed May 24, 2021
    Configuration menu
    Copy the full SHA
    a826093 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2021

  1. Function renames

    @charlesbluca
    charlesbluca committed May 26, 2021
    Configuration menu
    Copy the full SHA
    8f22d76 View commit details
    Browse the repository at this point in the history

  2. Return a Table from Python unpack

    @charlesbluca
    charlesbluca committed May 26, 2021
    Configuration menu
    Copy the full SHA
    aa54fbf View commit details
    Browse the repository at this point in the history

  3. Naive addition of dtypes w.r.t. serialization

    @charlesbluca
    charlesbluca committed May 26, 2021
    Configuration menu
    Copy the full SHA
    1c5b163 View commit details
    Browse the repository at this point in the history

  4. Remove debugging block

    @charlesbluca
    charlesbluca committed May 26, 2021
    Configuration menu
    Copy the full SHA
    683ad13 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed May 27, 2021
    Configuration menu
    Copy the full SHA
    e7be8f0 View commit details
    Browse the repository at this point in the history

  2. Call DataFrame _from_table for tests

    @charlesbluca
    charlesbluca committed May 27, 2021
    Configuration menu
    Copy the full SHA
    656f5de View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed Jun 14, 2021
    Configuration menu
    Copy the full SHA
    b413362 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed Jun 15, 2021
    Configuration menu
    Copy the full SHA
    a749d19 View commit details
    Browse the repository at this point in the history

  2. Use metadata apply in pack/unpack

    @charlesbluca
    charlesbluca committed Jun 15, 2021
    Configuration menu
    Copy the full SHA
    d33fe8a View commit details
    Browse the repository at this point in the history

  3. Fix categorical test

    @charlesbluca
    charlesbluca committed Jun 15, 2021
    Configuration menu
    Copy the full SHA
    e99b267 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    fd6ce46 View commit details
    Browse the repository at this point in the history

  2. Serialize dtypes of packed columns

    @charlesbluca
    charlesbluca committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    b49a4ab View commit details
    Browse the repository at this point in the history

  3. Add additional serialization tests

    @charlesbluca
    charlesbluca committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    f279710 View commit details
    Browse the repository at this point in the history

  4. Some docstring alterations

    @charlesbluca
    charlesbluca committed Jun 21, 2021
    Configuration menu
    Copy the full SHA
    f2af602 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2021

  1. Move pickle to top level imports

    @charlesbluca
    charlesbluca committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    b78d6f9 View commit details
    Browse the repository at this point in the history

  2. Wrap Cython packed columns in serializable Python class

    @charlesbluca
    charlesbluca committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    4dbd87f View commit details
    Browse the repository at this point in the history

  3. Add serialization roundtrip tests, centralize in test_pack.py

    @charlesbluca
    charlesbluca committed Jun 22, 2021
    Configuration menu
    Copy the full SHA
    4ece337 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2021

  1. Merge remote-tracking branch 'upstream/branch-21.08' into expose-pack… 

    …-api
    @charlesbluca
    charlesbluca committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    af6e8e4 View commit details
    Browse the repository at this point in the history

  2. Fix assert_eq import

    @charlesbluca
    charlesbluca committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    3fa48c1 View commit details
    Browse the repository at this point in the history