Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Flush parquet at end of batches tick #16073

Merged
merged 1 commit into from
May 11, 2024
Merged

fix: Flush parquet at end of batches tick #16073

merged 1 commit into from
May 11, 2024

Conversation

ritchie46
Copy link
Member

@ritchie46 ritchie46 commented May 6, 2024

Getting the chunks size correct in this model is hard. I will wait for the new engine design.

@ritchie46 ritchie46 changed the title WIP: better row-groups in sink [skip ci] fix: Flush parquet at end of batches tick May 11, 2024
@github-actions github-actions bot added fix Bug fix python Related to Python Polars rust Related to Rust Polars labels May 11, 2024
@ritchie46 ritchie46 merged commit b7207b2 into main May 11, 2024
3 checks passed
@ritchie46 ritchie46 deleted the parquet branch May 11, 2024 11:02
Wouittone pushed a commit to Wouittone/polars that referenced this pull request Jun 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fix Bug fix python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant