Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create MRE for rechunking failure #8

Closed
1 task
jbusecke opened this issue Aug 6, 2023 · 3 comments
Closed
1 task

Create MRE for rechunking failure #8

jbusecke opened this issue Aug 6, 2023 · 3 comments
Assignees

Comments

@jbusecke
Copy link
Collaborator

jbusecke commented Aug 6, 2023

Just a separate issue to track this.

  • Make a MRE for this bug and submit an issue about this.

I was able to reproduce the failure above for both iids used when I set the target_chunks={..., 'bnds':1} (tested with multiple values for the other dims). If I set target_chunks={..., 'bnds':2} I have so far not observed a single failure. I have traced back most failures with the dynamic chunking to this pattern too, and thus conclude this is not an issue with the dynamic chunking, but instead reveals some issues further upstream. My hint from above about the dimension having coordinates/no coordinates seemed to have been a wrong lead too. There is something is still going wrong with the rechunking if the dataset has dimensions on coordinates which are not present on the data_variable.

Originally posted by @jbusecke in #4 (comment)

@jbusecke
Copy link
Collaborator Author

I think this is being tackled in pangeo-forge/pangeo-forge-recipes#520

@cisaacstern
Copy link
Contributor

Yes and also the linked pangeo-forge/pangeo-forge-recipes#658

@jbusecke
Copy link
Collaborator Author

I think this was solved in #95.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants