Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve parquet MetadataFetch and AsyncFileReader docs #6505

Merged
merged 6 commits into from
Oct 6, 2024

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Oct 3, 2024

Which issue does this PR close?

Part of #6504

Rationale for this change

While working on the example for using parquet metadata in a local cache (#6081) some of these traits and how to implement them were not clear to me

What changes are included in this PR?

Add additional documentation and explanations

Are there any user-facing changes?

Better documentation and examples. No functional changes

@alamb alamb marked this pull request as ready for review October 3, 2024 13:15
/// Return a future that fetches the specified range of bytes asynchronously
///
/// Note the returned type is a boxed future, often created by
/// [FutureExt::boxed]. See the trait documentation for an example
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you are not familiar with rust futures BoxFuture is somewhat exotic. I will also make a PR upstream in futures to try and improve the docs there

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rust-lang/futures-rs#2887 -- we'll see what the maintainers say

parquet/src/arrow/async_reader/metadata.rs Outdated Show resolved Hide resolved
parquet/src/arrow/async_reader/mod.rs Outdated Show resolved Hide resolved
@alamb alamb changed the title Improve MetadataFetch and AsyncFileReader docs Improve parquet MetadataFetch and AsyncFileReader docs Oct 3, 2024
Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
@github-actions github-actions bot added the parquet Changes to the parquet crate label Oct 3, 2024
Copy link
Contributor

@etseidl etseidl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. 👍 @mbrobbel found the only issues I did.

Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
parquet/src/arrow/async_reader/metadata.rs Outdated Show resolved Hide resolved
parquet/src/file/metadata/reader.rs Outdated Show resolved Hide resolved
alamb and others added 3 commits October 4, 2024 18:46
Co-authored-by: Val Lorentz <progval+github@progval.net>
Co-authored-by: Val Lorentz <progval+github@progval.net>
@alamb alamb merged commit 408206b into apache:master Oct 6, 2024
16 checks passed
@alamb
Copy link
Contributor Author

alamb commented Oct 6, 2024

Thank you everyone for your suggestions and support.

@alamb alamb deleted the alamb/reader_docs branch October 6, 2024 11:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants