From 184e731f5c19a5024d110d7b02eca0da47c5bd33 Mon Sep 17 00:00:00 2001 From: Etienne Bacher <52219252+etiennebacher@users.noreply.github.com> Date: Thu, 2 Nov 2023 18:24:59 +0100 Subject: [PATCH] update vignette section on partitioning --- vignettes/polars.Rmd | 10 +++------- 1 file changed, 3 insertions(+), 7 deletions(-) diff --git a/vignettes/polars.Rmd b/vignettes/polars.Rmd index 668ea249a..1647d29e3 100644 --- a/vignettes/polars.Rmd +++ b/vignettes/polars.Rmd @@ -467,11 +467,8 @@ aq$filter( )$collect() ``` -Finally, can read/scan multiple files in the same directory through pattern -globbing. However, please note that partition-aware scanning is not yet -supported out of the box (e.g., Hive-style partitioned datasets). Follow -[this issue](https://github.com/pola-rs/polars/issues/4347) for more details -about when this will be resolved. +Finally, we can read/scan multiple files in the same directory through pattern +globbing. ```{r} dir.create("airquality-ds") @@ -480,8 +477,7 @@ write_dataset(airquality, "airquality-ds", partitioning = "Month") # Use pattern globbing to scan all parquet files in the folder aq2 = pl$scan_parquet("airquality-ds/*/*.parquet") -# Just print the first two rows. But note that the Month column -# (which we used for partitioning) is missing. +# Just print the first two rows. aq2$limit(2)$collect() ```