You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The context is we are working on introducing a data source cache layer for Ballista & DataFusion apache/datafusion-ballista#645. To make the cache layer transparent for the ObjectStore caller, we plan to introduce a special cached based ObjectStore, which will search local cache first and then the original remote source ObjectStore. A sample implementation is like https://github.com/yahoNanJing/arrow-ballista/blob/dev-20230302/ballista/core/src/cache_layer/object_store/file.rs. Then we hope the ObjectStoreRegistry be able to provide polymorphism for the get_by_url method. If cached enabled, that function will always return a cached-based ObjectStore.
Describe the solution you'd like
To introduce an object trait as the attribute of ObjectStoreRegistry.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The context is we are working on introducing a data source cache layer for Ballista & DataFusion apache/datafusion-ballista#645. To make the cache layer transparent for the
ObjectStore
caller, we plan to introduce a special cached basedObjectStore
, which will search local cache first and then the original remote sourceObjectStore
. A sample implementation is like https://github.com/yahoNanJing/arrow-ballista/blob/dev-20230302/ballista/core/src/cache_layer/object_store/file.rs. Then we hope theObjectStoreRegistry
be able to provide polymorphism for theget_by_url
method. If cached enabled, that function will always return a cached-basedObjectStore
.Describe the solution you'd like
To introduce an object trait as the attribute of
ObjectStoreRegistry
.Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: