Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image storage: serve iso images, lithops support #778

Merged
merged 11 commits into from
Mar 11, 2021

Conversation

intsco
Copy link
Member

@intsco intsco commented Mar 8, 2021

  • Export iso image URLs to ES.
  • Make image storage work with lithops.
  • Remove dataset indexing from ServerAnnotationJob.
  • Configure policy for image storage bucket on startup.
  • Fix sci-test.
  • Remove deprecated bootstrap_and_run, refactor dependent scripts.
  • Update graphql Annotation resolver.
  • Handle pylint==2.7.0 complaints.

* remove deprecated bootstrap_and_run, refactor
dependent scripts
* configure policy for image storage bucket on startup
* fix sci-test
* update graphql Annotation resolver
@intsco intsco self-assigned this Mar 8, 2021
@intsco intsco added the enhancement New feature or request label Mar 8, 2021
* remove dataset indexing from ServerAnnotationJob
* linting
@intsco intsco changed the title feat: serve iso image urls from graphql feat: Serve iso images. Lithops support. Mar 9, 2021
@intsco intsco marked this pull request as ready for review March 9, 2021 18:32
@intsco intsco changed the title feat: Serve iso images. Lithops support. Image storage: serve iso images, lithops support. Mar 9, 2021
@intsco intsco changed the title Image storage: serve iso images, lithops support. Image storage: serve iso images, lithops support Mar 9, 2021
@intsco intsco marked this pull request as draft March 9, 2021 23:38
* thumnail and coloc gen with lithops
* simplify ImageStorage init
@intsco intsco marked this pull request as ready for review March 10, 2021 11:41
Copy link
Contributor

@LachlanStuart LachlanStuart left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for cleaning up the lint issues. Generally looks good.

My comment on ImageStorage._configure_bucket is non-critical - skip it if you don't have time.

Action is only needed on the migration comment if you don't already have a plan for how to deal with the transition period.

Copy link
Contributor

@sergii-mamedov sergii-mamedov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@intsco intsco merged commit 1564675 into feat/s3-image-storage-meta Mar 11, 2021
@intsco intsco deleted the feat/image-storage-graphql-lithops branch March 11, 2021 21:32
intsco added a commit that referenced this pull request Mar 24, 2021
* feat: serve iso image urls from graphql

* remove deprecated bootstrap_and_run, refactor
dependent scripts
* configure policy for image storage bucket on startup
* fix sci-test
* update graphql Annotation resolver

* fix: test_es_export.py

* feat: make image storage work with lithops

* remove dataset indexing from ServerAnnotationJob
* linting

* test: fix

* test: fix sci test

* fix: code polishing

* fix: catch import error

* feat: delete ion thumbnail on ds delete

* fix: pass ImageStorage objects to lithops functions

* thumnail and coloc gen with lithops
* simplify ImageStorage init

* test: fix colocalization

* fix: move image storage bucket configuration to module level init
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants