Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for read from Cosmos DB Core SQL API #25672

Merged
merged 18 commits into from
Jul 10, 2023

Conversation

RustedBones
Copy link
Contributor

Fix #23604
Follow-up from #23610

Implementation inspired from official azure-cosmos-spark

@RustedBones
Copy link
Contributor Author

R: @kennknowles as you were part of the previous discussion in the linked PR

@github-actions
Copy link
Contributor

github-actions bot commented Mar 1, 2023

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

@codecov
Copy link

codecov bot commented Mar 1, 2023

Codecov Report

Merging #25672 (92508e1) into master (f19c384) will increase coverage by 0.26%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #25672      +/-   ##
==========================================
+ Coverage   71.05%   71.32%   +0.26%     
==========================================
  Files         858      862       +4     
  Lines      104105   105206    +1101     
==========================================
+ Hits        73976    75038    +1062     
- Misses      28580    28619      +39     
  Partials     1549     1549              
Flag Coverage Δ
python 80.52% <ø> (+0.25%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 21 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@RustedBones
Copy link
Contributor Author

@Miuler can you give it a try in a real setup ? I've only tested with testcontainers.

@github-actions
Copy link
Contributor

This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@beam.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Jun 24, 2023
@RustedBones RustedBones force-pushed the azure-cosmos branch 2 times, most recently from d2f1f81 to 24e9fe8 Compare June 30, 2023 13:40
@RustedBones
Copy link
Contributor Author

@kennknowles & @Abacn can you have a look as you commented on #23610 ?

@Abacn
Copy link
Contributor

Abacn commented Jun 30, 2023

Thanks, taking a look

@Abacn Abacn removed the stale label Jun 30, 2023
Copy link
Contributor

@Abacn Abacn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution!

This looks pretty solid to me. Left a few comments mostly regarding code format

@@ -612,6 +612,7 @@ class BeamModulePlugin implements Plugin<Project> {
aws_java_sdk2_regions : "software.amazon.awssdk:regions:$aws_java_sdk2_version",
aws_java_sdk2_utils : "software.amazon.awssdk:utils:$aws_java_sdk2_version",
aws_java_sdk2_profiles : "software.amazon.awssdk:profiles:$aws_java_sdk2_version",
azure_sdk_bom : "com.azure:azure-sdk-bom:1.2.14",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I updated to use the azure-sdk-bom to ensure azure module compatibility

Copy link
Contributor

@Abacn Abacn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! LGTM

@Abacn Abacn merged commit dcd8765 into apache:master Jul 10, 2023
15 of 16 checks passed
@RustedBones RustedBones deleted the azure-cosmos branch July 11, 2023 10:18
aleksandr-dudko pushed a commit to aleksandr-dudko/beam that referenced this pull request Jul 17, 2023
* feat(azure-cosmosdb): Add support for cosmosdb with Core (SQL) API

Refs: apache#23604

* build(azure-cosmosdb): Add fleet in .gitignore

* docs(azure-cosmosdb): Add scaladoc, license, experimental annotation and move the feature in CHANGELOG.md to 2.50.0 version.

---------

Co-authored-by: Hector Miuler Malpica Gallegos <miuler@gmail.com>
bullet03 pushed a commit to akvelon/beam that referenced this pull request Aug 11, 2023
* feat(azure-cosmosdb): Add support for cosmosdb with Core (SQL) API

Refs: apache#23604

* build(azure-cosmosdb): Add fleet in .gitignore

* docs(azure-cosmosdb): Add scaladoc, license, experimental annotation and move the feature in CHANGELOG.md to 2.50.0 version.

---------

Co-authored-by: Hector Miuler Malpica Gallegos <miuler@gmail.com>
cushon pushed a commit to cushon/beam that referenced this pull request May 24, 2024
* feat(azure-cosmosdb): Add support for cosmosdb with Core (SQL) API

Refs: apache#23604

* build(azure-cosmosdb): Add fleet in .gitignore

* docs(azure-cosmosdb): Add scaladoc, license, experimental annotation and move the feature in CHANGELOG.md to 2.50.0 version.

---------

Co-authored-by: Hector Miuler Malpica Gallegos <miuler@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CosmosDB: Add support for Azure database CosmosDB with Core (SQL) Api
3 participants