Skip to content

Commit

Permalink
[SPARK-43974][CONNECT][BUILD] Upgrade buf to v1.23.1
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
The pr aims to upgrade buf from 1.20.0 to 1.23.1

### Why are the changes needed?
1.Release Notes:
- https://github.com/bufbuild/buf/releases/tag/v1.23.1
- https://github.com/bufbuild/buf/releases/tag/v1.23.0
- https://github.com/bufbuild/buf/releases/tag/v1.22.0
- https://github.com/bufbuild/buf/releases/tag/v1.21.0

2.The new version brings some bug fixed and improvment, as follow:
- Fix issue where buf beta graph would not print modules within a workspace that
had no dependencies or dependents.
- Fix issue where buf beta graph would print warnings for missing dependencies
that were actually present.
- Fix issue where locally-produced images did not have module information if the corresponding
module was stored in the new cache.
- Remove buf beta registry template.
- Remove buf beta registry plugin {create,deprecate,list,undeprecate,version} and replace with
buf beta registry plugin {push,delete}.
- Update buf beta price with the latest pricing information.

3.Manually test: dev/connect-gen-protos.sh, this upgrade will not change the generated files.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
- Manually test
- Pass GA

Closes apache#41937 from panbingkun/SPARK-43974_Right.

Authored-by: panbingkun <pbk1982@gmail.com>
Signed-off-by: Ruifeng Zheng <ruifengz@apache.org>
  • Loading branch information
panbingkun authored and zhengruifeng committed Jul 12, 2023
1 parent 8fd6d4d commit d9248e8
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -631,7 +631,7 @@ jobs:
- name: Install dependencies for Python code generation check
run: |
# See more in "Installation" https://docs.buf.build/installation#tarball
curl -LO https://github.com/bufbuild/buf/releases/download/v1.20.0/buf-Linux-x86_64.tar.gz
curl -LO https://github.com/bufbuild/buf/releases/download/v1.23.1/buf-Linux-x86_64.tar.gz
mkdir -p $HOME/buf
tar -xvzf buf-Linux-x86_64.tar.gz -C $HOME/buf --strip-components 1
python3.9 -m pip install 'protobuf==3.19.5' 'mypy-protobuf==3.3.0'
Expand Down
2 changes: 1 addition & 1 deletion python/docs/source/development/contributing.rst
Original file line number Diff line number Diff line change
Expand Up @@ -120,7 +120,7 @@ Prerequisite

PySpark development requires to build Spark that needs a proper JDK installed, etc. See `Building Spark <https://spark.apache.org/docs/latest/building-spark.html>`_ for more details.

Note that if you intend to contribute to Spark Connect in Python, ``buf`` version ``1.20.0`` is required, see `Buf Installation <https://docs.buf.build/installation>`_ for more details.
Note that if you intend to contribute to Spark Connect in Python, ``buf`` version ``1.23.1`` is required, see `Buf Installation <https://docs.buf.build/installation>`_ for more details.

Conda
~~~~~
Expand Down

0 comments on commit d9248e8

Please sign in to comment.