Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Missing revision info in databricks shims failed nightly build #9213

Closed
pxLi opened this issue Sep 11, 2023 · 1 comment · Fixed by #9222
Closed

[BUG] Missing revision info in databricks shims failed nightly build #9213

pxLi opened this issue Sep 11, 2023 · 1 comment · Fixed by #9222
Assignees
Labels
bug Something isn't working P0 Must have for release

Comments

@pxLi
Copy link
Collaborator

pxLi commented Sep 11, 2023

Describe the bug
related to #9148

databricks aggregators or new api artifacts now have no revision property files,
which would fail the parallel worlds check in nightly error=Error: version file missing

[2023-09-10T11:43:46.379Z] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:3.1.0:run (create-parallel-world) on project rapids-4-spark_2.12: An Ant BuildException has occured: The following error occurred while executing this line:
[2023-09-10T11:43:46.379Z] [ERROR] /home/jenkins/agent/workspace/jenkins-rapids_nightly-dev-github-925/dist/maven-antrun/build-parallel-worlds.xml:113: check-shims-revisions.sh failed: exitCode=1 error=Error: version file missing: /home/jenkins/agent/workspace/jenkins-rapids_nightly-dev-github-925/dist/target/parallel-world/spark321db/rapids4spark-version-info.properties
[2023-09-10T11:43:46.379Z] [ERROR] around Ant part ...<ant antfile="/home/jenkins/agent/workspace/jenkins-rapids_nightly-dev-github-925/dist/maven-antrun/build-parallel-worlds.xml" target="remove-dependencies-from-pom" />... @ 9:172 in /home/jenkins/agent/workspace/jenkins-rapids_nightly-dev-github-925/dist/target/antrun/build-main.xml
[2023-09-10T11:43:46.379Z] [ERROR] -> [Help 1]

Steps/Code to reproduce bug
https://github.com/NVIDIA/spark-rapids/blob/branch-23.10/jenkins/spark-nightly-build.sh

Expected behavior
Pass the revision check,

Environment details (please complete the following information)
databricks

Additional context
Add any other context about the problem here.

@pxLi pxLi added bug Something isn't working ? - Needs Triage Need team to review and classify labels Sep 11, 2023
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 11, 2023

cc @gerashegalov can you help take a look? thanks

@pxLi pxLi added P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Sep 11, 2023
@gerashegalov gerashegalov self-assigned this Sep 12, 2023
gerashegalov added a commit to gerashegalov/spark-rapids that referenced this issue Sep 12, 2023
Fixes NVIDIA#9213

Signed-off-by: Gera Shegalov <gera@apache.org>
pxLi pushed a commit that referenced this issue Sep 12, 2023
Fixes #9213

Signed-off-by: Gera Shegalov <gera@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working P0 Must have for release
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants