Skip to content

Commit

Permalink
Deploy sql-plugin-api artifact in DBR CI pipelines [skip ci] (#9195)
Browse files Browse the repository at this point in the history
Fixes #9194

Addendum to #9148 that forgot to add a manual deploy

Testing:
```bash
$ BASE_SPARK_VERSION_TO_INSTALL_DATABRICKS_JARS=3.3.0 URM_URL=file:/tmp/m2-local ./jenkins/databricks/deploy.sh 

$ find /tmp/m2-local-local/ -name \*jar -ls
  2379641     36 -rw-rw-r--   1 ubuntu   ubuntu      33438 Sep  6 21:37 /tmp/m2-local-local/com/nvidia/rapids-4-spark-sql-plugin-api_2.12/23.10.0-SNAPSHOT/rapids-4-spark-sql-plugin-api_2.12-23.10.0-20230906.213759-1-spark330db.jar
  2379668    128 -rw-rw-r--   1 ubuntu   ubuntu     129243 Sep  6 21:38 /tmp/m2-local-local/com/nvidia/rapids-4-spark-integration-tests_2.12/23.10.0-SNAPSHOT/rapids-4-spark-integration-tests_2.12-23.10.0-20230906.213801-1-spark330db.jar
  2379612     24 -rw-rw-r--   1 ubuntu   ubuntu      24123 Sep  6 21:37 /tmp/m2-local-local/com/nvidia/rapids-4-spark-aggregator_2.12/23.10.0-SNAPSHOT/rapids-4-spark-aggregator_2.12-23.10.0-20230906.213758-1-spark330db.jar
```

Signed-off-by: Gera Shegalov <gera@apache.org>
  • Loading branch information
gerashegalov authored Sep 6, 2023
1 parent 83ad213 commit de043ca
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion jenkins/databricks/deploy.sh
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,11 @@ echo "Databricks jar is: $DBJARFPATH"
MVN="mvn -Dmaven.wagon.http.retryHandler.count=3 -DretryFailedDeploymentCount=3"
$MVN -B deploy:deploy-file $MVN_URM_MIRROR -Durl=$SERVER_URL -DrepositoryId=$SERVER_ID \
-Dfile=$DBJARFPATH -DpomFile=aggregator/pom.xml -Dclassifier=$DB_SHIM_NAME
# install the integration test jar
# Deploy the sql-plugin-api jar
DB_PLUGIN_API_JAR_PATH=./sql-plugin-api/target/${DB_SHIM_NAME}/rapids-4-spark-sql-plugin-api_$SCALA_VERSION-$SPARK_PLUGIN_JAR_VERSION-${DB_SHIM_NAME}.jar
$MVN -B deploy:deploy-file $MVN_URM_MIRROR -Durl=$SERVER_URL -DrepositoryId=$SERVER_ID \
-Dfile=$DB_PLUGIN_API_JAR_PATH -DpomFile=./sql-plugin-api/pom.xml -Dclassifier=$DB_SHIM_NAME
# Deploy the integration test jar
DBINTTESTJARFPATH=./integration_tests/target/rapids-4-spark-integration-tests_$SCALA_VERSION-$SPARK_PLUGIN_JAR_VERSION-${DB_SHIM_NAME}.jar
$MVN -B deploy:deploy-file $MVN_URM_MIRROR -Durl=$SERVER_URL -DrepositoryId=$SERVER_ID \
-Dfile=$DBINTTESTJARFPATH -DpomFile=integration_tests/pom.xml -Dclassifier=$DB_SHIM_NAME

0 comments on commit de043ca

Please sign in to comment.