-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add command-line argument for benchmark result filename #904
Add command-line argument for benchmark result filename #904
Conversation
Signed-off-by: Andy Grove <andygrove@nvidia.com>
build |
@@ -33,19 +33,21 @@ object TpcdsLikeBench extends Logging { | |||
* @param spark The Spark session | |||
* @param query The name of the query to run e.g. "q5" | |||
* @param iterations The number of times to run the query. | |||
* @param resultFilenameStub Optional name for the generated JSON summary file. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm assuming Stub here was intentional because I think its actually only part of the file name, we may want to clarify the description to say prefix for the...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks. I renamed to summaryFilePrefix
to disambiguate from the output arguments that refer to the output of the query itself. I also updated the javadocs.
@@ -167,6 +179,7 @@ class Conf(arguments: Seq[String]) extends ScallopConf(arguments) { | |||
val iterations = opt[Int](default = Some(3)) | |||
val output = opt[String](required = false) | |||
val outputFormat = opt[String](required = false) | |||
val name = opt[String](required = false) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
similar here, "name" ends up being the command line option perhaps we should be more specific like outputFilePrefix
Signed-off-by: Andy Grove <andygrove@nvidia.com>
build |
Tests timed out. build. |
build |
build |
1 similar comment
build |
* Add command-line argument for benchmark result filename Signed-off-by: Andy Grove <andygrove@nvidia.com> * Rename parameter to summaryFilePrefix Signed-off-by: Andy Grove <andygrove@nvidia.com>
* Add command-line argument for benchmark result filename Signed-off-by: Andy Grove <andygrove@nvidia.com> * Rename parameter to summaryFilePrefix Signed-off-by: Andy Grove <andygrove@nvidia.com>
* Add command-line argument for benchmark result filename Signed-off-by: Andy Grove <andygrove@nvidia.com> * Rename parameter to summaryFilePrefix Signed-off-by: Andy Grove <andygrove@nvidia.com>
…IDIA#904) Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Signed-off-by: Andy Grove andygrove@nvidia.com
When running automated benchmarks with a number of different configurations, it is important to be able to override the name of the generated report summary JSON file that contains the timing information.
This PR also updates the pom so that a
jar-with-dependencies
jar is built for theintegration_test
module.