-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix and edit docs for standalone mode #1342
Fix and edit docs for standalone mode #1342
Conversation
Signed-off-by: Sameer Raheja <sraheja@nvidia.com>
build |
@@ -134,7 +134,7 @@ Now for each worker node: | |||
- `cp $SPARK_HOME/conf/spark-env.sh.template $SPARK_HOME/conf/spark-env.sh` | |||
- Edit `$SPARK_HOME/conf/spark-env.sh` and add any worker options. The example below sets the | |||
number of GPUs per worker to 4 and points to the discovery script. Change this for your setup. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this doesn't match below now. we can leave this 4 or if you think its confusing change the text.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I was unsure of whether to change that part of the example or not. It was a little confusing to me, but I think that was just me :-) I will change it back to 4.
Signed-off-by: Sameer Raheja <sraheja@nvidia.com>
build |
* Fix and edit docs for standalone mode Signed-off-by: Sameer Raheja <sraheja@nvidia.com> * Revert the example back to four GPUs per worker Signed-off-by: Sameer Raheja <sraheja@nvidia.com>
* Fix and edit docs for standalone mode Signed-off-by: Sameer Raheja <sraheja@nvidia.com> * Revert the example back to four GPUs per worker Signed-off-by: Sameer Raheja <sraheja@nvidia.com>
Signed-off-by: Sameer Raheja sraheja@nvidia.com
Fixed getting started on prem document for standalone mode to include
spark.executor.resource.gpu.amount
for the spark-shell example. Modified number of GPUs for the worker in the example to 1 instead of 4.