-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Extended the FAQ #401
Extended the FAQ #401
Conversation
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
build |
docs/FAQ.md
Outdated
|
||
### What parts of Apache Spark are accelerated? | ||
|
||
Currently, A limited set of SQL and DataFrame operations are supported, please see the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
'a limited set'
docs/FAQ.md
Outdated
|
||
The RAPIDS Accelerator for Apache Spark requires version 3.0.0 of Apache Spark. Because the plugin | ||
replaces parts of the physical plan that Apache Spark considers to be internal the code for those | ||
plans can change even between bug fix releases. As a part of our process we try to stay on top of |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nit. Comma after process
docs/FAQ.md
Outdated
|
||
### What is the road-map like? | ||
|
||
Please take a look at the github repository https://github.com/nvidia/spark-rapids The have issue |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
May need to reword this a bit
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We just got a question about speculative execution and the plugin if you think it is worth mentioning in this FAQ. #400
docs/FAQ.md
Outdated
|
||
### What is the road-map like? | ||
|
||
Please take a look at the github repository https://github.com/nvidia/spark-rapids The have issue |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please take a look at the github repository https://github.com/nvidia/spark-rapids The have issue | |
Please take a look at the [github repository](https://github.com/nvidia/spark-rapids) which has issue |
docs/FAQ.md
Outdated
be problematic. In general if you are going to do 30 seconds or more of processing within a single | ||
session the overhead can be amortized. | ||
|
||
### Why is the size of my output Parquet/Orc file different? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
### Why is the size of my output Parquet/Orc file different? | |
### Why is the size of my output Parquet/ORC file different? |
docs/FAQ.md
Outdated
|
||
We have not evaluated the performance yet. DeltaEngine is not open source, so any analysis needs to | ||
be done with Databricks in some form. When DeltaEngine is generally available if the terms of | ||
service allow it we will look into doing a comparison. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
service allow it we will look into doing a comparison. | |
service allow it, we will look into doing a comparison. |
docs/FAQ.md
Outdated
|
||
There is no limit on the number of tasks per executor that you can run. Generally we recommend 2 to | ||
6 tasks per executor and 1 GPU per executor. The GPU typically benefits from having 2 tasks run | ||
in (parallel)[configs.md#sql.concurrentGpuTasks] on it at a time, assuming your GPU has enough |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This link isn't rendering for some reason (the parallel
one)
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
build |
Thanks for the reviews I think I have addressed all of the comments. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @revans2
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
wow. ship it!
build |
* Extended the FAQ Signed-off-by: Robert (Bobby) Evans <bobby@apache.org> * Addressed review comments Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
* Extended the FAQ Signed-off-by: Robert (Bobby) Evans <bobby@apache.org> * Addressed review comments Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
* update the commands in the FLAdminAPI * update run destination to run number
Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
The extends the FAQ to include more questions that we have seen come up.