Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tispark: update title level and description #554

Merged
merged 1 commit into from
Jul 30, 2018
Merged

tispark: update title level and description #554

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 8 additions & 8 deletions tispark/tispark-user-guide.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,14 +29,14 @@ TiSpark is an OLAP solution that runs Spark SQL directly on TiKV, the distribute

## Recommended configuration

### Deployment of TiKV and TiSpark clusters
This section describes the configuration of independent deployment of TiKV and TiSpark, independent deployment of Spark and TiSpark, and hybrid deployment of TiKV and TiSpark.

#### Configuration of the TiKV cluster
### Configuration of independent deployment of TiKV and TiSpark

For independent deployment of TiKV and TiSpark, it is recommended to refer to the following recommendations:

For independent deployment of TiKV and TiSpark, it is recommended to refer to the following recommendations

+ Hardware configuration
- For general purposes, please refer to the TiDB and TiKV hardware configuration [recommendations](https://github.com/pingcap/docs/blob/master/op-guide/recommendation.md#deployment-recommendations).
- For general purposes, please refer to the TiDB and TiKV hardware configuration [recommendations](../op-guide/recommendation.md#deployment-recommendations).
- If the usage is more focused on the analysis scenarios, you can increase the memory of the TiKV nodes to at least 64G.

+ TiKV parameters (default)
Expand Down Expand Up @@ -67,7 +67,7 @@ For independent deployment of TiKV and TiSpark, it is recommended to refer to th
scheduler-worker-pool-size = 4
```

#### Configuration of the independent deployment of the Spark cluster and TiSpark cluster
### Configuration of independent deployment of Spark and TiSpark

See the [Spark official website](https://spark.apache.org/docs/latest/hardware-provisioning.html) for the detail hardware recommendations.

Expand All @@ -85,9 +85,9 @@ SPARK_WORKER_MEMORY = 32g
SPARK_WORKER_CORES = 8
```

#### Hybrid deployment configuration for TiSpark and TiKV clusters
### Configuration of hybrid deployment of TiKV and TiSpark

For the hybrid deployment of TiSpark and TiKV, add TiSpark required resources to the TiKV reserved resources, and allocate 25% of the memory for the system.
For the hybrid deployment of TiKV and TiSpark, add TiSpark required resources to the TiKV reserved resources, and allocate 25% of the memory for the system.

## Deploy the TiSpark cluster

Expand Down