Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dev, v3.0, v2.1: add safe-mode config in binlog reparo doc #1422

Closed
wants to merge 12 commits into from
Closed

dev, v3.0, v2.1: add safe-mode config in binlog reparo doc #1422

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
f4a5da6
dev/v3.0/v2.1: add safe-mode config in binlog reparo
junlan-zhang Aug 6, 2019
1d187b9
dev/v3.0/v2.1: add hyphen for safe-mode
junlan-zhang Aug 6, 2019
577d335
dev/v3.0/v2.1: delete unnecessary trailing-spaces
junlan-zhang Aug 6, 2019
942c1d4
dev/v3.0/v2.1: fix ul-indent
junlan-zhang Aug 6, 2019
c5fc36a
dev/v3.0/v2.1: fix ul-indent
junlan-zhang Aug 6, 2019
5eff694
Apply suggestions from code review
junlan-zhang Aug 7, 2019
eae5291
dev/v3.0/v2.1: fix format errors
junlan-zhang Aug 7, 2019
b5b96cb
Merge branch 'dev/v3.0/v2.1-add-safe-mode-config-in-binlog-reparo' of…
junlan-zhang Aug 7, 2019
9cb4e0e
Update dev/reference/tools/tidb-binlog/reparo.md
junlan-zhang Aug 8, 2019
87d37f5
dev/v3.0/v2.1: delete quotation marks
junlan-zhang Aug 8, 2019
870b912
Merge branch 'dev/v3.0/v2.1-add-safe-mode-config-in-binlog-reparo' of…
junlan-zhang Aug 8, 2019
7fe65f3
Merge remote-tracking branch 'upstream/master' into dev/v3.0/v2.1-add…
junlan-zhang Aug 8, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 8 additions & 8 deletions dev/how-to/maintain/backup-and-restore.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,15 +53,15 @@ To quickly backup and restore data (especially large amounts of data), refer to

- The total size of the exported files is 214G. A single table has 8 columns and 2 billion rows.
- The cluster topology:
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
- 4 TiDB instances
- 3 PD instances
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
junlan-zhang marked this conversation as resolved.
Show resolved Hide resolved
- 4 TiDB instances
- 3 PD instances
- The configuration of each node:
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- The `-F` parameter of `mydumper` is set to 16 and the `-t` parameter of `loader` is set to 64.

**Results**: It takes 11 hours to import all the data, which is 19.4G/hour.
Expand Down
7 changes: 7 additions & 0 deletions dev/reference/tools/tidb-binlog/reparo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,8 @@ Usage of Reparo:
Specifies the time point of finishing the recovery process.
Format: "2006-01-02 15:04:05"
If it is not set, the recovery process ends up with the last binlog file.
-safe-mode bool
Specifies whether to enable safe mode. When enabled, it supports repeated synchronization.
junlan-zhang marked this conversation as resolved.
Show resolved Hide resolved
```

### Description of the configuration file
Expand Down Expand Up @@ -81,6 +83,11 @@ log-level = "info"
# If it is set to "mysql", you need to configure `host`, `port`, `user` and `password` in [dest-db].
dest-type = "mysql"

# Safe-mode configuration
# Value: "true/false" ("false" by default)
junlan-zhang marked this conversation as resolved.
Show resolved Hide resolved
# If it is set to "true", Reparo splits the update statement into a delete plus replace statement.
junlan-zhang marked this conversation as resolved.
Show resolved Hide resolved
safe-mode = false
junlan-zhang marked this conversation as resolved.
Show resolved Hide resolved

# `replicate-do-db` and `replicate-do-table` specify the database and table to be recovered.
# `replicate-do-db` has priority over `replicate-do-table`.
# You can use a regular expression for configuration. The regular expression should start with "~".
Expand Down
16 changes: 8 additions & 8 deletions v2.1/how-to/maintain/backup-and-restore.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,15 +53,15 @@ To quickly backup and restore data (especially large amounts of data), refer to

- The total size of the exported files is 214G. A single table has 8 columns and 2 billion rows.
- The cluster topology:
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
- 4 TiDB instances
- 3 PD instances
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
- 4 TiDB instances
- 3 PD instances
- The configuration of each node:
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- The `-F` parameter of `mydumper` is set to 16 and the `-t` parameter of `loader` is set to 64.

**Results**: It takes 11 hours to import all the data, which is 19.4G/hour.
Expand Down
7 changes: 7 additions & 0 deletions v2.1/reference/tools/tidb-binlog/reparo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,8 @@ Usage of Reparo:
Specifies the time point of finishing the recovery process.
Format: "2006-01-02 15:04:05"
If it is not set, the recovery process ends up with the last binlog file.
-safe-mode bool
Specifies whether to enable safe mode. When enabled, it supports repeated synchronization.
```

### Description of the configuration file
Expand Down Expand Up @@ -81,6 +83,11 @@ log-level = "info"
# If it is set to "mysql", you need to configure `host`, `port`, `user` and `password` in [dest-db].
dest-type = "mysql"

# Safe-mode configuration
# Value: "true/false" ("false" by default)
# If it is set to "true", Reparo splits the update statement into a delete plus replace statement.
safe-mode = false

# `replicate-do-db` and `replicate-do-table` specify the database and table to be recovered.
# `replicate-do-db` has priority over `replicate-do-table`.
# You can use a regular expression for configuration. The regular expression should start with "~".
Expand Down
16 changes: 8 additions & 8 deletions v3.0/how-to/maintain/backup-and-restore.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,15 +54,15 @@ To quickly backup and restore data (especially large amounts of data), refer to

- The total size of the exported files is 214G. A single table has 8 columns and 2 billion rows.
- The cluster topology:
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
- 4 TiDB instances
- 3 PD instances
- 12 TiKV instances: 4 nodes, 3 TiKV instances per node
- 4 TiDB instances
- 3 PD instances
- The configuration of each node:
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- CPU: Intel Xeon E5-2670 v3 @ 2.30GHz
- 48 vCPU [2 x 12 physical cores]
- Memory: 128G
- Disk: sda [raid 10, 300G] sdb[RAID 5, 2T]
- Operating System: CentOS 7.3
- The `-F` parameter of `mydumper` is set to 16 and the `-t` parameter of `loader` is set to 64.

**Results**: It takes 11 hours to import all the data, which is 19.4G/hour.
Expand Down
7 changes: 7 additions & 0 deletions v3.0/reference/tools/tidb-binlog/reparo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,8 @@ Usage of Reparo:
Specifies the time point of finishing the recovery process.
Format: "2006-01-02 15:04:05"
If it is not set, the recovery process ends up with the last binlog file.
-safe-mode bool
Specifies whether to enable safe mode. When enabled, it supports repeated synchronization.
```

### Description of the configuration file
Expand Down Expand Up @@ -82,6 +84,11 @@ log-level = "info"
# If it is set to "mysql", you need to configure `host`, `port`, `user` and `password` in [dest-db].
dest-type = "mysql"

# Safe-mode configuration
# Value: "true/false" ("false" by default)
# If it is set to "true", Reparo splits the update statement into a delete plus replace statement.
safe-mode = false

# `replicate-do-db` and `replicate-do-table` specify the database and table to be recovered.
# `replicate-do-db` has priority over `replicate-do-table`.
# You can use a regular expression for configuration. The regular expression should start with "~".
Expand Down