Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

drainer error #7744

Closed
sakufo opened this issue Sep 19, 2018 · 1 comment
Closed

drainer error #7744

sakufo opened this issue Sep 19, 2018 · 1 comment
Labels
type/question The issue belongs to a question.

Comments

@sakufo
Copy link

sakufo commented Sep 19, 2018

After using the drainer output to the downstream mysql prompt the following error, check the downstream database, no data updates.
please help.

2018/09/19 16:00:53 server.go:81: [info] clusterID of drainer server is 6580197893879686949
2018/09/19 16:00:53 checkpoint.go:48: [info] initialize mysql type checkpoint binlog commitTS = 403001324297519112 and positions = map[] with config &{Db:0xc0002ca8c0 Schema:tidb_binlog Table:checkpoint ClusterID:6580197893879686949 InitialCommitTS:403001324297519112 CheckPointFile:data.drainer/savepoint}
2018/09/19 16:00:53 offset_seeker.go:82: [info] kafka consumer version 0.8.2.0
2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.29:9092
2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.29:9092 (unregistered)
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.31:9092
2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.31:9092 (unregistered)
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:00:54 syncer.go:115: [info] [prepare] begin to construct schema infomation in syncer
2018/09/19 16:01:04 collector.go:365: [info] commit ts 403001324297519112's safe commit ts is 403001009724719112
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 offset.go:115: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, oldest offset 0, newest offset 7111
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 offset.go:120: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, offset 1374
2018/09/19 16:01:04 collector.go:226: [info] node VM_8_2_centos:8250 get save point {0 1374}
2018/09/19 16:01:04 kafka.go:80: [info] kafka consumer version 0.8.2.0
2018/09/19 16:01:04 client.go:120: [sarama] Initializing new client
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.24:9092
2018/09/19 16:01:04 broker.go:148: [sarama] Connected to broker at 10.10.8.24:9092 (unregistered)
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:01:04 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:01:04 pump.go:433: [info] [pump VM_8_2_centos:8250] consume from topic 6580197893879686949_VM_8_2_centos_8250 partition 0 offset 1374
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0

Question

Before asking a question, make sure you have:

@sakufo
Copy link
Author

sakufo commented Sep 19, 2018

Find the reason, the pump startup sequence problem
Since my Pump is post-deployed, I started the Pump directly after deployment and ignored the instructions in the documentation to start Pump and then start Tidb. Restart the tidb with ansible-playbook.

@sakufo sakufo closed this as completed Sep 19, 2018
@lysu lysu added the type/question The issue belongs to a question. label Sep 20, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/question The issue belongs to a question.
Projects
None yet
Development

No branches or pull requests

2 participants