Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

potiential deadlock found in CI #51738

Open
Tracked by #41316
lance6716 opened this issue Mar 13, 2024 · 0 comments
Open
Tracked by #41316

potiential deadlock found in CI #51738

lance6716 opened this issue Mar 13, 2024 · 0 comments
Labels
component/test severity/moderate sig/transaction SIG:Transaction type/bug The issue is confirmed as a bug.

Comments

@lance6716
Copy link
Contributor

Have been trying to lock it again for more than 20s

goroutine 2774267 lock 0xc027ada460

pkg/domain/domain.go:594 domain.(*Domain).Reload ??? <<<<<

pkg/domain/domain.go:593 domain.(*Domain).Reload ???

pkg/domain/domain.go:910 domain.(*Domain).loadSchemaInLoop ???

pkg/domain/domain.go:1283 domain.(*Domain).Init.func2 ???

pkg/util/wait_group_wrapper.go:99 util.(*WaitGroupEnhancedWrapper).Run.func1 ???



Here is what goroutine 2774071 doing now

goroutine 2774071 [select]:

github.com/tikv/client-go/v2/config/retry.(*Config).createBackoffFn.newBackoffFn.func2({0x6915c70, 0xc031cd89c0}, 0xffffffffffffffff)

	external/com_github_tikv_client_go_v2/config/retry/config.go:205 +0x505

github.com/tikv/client-go/v2/config/retry.(*Backoffer).BackoffWithCfgAndMaxSleep(0xc031c06bd0, 0xc001009530, 0x18?, {0x68e4e20, 0xc054f95a10})

	external/com_github_tikv_client_go_v2/config/retry/backoff.go:195 +0x66d

github.com/tikv/client-go/v2/config/retry.(*Backoffer).Backoff(0xc031c06bd0, 0xc001009530, {0x68e4e20, 0xc054f95a10})

	external/com_github_tikv_client_go_v2/config/retry/backoff.go:122 +0x251

github.com/tikv/client-go/v2/txnkv/txnsnapshot.(*KVSnapshot).get(0xc0310d5b00, {0x6915c70, 0xc031cd89c0}, 0xc031c06bd0, {0xc0298b5e90, 0x24, 0x29})

	external/com_github_tikv_client_go_v2/txnkv/txnsnapshot/snapshot.go:753 +0xe25

github.com/tikv/client-go/v2/txnkv/txnsnapshot.(*KVSnapshot).Get(0xc0310d5b00, {0x6915d50, 0x9e1fb80}, {0xc0298b5e90, 0x24, 0x29})

	external/com_github_tikv_client_go_v2/txnkv/txnsnapshot/snapshot.go:638 +0x3e5

github.com/pingcap/tidb/pkg/store/driver/txn.(*tikvSnapshot).Get(0xc031bd9440?, {0x6915d50?, 0x9e1fb80?}, {0xc0298b5e90?, 0x30?, 0x5b5dec0?})

	pkg/store/driver/txn/snapshot.go:60 +0x113

github.com/pingcap/tidb/pkg/structure.(*TxStructure).Get(0xc031bd9440, {0x918d600?, 0x30?, 0x5b5dec0?})

	pkg/structure/string.go:37 +0x5e

github.com/pingcap/tidb/pkg/structure.(*TxStructure).GetInt64(0x1?, {0x918d600?, 0xc031bd9440?, 0x918b250?})

	pkg/structure/string.go:46 +0x26

github.com/pingcap/tidb/pkg/meta.(*Meta).GetSchemaVersionWithNonEmptyDiff(0xc031cd8930)

	pkg/meta/meta.go:477 +0x45

github.com/pingcap/tidb/pkg/domain.(*Domain).loadInfoSchema(0xc027ada400, 0x5ef6f64?)

	pkg/domain/domain.go:237 +0x145

github.com/pingcap/tidb/pkg/domain.(*Domain).Reload(0xc027ada400)

	pkg/domain/domain.go:604 +0x1f1

github.com/pingcap/tidb/pkg/ddl.(*DefaultCallback).OnChanged(0xc00b599038, {0x0?, 0x0?})

	pkg/ddl/callback.go:141 +0xe4

github.com/pingcap/tidb/pkg/ddl.(*ddl).callHookOnChanged(0xc05f922120?, 0x69902c0?, {0x0?, 0x0?})

	pkg/ddl/ddl.go:1311 +0xe6

github.com/pingcap/tidb/pkg/ddl.(*ddl).dropIndex(0xc05f922120, {0x69902c0, 0xc00497fb00}, {{{0xc035ba159c, 0x8}, {0xc035ba159c, 0x8}}, {{0xc035ba15a5, 0x2}, {0xc035ba15a5, ...}}}, ...)

	pkg/ddl/ddl_api.go:7989 +0x8ea

github.com/pingcap/tidb/pkg/ddl.(*ddl).AlterTable(0xc05f922120, {0x6915c70, 0xc03689be60}, {0x69902c0, 0xc00497fb00}, 0xc035ba15a5?)

	pkg/ddl/ddl_api.go:3892 +0x11ee

github.com/pingcap/tidb/pkg/executor.(*DDLExec).executeAlterTable(0xc02ef3e900, {0x6915c70, 0xc03689be60}, 0xc02ef3a6c0)

	pkg/executor/ddl.go:388 +0x131

github.com/pingcap/tidb/pkg/executor.(*DDLExec).Next(0xc02ef3e900, {0x6915c70?, 0xc03689bdd0?}, 0x1?)

	pkg/executor/ddl.go:152 +0x2c7

github.com/pingcap/tidb/pkg/executor/internal/exec.Next({0x6915c70, 0xc03689bdd0}, {0x693f000, 0xc02ef3e900}, 0xc02ef22f00)

	pkg/executor/internal/exec/executor.go:404 +0x2fc

github.com/pingcap/tidb/pkg/executor.(*ExecStmt).next(0xc02e15b770, {0x6915c70, 0xc03689bdd0}, {0x693f000, 0xc02ef3e900}, 0x1d6259a?)

	pkg/executor/adapter.go:1198 +0x78

github.com/pingcap/tidb/pkg/executor.(*ExecStmt).handleNoDelayExecutor(0xc02e15b770, {0x6915c70?, 0xc03689bdd0?}, {0x693f000?, 0xc02ef3e900})

	pkg/executor/adapter.go:946 +0x3f3

github.com/pingcap/tidb/pkg/executor.(*ExecStmt).handleNoDelay(0xc02e15b770, {0x6915c70, 0xc03689bdd0}, {0x693f000?, 0xc02ef3e900?}, 0x0)

	pkg/executor/adapter.go:780 +0x2af

github.com/pingcap/tidb/pkg/executor.(*ExecStmt).Exec(0xc02e15b770, {0x6915c70, 0xc03689bdd0})

	pkg/executor/adapter.go:555 +0xf1c

github.com/pingcap/tidb/pkg/session.runStmt({0x6915c70, 0xc03689b9b0}, 0xc00497fb00, {0x6920ad0, 0xc02e15b770?})

	pkg/session/session.go:2373 +0x4a6

github.com/pingcap/tidb/pkg/session.(*session).ExecuteStmt(0xc00497fb00, {0x6915c70?, 0xc03689b9b0?}, {0x692c0b0, 0xc02ef3a6c0?})

	pkg/session/session.go:2242 +0x141c

github.com/pingcap/tidb/pkg/testkit.(*TestKit).ExecWithContext(0xc02b778d20, {0x6915c70, 0xc03689b9b0}, {0xc035ba1590, 0x27}, {0x0, 0x0, 0x0})

	pkg/testkit/testkit.go:365 +0x6d2

github.com/pingcap/tidb/pkg/testkit.(*TestKit).Exec(0x68f2080?, {0xc035ba1590, 0x27}, {0x0, 0x0, 0x0})

	pkg/testkit/testkit.go:338 +0x90

github.com/pingcap/tidb/tests/realtikvtest/addindextestutil.checkResult(0xc02b6a18c0, {0xc03cdebee0, 0xb}, 0x5f8ce29?, 0x0)

	tests/realtikvtest/addindextestutil/common.go:335 +0x685

github.com/pingcap/tidb/tests/realtikvtest/addindextestutil.TestOneColFrame(0xc02b6a18c0, {0xc008151f18, 0x3, 0x8251348?}, 0x6102bf8)

	tests/realtikvtest/addindextestutil/common.go:393 +0x5d0

tests/realtikvtest/addindextest/addindextest_test.TestPiTRCreateNonUniqueIndex(0xc00f498c00?)

	tests/realtikvtest/addindextest/pitr_test.go:31 +0x149

testing.tRunner(0xc019613040, 0x6102a10)

	GOROOT/src/testing/testing.go:1595 +0xff

created by testing.(*T).Run in goroutine 1

	GOROOT/src/testing/testing.go:1648 +0x3ad

https://do.pingcap.net/jenkins/blue/organizations/jenkins/pingcap%2Ftidb%2Fghpr_check2/detail/ghpr_check2/5675/pipeline

@lance6716 lance6716 added the type/bug The issue is confirmed as a bug. label Mar 13, 2024
@jebter jebter added the sig/transaction SIG:Transaction label Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/test severity/moderate sig/transaction SIG:Transaction type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

2 participants