sentry: coster.go:565: node sort with MaxCost added to the memo (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).Compute... #95729

cockroach-teamcity · 2023-01-24T11:45:05Z

This issue was autofiled by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry link: https://sentry.io/organizations/cockroach-labs/issues/3894039000/?referrer=webhooks_plugin

Panic message:

coster.go:565: node sort with MaxCost added to the memo
(1) assertion failure
Wraps: (2) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).ComputeCost
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/coster.go:565
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeEnforcer
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:690
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).enforceProps
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:652
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:555
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeExpr
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:291
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:570
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).optimizeGroup
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:515
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*Optimizer).Optimize
| github.com/cockroachdb/cockroach/pkg/sql/opt/xform/optimizer.go:261
| github.com/cockroachdb/cockroach/pkg/sql.(*optPlanningCtx).buildExecMemo
| github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:574
| github.com/cockroachdb/cockroach/pkg/sql.(*planner).makeOptimizerPlan
| github.com/cockroachdb/cockroach/pkg/sql/plan_opt.go:231
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).makeExecPlan
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1432
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1058
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:687
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func1
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:129
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:2382
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt
| github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:128
Wraps: (3) node sort with MaxCost added to the memo
Error types: (1) *assert.withAssertionFailure (2) *withstack.withStack (3) *errutil.leafError
-- report composition:
*errutil.leafError: node sort with MaxCost added to the memo
coster.go:565: *withstack.withStack (top exception)
*assert.withAssertionFailure

Stacktrace (expand for inline code snippets):

cockroach/pkg/sql/opt/xform/coster.go

Lines 564 to 566 in 77667a1

    
           	// unknown node. We'd rather detect this early. 
        
           	panic(errors.AssertionFailedf("node %s with MaxCost added to the memo", redact.Safe(candidate.Op()))) 
        
           }

in pkg/sql/opt/xform.(*coster).ComputeCost

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 689 to 691 in 77667a1

    
           // added. 
        
           cost := innerState.cost + o.coster.ComputeCost(enforcer, enforcerProps) 
        
           o.ratchetCost(state, enforcer, cost)

in pkg/sql/opt/xform.(*Optimizer).optimizeEnforcer

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 651 to 653 in 77667a1

    
           memberProps := BuildChildPhysicalProps(o.mem, enforcer, 0, required) 
        
           fullyOptimized = o.optimizeEnforcer(state, enforcer, required, member, memberProps)

in pkg/sql/opt/xform.(*Optimizer).enforceProps

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 554 to 556 in 77667a1

    
           // of requiring one of the merge join children to be sorted. 
        
           fullyOptimized = o.enforceProps(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 290 to 292 in 77667a1

    
           case memo.RelExpr: 
        
           	state := o.optimizeGroup(t, required) 
        
           	return state.cost, state.fullyOptimized

in pkg/sql/opt/xform.(*Optimizer).optimizeExpr

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 569 to 571 in 77667a1

    
           // Optimize the child with respect to those properties. 
        
           childCost, childOptimized := o.optimizeExpr(member.Child(i), childRequired)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 514 to 516 in 77667a1

    
           // Optimize the group member with respect to the required properties. 
        
           memberOptimized := o.optimizeGroupMember(state, member, required)

in pkg/sql/opt/xform.(*Optimizer).optimizeGroup

cockroach/pkg/sql/opt/xform/optimizer.go

Lines 260 to 262 in 77667a1

    
           rootProps := o.mem.RootProps() 
        
           o.optimizeGroup(root, rootProps)

in pkg/sql/opt/xform.(*Optimizer).Optimize

cockroach/pkg/sql/plan_opt.go

Lines 573 to 575 in 77667a1

    
           if _, isCanned := opc.p.stmt.AST.(*tree.CannedOptPlan); !isCanned { 
        
           	if _, err := opc.optimizer.Optimize(); err != nil { 
        
           		return nil, err

in pkg/sql.(*optPlanningCtx).buildExecMemo

cockroach/pkg/sql/plan_opt.go

Lines 230 to 232 in 77667a1

    
           execMemo, err := opc.buildExecMemo(ctx) 
        
           if err != nil {

in pkg/sql.(*planner).makeOptimizerPlan

cockroach/pkg/sql/conn_executor_exec.go

Lines 1431 to 1433 in 77667a1

    
           func (ex *connExecutor) makeExecPlan(ctx context.Context, planner *planner) error { 
        
           	if err := planner.makeOptimizerPlan(ctx); err != nil { 
        
           		log.VEventf(ctx, 1, "optimizer plan failed: %v", err)

in pkg/sql.(*connExecutor).makeExecPlan

cockroach/pkg/sql/conn_executor_exec.go

Lines 1057 to 1059 in 77667a1

    
           // between here and there needs to happen even if there's an error. 
        
           err := ex.makeExecPlan(ctx, planner) 
        
           // We'll be closing the plan manually below after execution; this

in pkg/sql.(*connExecutor).dispatchToExecutionEngine

cockroach/pkg/sql/conn_executor_exec.go

Lines 686 to 688 in 77667a1

    
           if err := ex.dispatchToExecutionEngine(stmtCtx, p, res); err != nil { 
        
           	stmtThresholdSpan.Finish()

in pkg/sql.(*connExecutor).execStmtInOpenState

cockroach/pkg/sql/conn_executor_exec.go

Lines 128 to 130 in 77667a1

    
           err = ex.execWithProfiling(ctx, ast, prepared, func(ctx context.Context) error { 
        
           	ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, prepared, pinfo, res, canAutoCommit) 
        
           	return err

in pkg/sql.(*connExecutor).execStmt.func1

cockroach/pkg/sql/conn_executor_exec.go

Lines 2381 to 2383 in 77667a1

    
           } else { 
        
           	err = op(ctx) 
        
           }

in pkg/sql.(*connExecutor).execWithProfiling

cockroach/pkg/sql/conn_executor_exec.go

Lines 127 to 129 in 77667a1

    
           case stateOpen: 
        
           	err = ex.execWithProfiling(ctx, ast, prepared, func(ctx context.Context) error { 
        
           		ev, payload, err = ex.execStmtInOpenState(ctx, parserStmt, prepared, pinfo, res, canAutoCommit)

in pkg/sql.(*connExecutor).execStmt

pkg/sql/opt/xform/coster.go in pkg/sql/opt/xform.(*coster).ComputeCost at line 565
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeEnforcer at line 690
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).enforceProps at line 652
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 555
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeExpr at line 291
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroupMember at line 570
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).optimizeGroup at line 515
pkg/sql/opt/xform/optimizer.go in pkg/sql/opt/xform.(*Optimizer).Optimize at line 261
pkg/sql/plan_opt.go in pkg/sql.(*optPlanningCtx).buildExecMemo at line 574
pkg/sql/plan_opt.go in pkg/sql.(*planner).makeOptimizerPlan at line 231
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).makeExecPlan at line 1432
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 1058
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 687
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func1 at line 129
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 2382
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt at line 128

Tag	Value
Cockroach Release	`v22.2.0`
Cockroach SHA:	`77667a1`
Platform	linux amd64
Distribution	CCL
Environment	v22.2.0
Command	start-single-node
Go Version	``
# of CPUs
# of Goroutines

Jira issue: CRDB-23694

The text was updated successfully, but these errors were encountered:

yuzefovich · 2023-03-06T06:04:40Z

dup of #95728

cockroach-teamcity added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-sentry Originated from an in-the-wild panic report. labels Jan 24, 2023

yuzefovich closed this as completed Mar 6, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sentry: coster.go:565: node sort with MaxCost added to the memo (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).Compute... #95729

sentry: coster.go:565: node sort with MaxCost added to the memo (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).Compute... #95729

cockroach-teamcity commented Jan 24, 2023 •

edited by cockroach-jira-scripts

Loading

yuzefovich commented Mar 6, 2023

sentry: coster.go:565: node sort with MaxCost added to the memo (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).Compute... #95729

sentry: coster.go:565: node sort with MaxCost added to the memo (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/opt/xform.(*coster).Compute... #95729

Comments

cockroach-teamcity commented Jan 24, 2023 • edited by cockroach-jira-scripts Loading

yuzefovich commented Mar 6, 2023

cockroach-teamcity commented Jan 24, 2023 •

edited by cockroach-jira-scripts

Loading