release-26.2: server: TestDrain failed

[github-actions]

server.TestDrain failed on release-26.2 @ e45d572891ae68c6a062b8f85cbeaa6f51a22e92:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked]
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1e9182a]

Stack:

goroutine 14871 [running]:
testing.tRunner.func1.2({0x6236720, 0xbe14080})
	GOROOT/src/testing/testing.go:1872 +0x237
testing.tRunner.func1()
	GOROOT/src/testing/testing.go:1875 +0x35b
panic({0x6236720?, 0xbe14080?})
	GOROOT/src/runtime/panic.go:783 +0x132
github.com/cockroachdb/cockroach/pkg/util/grpcutil.IsClosedConnection({0x0, 0x0})
	pkg/util/grpcutil/grpc_util.go:94 +0xea
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain.func3()
	pkg/server/drain_test.go:130 +0x65
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError.func1()
	pkg/testutils/soon.go:76 +0x42
github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration(0xa7a358200, 0xc002a8fd40)
	pkg/util/retry/retry.go:362 +0xbe
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError(0xc019153ec8, 0xa7a358200)
	pkg/testutils/soon.go:82 +0x56
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithin({0x7c29930, 0xc01f3c5410}, 0xc019153ec8, 0xa7a358200)
	pkg/testutils/soon.go:59 +0x58
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon({0x7c29930, 0xc01f3c5410}, 0xc019153ec8)
	pkg/testutils/soon.go:38 +0x45
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain(0xc013794a80, 0x0)
	pkg/server/drain_test.go:128 +0x3b6
github.com/cockroachdb/cockroach/pkg/server_test.TestDrain.func1(0x5d1ed3?, 0x53?)
	pkg/server/drain_test.go:40 +0x13
github.com/cockroachdb/cockroach/pkg/testutils.RunValues[...].func1()
	pkg/testutils/subtest.go:23 +0x1b
testing.tRunner(0xc013794a80, 0xc013beb220)
	GOROOT/src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 14866
	GOROOT/src/testing/testing.go:1997 +0x465

Log preceding fatal error

=== RUN   TestDrain
    test_log_scope.go:172: test logs captured to: outputs.zip/logTestDrain172011007
    test_log_scope.go:82: use -show-logs to present logs inline
--- FAIL: TestDrain (24.22s)

Parameters:

• attempt=1
• run=1
• shard=11

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/kv-triage @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-61751

[blathers-crl]

This issue has multiple T-eam labels. Please make sure it only has one, or else issue synchronization will not work correctly.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

[blathers-crl]

This issue has multiple T-eam labels. Please make sure it only has one, or else issue synchronization will not work correctly.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.}

[cockroach-teamcity]

server.TestDrain failed on release-26.2 @ cc34a3eefe9f9548beaa55ced23d3503332bac20:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked]
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1e919ea]

Stack:

goroutine 2633 [running]:
testing.tRunner.func1.2({0x6236aa0, 0xbe15080})
	GOROOT/src/testing/testing.go:1872 +0x237
testing.tRunner.func1()
	GOROOT/src/testing/testing.go:1875 +0x35b
panic({0x6236aa0?, 0xbe15080?})
	GOROOT/src/runtime/panic.go:783 +0x132
github.com/cockroachdb/cockroach/pkg/util/grpcutil.IsClosedConnection({0x0, 0x0})
	pkg/util/grpcutil/grpc_util.go:94 +0xea
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain.func3()
	pkg/server/drain_test.go:130 +0x65
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError.func1()
	pkg/testutils/soon.go:76 +0x42
github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration(0xa7a358200, 0xc00322fd40)
	pkg/util/retry/retry.go:362 +0xbe
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError(0xc0165afec8, 0xa7a358200)
	pkg/testutils/soon.go:82 +0x56
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithin({0x7c29d50, 0xc00df62b10}, 0xc0165afec8, 0xa7a358200)
	pkg/testutils/soon.go:59 +0x58
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon({0x7c29d50, 0xc00df62b10}, 0xc0165afec8)
	pkg/testutils/soon.go:38 +0x45
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain(0xc003e80000, 0x0)
	pkg/server/drain_test.go:128 +0x3b6
github.com/cockroachdb/cockroach/pkg/server_test.TestDrain.func1(0x5d1ed3?, 0x53?)
	pkg/server/drain_test.go:40 +0x13
github.com/cockroachdb/cockroach/pkg/testutils.RunValues[...].func1()
	pkg/testutils/subtest.go:23 +0x1b
testing.tRunner(0xc003e80000, 0xc003802b40)
	GOROOT/src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 2628
	GOROOT/src/testing/testing.go:1997 +0x465

Log preceding fatal error

=== RUN   TestDrain
    test_log_scope.go:172: test logs captured to: outputs.zip/logTestDrain2673471130
    test_log_scope.go:82: use -show-logs to present logs inline
--- FAIL: TestDrain (4.37s)

Parameters:

• attempt=1
• run=10
• shard=11

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

[cockroach-teamcity]

server.TestDrain failed on release-26.2 @ 6e1e2f7b00d31726cbc0d3e4265bf0ae4361aab6:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked]
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1e919ea]

Stack:

goroutine 14200 [running]:
testing.tRunner.func1.2({0x623b2a0, 0xbe1c080})
	GOROOT/src/testing/testing.go:1872 +0x237
testing.tRunner.func1()
	GOROOT/src/testing/testing.go:1875 +0x35b
panic({0x623b2a0?, 0xbe1c080?})
	GOROOT/src/runtime/panic.go:783 +0x132
github.com/cockroachdb/cockroach/pkg/util/grpcutil.IsClosedConnection({0x0, 0x0})
	pkg/util/grpcutil/grpc_util.go:94 +0xea
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain.func3()
	pkg/server/drain_test.go:130 +0x65
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError.func1()
	pkg/testutils/soon.go:76 +0x42
github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration(0xa7a358200, 0xc019ad9d40)
	pkg/util/retry/retry.go:362 +0xbe
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError(0xc01be6fec8, 0xa7a358200)
	pkg/testutils/soon.go:82 +0x56
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithin({0x7c2f1d0, 0xc0145b8c90}, 0xc01be6fec8, 0xa7a358200)
	pkg/testutils/soon.go:59 +0x58
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon({0x7c2f1d0, 0xc0145b8c90}, 0xc01be6fec8)
	pkg/testutils/soon.go:38 +0x45
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain(0xc0115b6c40, 0x1)
	pkg/server/drain_test.go:128 +0x3b6
github.com/cockroachdb/cockroach/pkg/server_test.TestDrain.func1(0x5d1ed3?, 0x53?)
	pkg/server/drain_test.go:40 +0x13
github.com/cockroachdb/cockroach/pkg/testutils.RunValues[...].func1()
	pkg/testutils/subtest.go:23 +0x1b
testing.tRunner(0xc0115b6c40, 0xc002a14000)
	GOROOT/src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 2684
	GOROOT/src/testing/testing.go:1997 +0x465

Log preceding fatal error

=== RUN   TestDrain
    test_log_scope.go:172: test logs captured to: outputs.zip/logTestDrain197622307
    test_log_scope.go:82: use -show-logs to present logs inline
--- FAIL: TestDrain (29.54s)

Parameters:

• attempt=1
• run=3
• shard=11

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

[cockroach-teamcity]

server.TestDrain failed on release-26.2 @ 6e1e2f7b00d31726cbc0d3e4265bf0ae4361aab6:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked]
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x31be9e9]

Stack:

goroutine 3169 [running]:
testing.tRunner.func1.2({0x9eac900, 0x105f20c0})
	GOROOT/src/testing/testing.go:1872 +0x419
testing.tRunner.func1()
	GOROOT/src/testing/testing.go:1875 +0x683
panic({0x9eac900?, 0x105f20c0?})
	GOROOT/src/runtime/panic.go:783 +0x132
github.com/cockroachdb/cockroach/pkg/util/grpcutil.IsClosedConnection({0x0, 0x0})
	pkg/util/grpcutil/grpc_util.go:94 +0x189
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain.func3()
	pkg/server/drain_test.go:130 +0xd3
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError.func1()
	pkg/testutils/soon.go:76 +0x58
github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration(0x34630b8a00, 0xc010909c50)
	pkg/util/retry/retry.go:362 +0x176
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError(0xc01d309e20, 0x34630b8a00)
	pkg/testutils/soon.go:82 +0xff
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithin({0xc03a010, 0xc013be6690}, 0xc01d309e20, 0x34630b8a00)
	pkg/testutils/soon.go:59 +0x72
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon({0xc03a010, 0xc013be6690}, 0xc01d309e20)
	pkg/testutils/soon.go:38 +0x55
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain(0xc011364a80, 0x0)
	pkg/server/drain_test.go:128 +0x609
github.com/cockroachdb/cockroach/pkg/server_test.TestDrain.func1(0xc011364a80, 0x0)
	pkg/server/drain_test.go:40 +0x34
github.com/cockroachdb/cockroach/pkg/testutils.RunValues[...].func1()
	pkg/testutils/subtest.go:23 +0x42
testing.tRunner(0xc011364a80, 0xc003b70560)
	GOROOT/src/testing/testing.go:1934 +0x21d
created by testing.(*T).Run in goroutine 3164
	GOROOT/src/testing/testing.go:1997 +0x9d3

Log preceding fatal error

=== RUN   TestDrain
    test_log_scope.go:172: test logs captured to: outputs.zip/logTestDrain1709058087
    test_log_scope.go:82: use -show-logs to present logs inline
--- FAIL: TestDrain (30.89s)

Parameters:

• attempt=1
• race=true
• run=2
• shard=11

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

[cockroach-teamcity]

server.TestDrain failed on release-26.2 @ de4d315506ea3d4a6c86ab921d54cd1395b7f349:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered, repanicked]
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x1e94c8a]

Stack:

goroutine 299617 [running]:
testing.tRunner.func1.2({0x623e600, 0xbdf8090})
	GOROOT/src/testing/testing.go:1872 +0x237
testing.tRunner.func1()
	GOROOT/src/testing/testing.go:1875 +0x35b
panic({0x623e600?, 0xbdf8090?})
	GOROOT/src/runtime/panic.go:783 +0x132
github.com/cockroachdb/cockroach/pkg/util/grpcutil.IsClosedConnection({0x0, 0x0})
	pkg/util/grpcutil/grpc_util.go:94 +0xea
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain.func3()
	pkg/server/drain_test.go:130 +0x65
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError.func1()
	pkg/testutils/soon.go:76 +0x42
github.com/cockroachdb/cockroach/pkg/util/retry.ForDuration(0x34630b8a00, 0xc019a89d40)
	pkg/util/retry/retry.go:362 +0xbe
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithinError(0xc027117ec8, 0x34630b8a00)
	pkg/testutils/soon.go:82 +0x56
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsWithin({0x7c1b210, 0xc00181fd10}, 0xc027117ec8, 0x34630b8a00)
	pkg/testutils/soon.go:59 +0x58
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon({0x7c1b210, 0xc00181fd10}, 0xc027117ec8)
	pkg/testutils/soon.go:38 +0x45
github.com/cockroachdb/cockroach/pkg/server_test.doTestDrain(0xc00294a8c0, 0x0)
	pkg/server/drain_test.go:128 +0x3b6
github.com/cockroachdb/cockroach/pkg/server_test.TestDrain.func1(0x5d1cf3?, 0x73?)
	pkg/server/drain_test.go:40 +0x13
github.com/cockroachdb/cockroach/pkg/testutils.RunValues[...].func1()
	pkg/testutils/subtest.go:23 +0x1b
testing.tRunner(0xc00294a8c0, 0xc012262280)
	GOROOT/src/testing/testing.go:1934 +0xea
created by testing.(*T).Run in goroutine 299594
	GOROOT/src/testing/testing.go:1997 +0x465

Log preceding fatal error

=== RUN   TestDrain
    test_log_scope.go:172: test logs captured to: outputs.zip/logTestDrain3458897083
    test_log_scope.go:82: use -show-logs to present logs inline
--- FAIL: TestDrain (8.43s)

Parameters:

• attempt=1
• deadlock=true
• run=2
• shard=11

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!