release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable #57032

halverneus · 2020-11-23T19:36:33Z

I'm not sure if this is part of the upgrade to 20.2.0 or some other reason that correlates in time, but I seem to have suddenly lost all foreign key references on our production servers.

Please describe the issue you observed, and any steps we can take to reproduce it:

Make a database using an older version and upgrade. This was noticed some time after the upgrade.

What did you do? Describe in your own words.

If possible, provide steps to reproduce the behavior:

Set up CockroachDB 3-node cluster and initialize the database.
Use the following SQL to setup the database for the errors below:

-- The various known types of machines.
CREATE TABLE IF NOT EXISTS machine_type (
    id INT NOT NULL PRIMARY KEY,
    name STRING NOT NULL UNIQUE
);

INSERT INTO machine_type (id, name) VALUES
    (0, 'unknown'),
    (1, 'known');

-- Machines and their associated information.
CREATE TABLE IF NOT EXISTS machine (
    id BYTES DEFAULT uuid_v4() PRIMARY KEY NOT NULL,
    machine_type INT NOT NULL,
    name STRING,
    FOREIGN KEY(machine_type) REFERENCES machine_type(id) ON UPDATE CASCADE ON DELETE CASCADE
);

Add some data.
Upgrade to CockroachDB 20.2.0.
Sudd

Expected behavior
Return results from query like normal.

Additional data / screenshots

root@:26257/fini> SELECT * from backup
-> ;
ERROR: internal error: missing fk back reference "fk_machine_id_ref_machine" to "backup" from "machine"
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1500: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:298: unwrapDescriptor()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:160: GetDescriptorByID()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:215: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:707: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:811: exec()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:706: Txn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:193: acquire()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:858: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128: doCall()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.
root@:26257/fini> SELECT * FROM machine;
ERROR: internal error: missing fk back reference "fk_machine_type_ref_machine_type" to "machine" from "machine_type"
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1500: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:298: unwrapDescriptor()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:160: GetDescriptorByID()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:215: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:707: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:811: exec()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:706: Txn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:193: acquire()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:858: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128: doCall()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.
root@:26257/fini> SELECT * FROM machine_type;
ERROR: internal error: missing fk forward reference "fk_machine_type_ref_machine_type" to "machine_type" from "machine"
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1519: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:298: unwrapDescriptor()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:160: GetDescriptorByID()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:215: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:707: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:811: exec()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:706: Txn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:193: acquire()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:858: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128: doCall()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.

If a node in your cluster encountered a fatal error, supply the contents of the
log directories (at minimum of the affected node(s), but preferably all nodes).

Note that log files can contain confidential information. Please continue
creating this issue, but contact support@cockroachlabs.com to submit the log
files in private.

If applicable, add screenshots to help explain your problem.

Environment:

CockroachDB version 20.2.0
Server OS: Ubuntu Bionic
Client app: cockroach sql

Additional context
What was the impact?

I'm unable to run queries against our production servers.

The text was updated successfully, but these errors were encountered:

blathers-crl · 2020-11-23T19:36:36Z

Hello, I am Blathers. I am here to help you get the issue triaged.

It looks like you have not filled out the issue in the format of any of our templates. To best assist you, we advise you to use one of these templates.

I have CC'd a few people who may be able to assist you:

@cockroachdb/bulk-io (found keywords: backup)
@nvanbenschoten (found keywords: kv)

If we have not gotten back to your issue within a few business days, you can try the following:

Join our community slack channel and ask on #cockroachdb.
Try find someone from here if you know they worked closely on the area and CC them.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan.}

halverneus · 2020-11-23T21:40:29Z

This affects only the foreign keys that were created originally in the database when the database version was 19.2.0. All foreign keys created in subsequent upgrades work perfectly fine. I tried to manually add the constraint and drop the constraint with no luck:

oot@:26257/fini> SELECT * FROM usr_permission LIMIT 1;
ERROR: internal error: missing fk forward reference "fk_permission_ref_usr_permission" to "usr_permission" from "usr"
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1519: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:298: unwrapDescriptor()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:160: GetDescriptorByID()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:215: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:707: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:811: exec()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:706: Txn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:193: acquire()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:858: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128: doCall()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.
root@:26257/fini> ALTER TABLE usr ADD CONSTRAINT fk_permission_ref_usr_permission FOREIGN KEY(permission) REFERENCES usr_permission(id) ON UPDATE CASCADE ON DELETE CASCADE;
ERROR: duplicate constraint name: "fk_permission_ref_usr_permission"
SQLSTATE: 42710
root@:26257/fini> ALTER TABLE usr DROP CONSTRAINT fk_permission_ref_usr_permission;
ERROR: internal error: missing fk back reference "fk_permission_ref_usr_permission" to "usr" from "usr_permission"
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1500: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/alter_table.go:577: startExec()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan.go:514: func2()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:119: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:298: visitInternal()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:86: visit()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/walk.go:50: walkPlan()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan.go:517: startExec()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/plan_node_to_row_source.go:125: Start()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/execinfra/processorsbase.go:774: Run()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/flowinfra/flow.go:392: Run()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:422: Run()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/distsql_running.go:991: PlanAndRun()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:1001: execWithDistSQLEngine()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:872: dispatchToExecutionEngine()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:639: execStmtInOpenState()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor_exec.go:114: execStmt()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1465: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1467: execCmd()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:1391: run()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/conn_executor.go:508: ServeConn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:626: func1()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.

jordanlewis · 2020-11-23T22:16:55Z

Hi @halverneus, thanks for the report. The detail about 19.2 is extra helpful. This is symptomatic of "descriptor corruption", a known issue caused by validation for table metadata becoming more strict in 20.2 and thus uncovering pre-existing inconsistencies. Your data is safe, but we'll need to repair the corrupted descriptors to recover the data.

Could you run cockroach debug doctor cluster --url=<cluster connection string> (you'll have to use a 20.2 cockroach binary for this) to connect to your running cluster and run checks against the metadata, and send the output to us? (This command isn't publicly documented, but cockroach debug doctor cluster --help provides more documentation, including flags for connecting to the cluster.)

Also, please send us a debug zip. Note that debug zips can have sensitive information, so please send it to us via email at sql-schema-team@cockroachlabs.com

halverneus · 2020-11-23T22:42:28Z

I ran it from inside one of the containers (I don't have an exposed CRDB port outside of the Docker Swarm cluster). This is what I got:

root@us1fini-svr001:/home/keytech# docker exec -it d7e0adaa1bc4 ./cockroach debug doctor cluster --certs-dir=/run/secrets
Examining 48 descriptors and 51 namespace entries...
   Table   2: ParentID   1, ParentSchemaID 29, Name 'namespace': not being dropped but no namespace entry found
   Table  30: ParentID   1, ParentSchemaID 29, Name 'namespace2': namespace entry {ParentID:1 ParentSchemaID:29 Name:namespace} not found in draining names
   Table  30: ParentID   1, ParentSchemaID 29, Name 'namespace2': could not find name in namespace table
   Table  62: ParentID  52, ParentSchemaID 29, Name 'backup': missing fk back reference "fk_machine_id_ref_machine" to "backup" from "machine"
Examining 0 running jobs...
ERROR: validation failed
Failed running "debug doctor cluster"

halverneus · 2020-11-23T22:53:20Z

The debug.zip has just been sent with the reference to this issue number in the subject and the body.

jordanlewis · 2020-11-23T23:15:27Z

Hi @halverneus, we had a Google group misconfiguration before, but it's resolved now. Could you please re-send your email.

halverneus · 2020-11-24T00:01:37Z

It has been resent. Thanks!

thoszhang · 2020-11-24T03:40:07Z

The issue turns out to be that in 20.2, we introduced a bug in transforming on-disk descriptors to a new representation that had been introduced in 19.2. We're passing in a oneLevelUncachedDescGetter to Validate (same as in the stack trace above):

cockroach/pkg/sql/alter_table.go

Line 578 in 150c591

    
           params.ctx, catalogkv.NewOneLevelUncachedDescGetter(params.p.Txn(), params.ExecCfg().Codec),

Since the oneLevelUncachedDescGetter passes a nil DescGetter for its reads one level down, when we read referenced descriptors while validating foreign keys, we ultimately pass nil into tabledesc.maybeFillInDescriptor, which causes the foreign key upgrade to be skipped entirely. So Validate sees no post-19.2 FK references and reports a violation.

To fix this for 20.2 in a minimally invasive way, the plan is to extend Validate to treat un-upgraded referenced descriptors as valid.

thoszhang · 2020-11-24T03:40:20Z

@halverneus We'll get back to you within a day or so about fixing this for your cluster specifically.

blathers-crl · 2020-11-24T03:54:48Z

Hi @lucy-zhang, please add branch-* labels to identify which branch(es) this release-blocker affects.

_{🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is otan.}

halverneus · 2020-11-24T18:08:34Z

I'm afraid I didn't. I've just been monitoring releases going to Docker Hub and changing the version in my Docker Swarm Compose files (and testing on another stack), so I wasn't aware there were any instructions before now. That is unfortunate, on my part.

jordanlewis · 2020-11-25T00:07:53Z

Hi @halverneus, we've merged a fix for this issue into our master branch and into our 20.2 release branch #57083. There will be a nightly build available tonight, and I'll update this issue when it's available. I highly recommend waiting for that nightly build.

halverneus · 2020-11-25T00:16:04Z

Thanks! I'll look forward to updating in the morning. I'm not seeing a nightly build tag on Docker Hub, so I'm guessing I'll need to build my own Docker image for the time being. I think I can manage that just fine.

jordanlewis · 2020-11-25T01:50:43Z

FYI, we decided to include this critical fix in the official 20.2.2 version, which will very likely be released tomorrow. We'll include a link to the release binary, along with its Docker image, when it's available.

halverneus · 2020-11-25T01:54:25Z

Awesome! Even better! Thank you so very much!

halverneus · 2020-11-25T16:05:00Z

I just deployed the new release. Somethings have started working, but some of the foreign keys are giving me a slightly different error (perhaps I just need to wait for everything to flush?).

SELECT * FROM usr LIMIT 1;
ERROR: internal error: missing fk forward reference "fk_usr_ref_usr" to "usr" from "session" (un-upgraded foreign key references present)
SQLSTATE: XX000
DETAIL: stack trace:
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1635: validateCrossReferences()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/tabledesc/structured.go:1440: Validate()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:298: unwrapDescriptor()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/catalogkv/catalogkv.go:160: GetDescriptorByID()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:215: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:707: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:811: exec()
/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:706: Txn()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:193: acquire()
/go/src/github.com/cockroachdb/cockroach/pkg/sql/catalog/lease/lease.go:858: func1()
/go/src/github.com/cockroachdb/cockroach/pkg/util/syncutil/singleflight/singleflight.go:128: doCall()
/usr/local/go/src/runtime/asm_amd64.s:1357: goexit()

HINT: You have encountered an unexpected error.

Please check the public issue tracker to check whether this problem is
already tracked. If you cannot find it there, please report the error
with details by creating a new issue.

If you would rather not post publicly, please contact us directly
using the support form.

We appreciate your feedback.

halverneus · 2020-11-25T16:13:34Z

I've just checked doing a select on all tables and the only tables that are affected (if you still have my debug.zip) create 'missing fk forward reference' errors (never 'back reference', now, and only on the first half of the first schema upgrade appears affected, so I don't understand the specific cause, in this case). The following are the only remaining errors I have:

SELECT * FROM session_scope LIMIT 1;   
ERROR: internal error: missing fk forward reference "fk_scope_ref_session_scope" to "session_scope" from "session" (un-upgraded foreign key references present)
#####
root@:26257/fini> SELECT * FROM usr_permission LIMIT 1;             
ERROR: internal error: missing fk forward reference "fk_permission_ref_usr_permission" to "usr_permission" from "usr" (un-upgraded foreign key references present)
#####
SELECT * FROM usr LIMIT 1;
ERROR: internal error: missing fk forward reference "fk_usr_ref_usr" to "usr" from "session" (un-upgraded foreign key references present)
#####
SELECT * FROM machine_type LIMIT 1;       
ERROR: internal error: missing fk forward reference "fk_machine_type_ref_machine_type" to "machine_type" from "machine" (un-upgraded foreign key references present)

I can SELECT on all other tables from all other schema version without any issues. Thoughts?

Any way to manually upgrade an 'un-upgraded foreign key'?

halverneus · 2020-11-25T21:39:43Z

Changes made to a Docker image that was emailed directly to me fixed the issue.

jordanlewis · 2020-11-25T22:28:37Z

Thanks, @halverneus.

To close the loop, the PR #57133 corrected this issue. This resolution will be available in v20.2.3.

jordanlewis · 2020-11-26T01:26:52Z

If anyone finds this later and needs an urgent resolution before v20.2.3 is released, please see the binaries in this forum post: https://forum.cockroachlabs.com/t/issue-whenever-a-requests-comes-in-on-cockroachdb-20-2/4116/5

mishak87 · 2020-12-05T01:07:18Z

In case someone needs patched docker image 😊

FROM cockroachdb/cockroach:v20.2.2

RUN microdnf install tar gzip \
 && mkdir -p /tmp/patch \
 && cd /tmp/patch/ \
 && curl -O https://cockroach-builds.s3.amazonaws.com/cockroach-v20.2.2-2-gb91c2e7506.linux-amd64.tgz \
 && tar --strip-components=1 -xzf *.tgz \
 && microdnf remove gzip tar \
 && cp /tmp/patch/cockroach /cockroach/ \
 && rm -rf /tmp/patch

blathers-crl bot added O-community Originated from the community X-blathers-triaged blathers was able to find an owner labels Nov 23, 2020

nvanbenschoten assigned rafiss Nov 23, 2020

rafiss assigned thoszhang and unassigned rafiss Nov 23, 2020

ajwerner self-assigned this Nov 23, 2020

thoszhang added the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Nov 24, 2020

thoszhang added branch-release-20.2 branch-master Failures and bugs on the master branch. labels Nov 24, 2020

thoszhang changed the title missing fk back/forward reference * to * from * release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable Nov 24, 2020

jordanlewis added the S-1 High impact: many users impacted, serious risk of high unavailability or data loss label Nov 24, 2020

thoszhang mentioned this issue Nov 24, 2020

sql: allow for pre-19.2 foreign keys in table validation #57066

Merged

ajwerner mentioned this issue Nov 24, 2020

release-20.2: sql: allow for pre-19.2 foreign keys in table validation #57083

Merged

craig bot closed this as completed in c9fb63a Nov 24, 2020

jordanlewis reopened this Nov 24, 2020

jordanlewis closed this as completed Nov 25, 2020

This was referenced Dec 3, 2020

schema: create a "golden descriptor" upgrade test #57435

Closed

sql: add unique constraints to table descriptor #57502

Closed

nick-jones mentioned this issue Dec 14, 2020

Is upgrade auto-finalization a good default? #57887

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable #57032

release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable #57032

halverneus commented Nov 23, 2020

blathers-crl bot commented Nov 23, 2020

halverneus commented Nov 23, 2020

jordanlewis commented Nov 23, 2020 •

edited by thoszhang

Loading

halverneus commented Nov 23, 2020

halverneus commented Nov 23, 2020

jordanlewis commented Nov 23, 2020

halverneus commented Nov 24, 2020

thoszhang commented Nov 24, 2020

thoszhang commented Nov 24, 2020

blathers-crl bot commented Nov 24, 2020

halverneus commented Nov 24, 2020

jordanlewis commented Nov 25, 2020

halverneus commented Nov 25, 2020

jordanlewis commented Nov 25, 2020

halverneus commented Nov 25, 2020

halverneus commented Nov 25, 2020

halverneus commented Nov 25, 2020 •

edited

Loading

halverneus commented Nov 25, 2020

jordanlewis commented Nov 25, 2020 •

edited

Loading

jordanlewis commented Nov 26, 2020

mishak87 commented Dec 5, 2020

release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable #57032

release-20.2: sql: failure to upgrade FK representation during table validation produces spurious errors and makes table unavailable #57032

Comments

halverneus commented Nov 23, 2020

Additional data / screenshots

We appreciate your feedback.

blathers-crl bot commented Nov 23, 2020

halverneus commented Nov 23, 2020

jordanlewis commented Nov 23, 2020 • edited by thoszhang Loading

halverneus commented Nov 23, 2020

halverneus commented Nov 23, 2020

jordanlewis commented Nov 23, 2020

halverneus commented Nov 24, 2020

thoszhang commented Nov 24, 2020

thoszhang commented Nov 24, 2020

blathers-crl bot commented Nov 24, 2020

halverneus commented Nov 24, 2020

jordanlewis commented Nov 25, 2020

halverneus commented Nov 25, 2020

jordanlewis commented Nov 25, 2020

halverneus commented Nov 25, 2020

halverneus commented Nov 25, 2020

halverneus commented Nov 25, 2020 • edited Loading

halverneus commented Nov 25, 2020

jordanlewis commented Nov 25, 2020 • edited Loading

jordanlewis commented Nov 26, 2020

mishak87 commented Dec 5, 2020

jordanlewis commented Nov 23, 2020 •

edited by thoszhang

Loading

halverneus commented Nov 25, 2020 •

edited

Loading

jordanlewis commented Nov 25, 2020 •

edited

Loading