v4.0.11

Improvements

• Create tables in parallel to improve import performance #502
• Skip splitting Regions to improve import performance if the engine's total size is smaller than the Region size #524
• Add a import progress bar and optimize the accuracy of restore progress #506

Bug Fixes

• Fix a bug that column count mismatch might be triggered when using the TiDB-backend #535
• Fix a bug that TiDB-backend panics if the column counts of the source file and the column counts of the target table mismatch #528
• Fix a bug that TiKV might unexpectedly panic during TiDB Lightning's data import #554

v4.0.10

Improvements

• Support retrying S3 reads on error #533

Bug Fixes

• Fix a bug that the retry scan region key is not encoded, which causes the retried Region is not split #531
• Fix a bug that lost create table error during multiple tables created #530
• Fix the bug that lightning will trim all the empty sep when trim-last-sep is true, which causes "column count mismatch" in tidb backend #535

v5.0.0-rc

There is no release note for this version.

v4.0.9

Improvements

• Filter out all system schemas by default #459
• Support setting a default value for the auto-random primary key for the Local-backend or Importer-backend #457
• Use range properties to make the range split more precise in Local-backend #422
• Support a human-readable format (such as "2.5 GiB") in tikv-importer.region-split-size, mydumper.read-block-size, mydumper.batch-size, and mydumper.max-region-size #471

Bug Fixes

• Fix the issue that keys are encoded using the wrong field information #437
• Fix the issue that GC life time TTL does not take effect #448
• Fix the issue that causes panic when manually stops the running TiDB Lightning in the Local-backend mode #484

v3.0.20

There is no release note for this version.

v4.0.8

Improvements

• Support multi-byte CSV delimiters and separators #406
• Speed up the restore process by disabling some PD schedulers #408
• Use the GC-TTL API for checksum GC safepoint in the v4.0 cluster to avoid the GC error #396

Bug Fixes

• Fix the issue of wrong column information #420
• Fix the infinity loop that occurs when retrying to get Region information in the local mode #418

v4.0.7

Improvements

• Support dynamically updating the log level via the HTTP interface #393

v3.0.19

Bug Fixes

• Fix the issue that the TiDB Lightning process does not exit in time when encountering illegal UTF characters in CSV in the strict mode #378

v4.0.6

Improvements

• Split and ingest Region in more precise sizes #369

Bug Fixes

• Fix the issue that all failed operations of writes and ingests are mistakenly displayed as successful #381
• Fix the issue that some checkpoint updates might not be written to the database before TiDB Lightning exits #386

v4.0.5

Improvements

• Optimize some logs #352

Bug Fixes

• Fix the syntax error on empty binary/hex literals when using TiDB backend #357