This repository was archived by the owner on Jul 24, 2024. It is now read-only.

*: merging tidb-lightning#665

Merged

overvenus merged 362 commits into

pingcap:masterfrom

overvenus:merging

Feb 19, 2021

This pull request is big! We're only showing the most recent 250 commits

Commits on Jan 26, 2019

add code coverage badge and build status (#130)

zhouqiang-cl
authored and
kennytm
committed

Commits on Feb 13, 2019

restore: limit closed engine count for coordinating `write` and `import` (#119)
lonng
authored

Commits on Feb 20, 2019

add roadmap (#133)
IANTHEREAL
authored

Commits on Mar 8, 2019

restore: write index kv pairs and data kv pairs to separate engine (#132)

lonng
authored and
kennytm
committed

Commits on Mar 11, 2019

Support CSV (#111)
kennytm
authored
update version of tidb to latest release-2.1 (#138)

WangXiangUSTC
authored and
lonng
committed

Commits on Mar 13, 2019

tidb-lightning-ctl: added --import-engine and --cleanup-engine commands (#125)
kennytm
authored

Commits on Mar 14, 2019

*: parameter type fix (#141)

amyangfei
authored and
lonng
committed

Commits on Mar 15, 2019

remove changelog and get change logs from release (#146)

IANTHEREAL
authored and
kennytm
committed
test: fix cleanup script to enable re-run integration test locally (#142)

amyangfei
authored and
lonng
committed
restore: fix #140 lightning breaks on tidb-master (#147)
lonng
authored

Commits on Mar 18, 2019

fix deadlock and goroutine leak in chunk restore (#149)

IANTHEREAL
authored and
lonng
committed

Commits on Mar 20, 2019

restore: eager release index engine worker after imported (#150)
lonng
authored

Commits on Mar 22, 2019

checkpoint: fix checkpoint not updated in some scenario (#151)

amyangfei
authored and
lonng
committed

Commits on Mar 25, 2019

Revert "fix deadlock and goroutine leak in chunk restore (#149)" (#152)

IANTHEREAL
authored and
kennytm
committed

Commits on Mar 27, 2019

restore: add local checksum log (#153)

lonng
authored and
kennytm
committed

Commits on Apr 3, 2019

Commits on Apr 4, 2019

tests: fix a test failure due to conflict between #145 and #158 (#159)
kennytm
authored

Commits on Apr 9, 2019

Commits on Apr 15, 2019

go.mod: upgrade dependencies, esp TiDB -> v3.0.0-beta.1 (#160)
kennytm
authored

Commits on Apr 16, 2019

Fix interpretation of integers in a BIT column (#161)
kennytm
authored

Commits on Apr 17, 2019

*: replace gofail with new failpoint implementation (#165)
lonng
authored

Commits on Apr 19, 2019

*: use pingcap/log (zap) for logging (#162)
kennytm
authored

Commits on Apr 22, 2019

main: sync log before exit + update failpoint dep (#168)

kennytm
authored and
lonng
committed

Commits on Apr 25, 2019

kv: fix handling of column default values (#170)
kennytm
authored

Commits on Apr 26, 2019

tests,restore: re-enable the exotic_filenames test (#172)

kennytm
authored and
lonng
committed

Commits on Apr 30, 2019

config: reduce default table-concurrency from 8 to 6 (#175)

kennytm
authored and
lonng
committed

Commits on May 4, 2019

Support table routing rules (merging sharded tables) (#95)
kennytm
authored

Commits on May 8, 2019

Commits on May 13, 2019

common: improve unit test coverage of 'common' package (#186)
lonng
authored

Commits on May 16, 2019

config: improve unit test coverage of 'config' package (#192)
lonng
authored

Commits on May 21, 2019

Add unit tests for kv/importer and restore/checkpoints, plus some bug fixes (#191)
kennytm
authored

Commits on May 27, 2019

Add unit tests for 'restore.go' (TableRestore and chunkRestore) (#193)

kennytm
authored and
lonng
committed

Commits on Jun 5, 2019

go.mod: update dependencies (#197)
kennytm
authored

Commits on Jun 18, 2019

config,lightning: Implements server mode (#198)
kennytm
authored

Commits on Jul 2, 2019

go.mod: update dependencies (#200)
kennytm
authored

Commits on Jul 3, 2019

Post restore config fix (#202)

ericsyh
authored and
kennytm
committed

Commits on Jul 5, 2019

Introduce a basic web interface (#199)
kennytm
authored

Commits on Jul 10, 2019

Update README.md (#207)
lance6716
authored

Commits on Jul 11, 2019

Improve errors and logs on syntax error / conversion failure (#201)
kennytm
authored

Commits on Jul 15, 2019

Commits on Jul 16, 2019

build(deps): bump lodash from 4.17.11 to 4.17.14 in /web (#213)

dependabot[bot]
authored and
kennytm
committed

Commits on Jul 18, 2019

*: adjust solution for TOOL-1420 and add a test case (#214)
kennytm
authored

Commits on Jul 19, 2019

tests: add test case for simple partitioned tables (#206)
kennytm
authored

Commits on Jul 24, 2019

checkpoints: remove node_id field and rename the schema on keep-after-success (#208)
kennytm
authored

Commits on Jul 25, 2019

Commits on Jul 29, 2019

*: abstract the Importer communication into an interface (#215)
kennytm
authored

Commits on Aug 7, 2019

restore: update and restore GCLifeTime once when parallel (#220)
lance6716
authored

Commits on Aug 14, 2019

*: support MySQL backend (#221)
kennytm
authored

Commits on Aug 15, 2019

config: always skip the system databases (#225)
kennytm
authored

Commits on Aug 21, 2019

backend: update mysql backend to tidb backend (#228)

WangXiangUSTC
authored and
kennytm
committed

Commits on Aug 22, 2019

lightning/common: add unit test (#229)

WangXiangUSTC
and
kennytm
committed

Commits on Aug 23, 2019

mock: update rpc endpoint (#226)
lance6716
authored

Commits on Aug 26, 2019

Commits on Aug 30, 2019

backend: dynamically calculate the maximum auto-inc ID (#227)
kennytm
authored

Commits on Sep 6, 2019

checkpoint: fix empty map become nil after unmarshall (#237)

lance6716
authored and
kennytm
committed

Commits on Sep 29, 2019

config: increase default concurrency (#244)

lance6716
authored and
IANTHEREAL
committed

Commits on Oct 8, 2019

backend/tidb: use REPLACE INTO or INSERT IGNORE INTO to provide idempotent insertion (#243)

lance6716
authored and
IANTHEREAL
committed

Commits on Oct 9, 2019

*: use fixed timestamp to ensure import stability wrt CURRENT_TIMESTAMP (#235)

kennytm
authored and
IANTHEREAL
committed

Commits on Oct 18, 2019

*: update dependencies (tidb -> 3.0.4) (#246)

kennytm
authored and
IANTHEREAL
committed

Commits on Nov 3, 2019

improve the log when encountering invalid checkpoint (#247)
kennytm
authored

Commits on Nov 20, 2019

config: adding `[tidb] max-allowed-packet` config (#248)
kennytm
authored

Commits on Dec 12, 2019

Fix +incompatible suffix not allowed error reported by go mod (#249)

suzaku
authored and
kennytm
committed

Commits on Dec 16, 2019

allow use a separate pauser instead of global pauser (#251)

Zejun Li
authored and
suzaku
committed

Commits on Dec 17, 2019

Add password as command line argument (#253)

Jacob Lerche
authored and
gregwebs
committed

Commits on Jan 10, 2020

metrics: copy the grafana board into this repo (#256)
kennytm
authored

Commits on Jan 14, 2020

*: Update dependencies and fix unit test on Windows (#254)
kennytm
authored

Commits on Feb 4, 2020

config: synchronize actual default value with the toml file (#255)
kennytm
authored

Commits on Feb 5, 2020

lightning: ensure the web interface still works outside server mode (#259)
kennytm
authored

Commits on Feb 10, 2020

Upgrade TiDB to 4.0.0-beta, and recognize @@tidb_row_format_version = 2 (#268)
kennytm
authored

Commits on Feb 27, 2020

Support TLS; Reduce the need of config.toml in integration tests (#270)
kennytm
authored

Commits on Feb 29, 2020

backend: define a reusable BufStore when creating a new session (#274)
kennytm
authored

Commits on Mar 5, 2020

Update Chinese doc url (#276)
kennytm
authored

Commits on Mar 10, 2020

Set session var for every new conn (#280)
july2993
authored

Commits on Mar 12, 2020

lightning: split large csv file if possible (#272)

XuHuaiyu
and
kennytm
authored

Commits on Mar 16, 2020

Commits on Apr 13, 2020

Commits on Apr 20, 2020

Support store version format generated by `git describe --tags` (#295)
solotzg
authored

Commits on May 14, 2020

update tidb-tools to latest (#319)
3pointer
authored

Commits on Jun 5, 2020

support alter random && update tidb dependency to latest (#324)
3pointer
authored

Commits on Jun 10, 2020

backend: add local kv storage backend to get rid of importer (#326)

glorv
and
3pointer
authored

Commits on Jun 11, 2020

Commits on Jun 17, 2020

Fix test cases on release-3.0 (#330)
kennytm
authored

Commits on Jun 19, 2020

optimize parse csv and local backend write tikv (#334)
glorv
authored

Commits on Jun 24, 2020

Commits on Jun 28, 2020

optimize encoder and adjust some config (#338)
glorv
authored

Commits on Jul 8, 2020

log: fix log file path (#345)
glorv
authored

Commits on Jul 10, 2020

Commits on Jul 14, 2020

Commits on Jul 15, 2020

restore: do not rebase auto-id or generate auto row id for table with common handle (#349)
glorv
authored

Commits on Jul 22, 2020

Fix verbose log message for shell (#352)
Null not nil
authored

Commits on Jul 24, 2020

Commits on Jul 28, 2020

Commits on Aug 6, 2020

parser: fix csv parse header with empty line (#364)
glorv
authored

Commits on Aug 7, 2020

restore: fix missing colum infos when restore from checkpoint (#362)
glorv
authored

Commits on Aug 13, 2020

Commits on Aug 19, 2020

restore: support split csv source file with header (#363)
glorv
authored

Commits on Aug 20, 2020

Commits on Aug 24, 2020

Commits on Aug 27, 2020

backend: update committs from unix timestamp to pd tso (#379)
3pointer
authored

Commits on Aug 31, 2020

Commits on Sep 1, 2020

Commits on Sep 2, 2020

test: change integration test script to allow run tests in parallel (#382)
glorv
authored

Commits on Sep 3, 2020

Commits on Sep 4, 2020

Commits on Sep 8, 2020

backend: use peer address as grpc addr for tiflash store (#392)
glorv
authored

Commits on Sep 11, 2020

Commits on Sep 14, 2020

make tiflash test more stable (#397)
glorv
authored

Commits on Sep 16, 2020

Commits on Sep 17, 2020

backend: fix load partition table with local backend (#402)
glorv
authored

Commits on Sep 21, 2020

Commits on Sep 25, 2020

support new collation for kv encoder (#407)
glorv
authored

Commits on Sep 27, 2020

mydump: support multi bytes csv delimiter and separator (#406)

glorv
and
kennytm
authored

Commits on Sep 28, 2020

Commits on Oct 9, 2020

Commits on Oct 10, 2020

config: fix error on `-d 'C:\Windows\Path'` (#411)
kennytm
authored

Commits on Oct 12, 2020

local: fix infinity loop in retry get region (#418)
glorv
authored

Commits on Oct 13, 2020

backend: speed up uploading by open multi TCP connections (#400)
YuJuncen
authored

Commits on Oct 19, 2020

Commits on Oct 27, 2020

Commits on Nov 2, 2020

make: hide go.mod to resolve cyclic dependency with tidb (#439)
lance6716
authored

Commits on Nov 4, 2020

Commits on Nov 6, 2020

Commits on Nov 10, 2020

Commits on Nov 11, 2020

fix service gc ttl again (#465)
glorv
authored

Commits on Nov 12, 2020

mydumper: verify file routing config (#470)
glorv
authored

Commits on Nov 13, 2020

config: allow four byte-size config to be specified using human-readable units ("100 GiB") (#471)

kennytm
and
glorv
authored

Commits on Nov 16, 2020

Commits on Nov 23, 2020

Commits on Nov 24, 2020

restore: wait sub task finish before exit (#485)
glorv
authored

Commits on Nov 26, 2020

Commits on Nov 27, 2020

backend/local: batch split region with batch limit (#487)
glorv
authored

Commits on Dec 1, 2020

Commits on Dec 5, 2020

backend: support stored generated columns in local/importer backends (#505)
kennytm
authored

Commits on Dec 8, 2020

Commits on Dec 14, 2020

backend/local: fix next key (#523)
glorv
authored

Commits on Dec 20, 2020

backend: import planner/core package to initialize expression.RewriteAstExpr (#526)
Xuhui Lu
authored

Commits on Dec 21, 2020

Commits on Dec 22, 2020

post-process: support run table analyze after all tables are finished (#509)

glorv
and
lance6716
authored

Commits on Dec 23, 2020

Commits on Dec 24, 2020

mydumper: update br to apply auto retry s3 read error (#533)
glorv
authored

Commits on Dec 28, 2020

Commits on Dec 29, 2020

mydumper: do not remove more than 1 sep if trim last sep is true (#535)
glorv
authored

Commits on Dec 31, 2020

restore: add error retry for checksum by tikv (#537)
glorv
authored

Commits on Jan 4, 2021

Commits on Jan 6, 2021

Commits on Jan 7, 2021

Compatible for disk quota (#543)

authored

Commits on Jan 8, 2021

*: add method to check whether need local SST of table (#491)
lance6716
authored

Commits on Jan 11, 2021

backend/local: skip split regions if engine total size is smaller than region size (#524)
glorv
authored

Commits on Jan 13, 2021

config: change redact log parameter name (#547)
lichunzhu
authored

Commits on Jan 18, 2021

Commits on Jan 25, 2021

test: fix s3 integration test (#555)
glorv
authored

Commits on Jan 26, 2021

grafana dashboards support multiple cluster (#556)
Jiajin Zheng
authored

Commits on Jan 27, 2021

Commits on Jan 29, 2021

Commits on Feb 19, 2021