Skip to content

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Nov 3, 2023

Cherry-pick #25847, #26040, #26169, #26272, #26312.

apache#25847)

Doris is not responsible for managing snapshots, but it needs to clear all
snapshots before doing backup/restore regression testing, so a property is
added to indicate that existing snapshots need to be cleared when creating a
repo.

In addition, a regression test case for backup/restore has been added.
)

1. restore overwrites an exists table
2. backup & restore with exclude table
3. restore to a new table
4. restore mix exists and new tables
5. restore with alias
@w41ter
Copy link
Contributor Author

w41ter commented Nov 3, 2023

run buildall

@github-actions github-actions bot added area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. kind/test labels Nov 3, 2023
@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.83 seconds
stream load tsv: 553 seconds loaded 74807831229 Bytes, about 129 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.5 seconds inserted 10000000 Rows, about 338K ops/s
storage size: 17164095954 Bytes

@xiaokang xiaokang merged commit 20a61b0 into apache:branch-2.0 Nov 3, 2023
@w41ter w41ter deleted the pick/25847 branch November 3, 2023 04:52
gnehil pushed a commit to gnehil/doris that referenced this pull request Dec 4, 2023
* [feature](backup) add property to remove snapshot before creating repo (apache#25847)

Doris is not responsible for managing snapshots, but it needs to clear all
snapshots before doing backup/restore regression testing, so a property is
added to indicate that existing snapshots need to be cleared when creating a
repo.

In addition, a regression test case for backup/restore has been added.

* [cases](regression-test) Add backup & restore with multi tables test (apache#26040)

* [cases](regression-test) Add backup restore operation test (apache#26169)

1. restore overwrites an exists table
2. backup & restore with exclude table
3. restore to a new table
4. restore mix exists and new tables
5. restore with alias

* [fix](regression) Add auto-expired prefix for backup/restore cases (apache#26272)

* [test](regression) Add backup/restore DB case (apache#26312)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants