Skip to content

feat(cache): add temp file caching for retry in copy/move tasks#1588

Closed
jenfonro wants to merge 4 commits intoOpenListTeam:mainfrom
jenfonro:cache
Closed

feat(cache): add temp file caching for retry in copy/move tasks#1588
jenfonro wants to merge 4 commits intoOpenListTeam:mainfrom
jenfonro:cache

Conversation

@jenfonro
Copy link
Copy Markdown
Contributor

@jenfonro jenfonro commented Nov 5, 2025

Description / 描述

  • 增加了临时文件的控制,现在当上传失败时,可以复用下载成功的文件,实现加快重试
  • 同时缓存了md5,避免重复io

Motivation and Context / 背景

目前的任务中,当下载成功,上传失败时,重试时会重新下载

How Has This Been Tested? / 测试

  • 远程存储上传至百度云盘,在下载/上传阶段手动失败,关注临时文件的变动(上传阶段观察网络下行更直观)

Checklist / 检查清单

@jenfonro
Copy link
Copy Markdown
Contributor Author

jenfonro commented Nov 5, 2025

目前只支持了百度云,主要是想大佬们看一下实现的逻辑对不对,

如果这个逻辑对的话,那么我再去适配一下非流式传输的驱动

@jenfonro
Copy link
Copy Markdown
Contributor Author

jenfonro commented Nov 5, 2025

这个需要依赖新的tache,否则可能会导致临时文件过多而爆磁盘(未实验)

目前原作者的tache中已经合并了新的任务逻辑,Openlist这边的还未合并

@j2rong4cn
Copy link
Copy Markdown
Member

改的太乱了,上传重试应该在驱动处理,

@j2rong4cn j2rong4cn marked this pull request as draft November 5, 2025 09:32
@jenfonro
Copy link
Copy Markdown
Contributor Author

jenfonro commented Nov 5, 2025

改的太乱了,上传重试应该在驱动处理,

的确,之前想的是在任务系统中统一处理,反而导致很混乱,

现在代码修改过了,看一下这样是否符合?

@jenfonro jenfonro requested a review from j2rong4cn November 6, 2025 14:37
@j2rong4cn j2rong4cn closed this Nov 7, 2025
@j2rong4cn
Copy link
Copy Markdown
Member

如何不想重新缓存,应该像你之前的pr #1279 那样在缓存之后,根据情况重试

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants