add: Update help of --jobs#7297
Conversation
| "Only used along with '--to-remote'. " | ||
| "Number of jobs to run simultaneously " | ||
| "when pushing data to remote." | ||
| "The default value is 4 * cpu_count(). " |
There was a problem hiding this comment.
just to double check: is it a correct default value? (I thought it was something like min(4, 4 * cpu_count())? (which we should also update I think)
There was a problem hiding this comment.
It is the current default: https://github.com/iterative/dvc/blob/73fee513b955f1b44542a450318ad42eec850add/dvc/fs/base.py#L36
Do you mean that we should increase the number?
There was a problem hiding this comment.
no, I wanted to double check if it's correct or not - that's it
I always forget which one of those two lines (https://github.com/iterative/dvc/blob/73fee513b955f1b44542a450318ad42eec850add/dvc/fs/base.py#L38) apply to what part.
I would may be check if some file systems override it. Just in case.
There was a problem hiding this comment.
HASH_JOBS is for calculating checksums and can be overridden with core.checksum_jobs.
add jobs refer to to_remote functionality.
There was a problem hiding this comment.
I would may be check if some file systems override it. Just in case.
Currently, both _JOBS and HASH_JOBS are never overwritten by any file system.
3 participants
❗ I have followed the Contributing to DVC checklist.
📖 If this PR requires documentation updates, I have created a separate PR (or issue, at least) in dvc.org and linked it here.