Skip to content

[WIP] cases: rewrite Shared Dev Server#1724

Closed
jorgeorpinel wants to merge 2 commits into
use-casesfrom
use-cases-shrdevsrv
Closed

[WIP] cases: rewrite Shared Dev Server#1724
jorgeorpinel wants to merge 2 commits into
use-casesfrom
use-cases-shrdevsrv

Conversation

@jorgeorpinel
Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel commented Aug 27, 2020

@shcheklein shcheklein temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 01:42 Inactive
@jorgeorpinel jorgeorpinel changed the base branch from master to use-cases August 27, 2020 01:42
@jorgeorpinel jorgeorpinel changed the title [WIP] cases: rewrite Shared Dev Server cases: rewrite Shared Dev Server Aug 27, 2020
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 03:16 Inactive
Comment on lines -58 to +74
And tell DVC to set group permissions on newly created or downloaded cache
files:
And configure DVC to set group permissions on cached assets, and to enable all
[link types](/doc/user-guide/large-dataset-optimization#file-link-types-for-the-dvc-cache):

```dvc
$ dvc config cache.shared group
$ dvc config cache.type 'reflink,symlink,hardlink,copy'
```

> See `dvc cache dir` and `dvc config cache` for more information.
⚠️ Note that you cam't manually modify tracked data with the above `cache.type`
value. Soft/hard links are disabled by default for this reason, but are needed
for a reliable shared cache.
Copy link
Copy Markdown
Contributor Author

@jorgeorpinel jorgeorpinel Aug 27, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here are the updates to address #429 (comment) @shcheklein — note that the manual protect setting is no longer required (it's now automatic with sym/hardlinks).

I'm just not sure I get why this is necessary so only wrote "symlink,hardlink... are needed for a reliable shared cache" for now.

Copy link
Copy Markdown
Contributor Author

@jorgeorpinel jorgeorpinel Aug 27, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, typo in cam't 🤦 - fixing...

add note about enabling all link types to close #429
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-landing-use-cases-s-rzdkxy August 27, 2020 03:20 Inactive
@jorgeorpinel jorgeorpinel changed the title cases: rewrite Shared Dev Server [WIP] cases: rewrite Shared Dev Server Aug 29, 2020
@jorgeorpinel jorgeorpinel force-pushed the use-cases branch 2 times, most recently from 1dd8ac4 to d224c98 Compare August 30, 2020 00:34
@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

Stale but will retake this ASAP.

@jorgeorpinel jorgeorpinel deleted the use-cases-shrdevsrv branch November 28, 2020 00:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cases: update Shared Dev Server with an optimization link

2 participants