Skip to content

cases: Fast and Secure Data Caching Hub#2587

Merged
jorgeorpinel merged 45 commits into
masterfrom
cases/mgn-dsets
Aug 24, 2021
Merged

cases: Fast and Secure Data Caching Hub#2587
jorgeorpinel merged 45 commits into
masterfrom
cases/mgn-dsets

Conversation

@jorgeorpinel
Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel commented Jun 28, 2021

Closes #654 (comment)
Closes #820 (last item)

TODOs:

@shcheklein shcheklein temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq June 28, 2021 23:46 Inactive
redir to hypothetical (for now) how-to
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq June 28, 2021 23:50 Inactive
Comment thread redirects-list.json Outdated
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq June 30, 2021 03:32 Inactive
Comment thread content/docs/use-cases/managing-datasets.md Outdated
Comment thread content/docs/use-cases/managing-datasets.md Outdated
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 1, 2021 18:37 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 1, 2021 18:47 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 3, 2021 04:12 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 6, 2021 00:06 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 6, 2021 05:23 Inactive
@jorgeorpinel jorgeorpinel requested a review from shcheklein July 6, 2021 05:23
Comment thread content/docs/use-cases/data-storage-layers.md Outdated
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 6, 2021 05:24 Inactive
Comment thread content/docs/use-cases/data-storage-layers.md Outdated
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq July 7, 2021 03:52 Inactive
Comment thread content/docs/use-cases/data-storage-layers.md Outdated
@jorgeorpinel jorgeorpinel marked this pull request as ready for review July 7, 2021 03:57
@iesahin

This comment has been minimized.

@casperdcl
Copy link
Copy Markdown
Contributor

Are we all agreed on the following?

  • there are 2 categories of target audience. To catch both,
    1. title requires "Secure" or synonym
    2. title requires "Speed/Optimise" or synonym

Also IMHO this is not about SEO (whether it shows up in my search results). It is purely about being misleading (would I bother clicking on it assuming it was top of my search results).

@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 11, 2021 15:19 Inactive
@jorgeorpinel jorgeorpinel changed the title cases: Fast and Secure Data Caching cases: Secure Data&Models Caching Hub Aug 11, 2021
@jorgeorpinel

This comment has been minimized.

@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

jorgeorpinel commented Aug 11, 2021

ii. title requires "Speed/Optimise" or synonym

I don't agree on this as a necessity. I think "Caching" implies speed.

@@ -0,0 +1,78 @@
# Secure Data and Model Caching Hub
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's not make it about models I think

this layer is important primarily to optimize datasets usage

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor: Hub - do we need this new term? I'm fine to keep it. just doesn't feel like it's needed

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

by using Secure exclusively we are overemphasizing it too much now ... it become specifically about "security" now

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Caching Hub can be replaced with Cache I think?

Copy link
Copy Markdown
Contributor Author

@jorgeorpinel jorgeorpinel Aug 12, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's not make it about models

OK, removing "and Models".

Hub - do we need this new term?
Caching Hub can be replaced with Cache

Could be "Layer", or nothing. Layer could refer to the infrastructural aspect of this patter but it's not clear until you actually read the contents. What I like abut Hub is that a) some people may get that it's infrastructure-related (term taken from that recent SO question) and b) it implies multiple parties (people or projects in this case) can share a central cache.

by using Secure exclusively we are overemphasizing it too much now

Since "and Models" will be gone now, we can go back to "Fast and Secure" but fast has some misleading connotations (e.g. improving network throughput)... 🤔

creating duplication (increasing cost). Valuable time is wasted waiting for
downloads in each environment.

![](/img/dataset-copies.png) _Users wait for repeated transfers and produce
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image feedback:

  • border (you mentioned that are removing them - that's good)
  • first image should trigger some pain , right not it's neutral - we don't see slow, we don't see the problem - can we emphasize that's slow
  • style: smooth arrows heads/tails
  • one barrel is enough? otherwise it's not clear if we have two different storages?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Communicated with the designer. Will report back when we have updates ⏳

@iesahin
Copy link
Copy Markdown
Contributor

iesahin commented Aug 12, 2021

After @shcheklein 's review, for the title: "Fast and Secure Data Cache"?

@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

jorgeorpinel commented Aug 12, 2021

Fast and Secure Data Cache

Fast could be misleading but I'm OK with that. I would still prefer "Caching Hub" though, as explained in #2587 (comment).

@jorgeorpinel jorgeorpinel changed the title cases: Secure Data&Models Caching Hub cases: Fast and Secure Data Caching Hub Aug 12, 2021
@shcheklein
Copy link
Copy Markdown
Contributor

Caching Hub vs Cache

No strong opinion on this one - I see pros and cons for both, I think it's fine to go with Hub.

@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 13, 2021 20:11 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 17, 2021 23:17 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 17, 2021 23:35 Inactive
@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

UPDATE: FYI we're still finalizing the images but they're pretty close already. See https://dvc-org-cases-mgn-dsets-fbikyq.herokuapp.com/doc/use-cases/fast-data-caching-hub:

image

image

@jendefig
Copy link
Copy Markdown
Contributor

jendefig commented Aug 18, 2021

UPDATE: FYI we're still finalizing the images but they're pretty close already. See https://dvc-org-cases-mgn-dsets-fbikyq.herokuapp.com/doc/use-cases/fast-data-caching-hub

There needs to be a party parrot/blob in Github. 😉

@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

jorgeorpinel commented Aug 18, 2021

I vote for a "run for your life Hollywood style" parrot

image

@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 24, 2021 06:35 Inactive
@jorgeorpinel jorgeorpinel temporarily deployed to dvc-org-cases-mgn-dsets-fbikyq August 24, 2021 06:37 Inactive
@jorgeorpinel jorgeorpinel merged commit b1a0df8 into master Aug 24, 2021
@jorgeorpinel
Copy link
Copy Markdown
Contributor Author

So this was approved and the images have been worked on so I merged it! Please see the final result in https://dvc.org/doc/use-cases/fast-data-caching-hub and let me know if you have additional feedback. Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A: docs Area: user documentation (gatsby-theme-iterative) C: cases Content of /doc/use-cases p1-important Active priorities to deal within next sprints

Projects

None yet

Development

Successfully merging this pull request may close these issues.

use-cases: revise so they're more high level "landing pages" cases: generalized shared dev server

7 participants