Skip to content

S3 access_key_id & secret_access_key args#1589

Merged
jorgeorpinel merged 10 commits into
treeverse:masterfrom
farizrahman4u:patch-1
Jul 20, 2020
Merged

S3 access_key_id & secret_access_key args#1589
jorgeorpinel merged 10 commits into
treeverse:masterfrom
farizrahman4u:patch-1

Conversation

@farizrahman4u
Copy link
Copy Markdown
Contributor

Comment thread content/docs/command-reference/remote/modify.md Outdated
Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @farizrahman4u please request my review when treeverse/dvc/pull/4224 is merged.

@jorgeorpinel jorgeorpinel changed the title S3 access_key_id & secret_access_key args WIP: S3 access_key_id & secret_access_key args Jul 18, 2020
Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quick review for now:

Comment thread content/docs/command-reference/remote/modify.md Outdated
Comment thread content/docs/command-reference/remote/modify.md Outdated
@jorgeorpinel
Copy link
Copy Markdown
Contributor

Another note: something is wrong with the text formatting here because a Restyled PR was created automatically. I thought it was the white spaces but I removed them and the Restyled PR is still there (it should close automatically). Please try to figure out what the difference is comparing your changes to https://github.com/iterative/dvc.org/pull/1590/files and/or follow our contribution guidelines, found in https://dvc.org/doc/user-guide/contributing/docs. Thanks

farizrahman4u and others added 4 commits July 19, 2020 12:53
Co-authored-by: Jorge Orpinel <jorgeorpinel@users.noreply.github.com>
Co-authored-by: Jorge Orpinel <jorgeorpinel@users.noreply.github.com>
@efiop
Copy link
Copy Markdown
Contributor

efiop commented Jul 19, 2020

@jorgeorpinel Styling seems to be fixed now.

Comment thread content/docs/command-reference/remote/modify.md Outdated
Comment on lines +111 to +119
- `access_key_id` - (optional) AWS Access Key ID. Overrides credentials from
`credentialpath`:

```dvc
$ dvc remote modify myremote access_key_id my-access-key-id
```

- `secret_access_key` - (optional) AWS Secret Access Key. Overrides credentials
from `credentialpath`:
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But actually... All of these settings are optional, even credentialpath. So why/when does credentialpath need to be overridden?

From the section's description: "To override some of these settings, you could use the following options".

Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel Jul 19, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are these new ones just an alternative to credentialpath?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, all of these are optional except for the url. You can override default credentialpath (~/.aws/credentials) when you want to use a different creds file.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I get it. My questions are geared towards improving the explanation for the users.

So maybe credentialpath should state it is the default AWS credentials file if omitted, or something like this? Another option is to say these new options can be used "instead of credentialpath" (and not call them optional). The way they're described now may be confusing.

This comment was marked as resolved.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These config options will override not only what is in credentialpath but also what is in the env or boto3-specific config, so the hierarchy is more complex and, ideally, it should be described (a note about us using boto3 and a reference to https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html might suffice) once for the whole s3-related section. We could create a ticket for that for later, but for now just say that these newly added options are optional.

Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel Jul 20, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could create a ticket for that for later, but for now just say that these newly added options are optional.

Sure, feel free to open the ticket. Seems like a note we should have... For now I applied my suggestion and merged this. It does already imply all these settings are optional at the beginning of the section, and per the nature of dvc remote modify.

Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One more question left please ☝️

Comment thread content/docs/command-reference/remote/modify.md Outdated
@jorgeorpinel jorgeorpinel changed the title WIP: S3 access_key_id & secret_access_key args S3 access_key_id & secret_access_key args Jul 20, 2020
Copy link
Copy Markdown
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Applied my suggestion.

@jorgeorpinel jorgeorpinel merged commit bdc961d into treeverse:master Jul 20, 2020
@jorgeorpinel
Copy link
Copy Markdown
Contributor

Merged the Restyled PR (#1603).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants