Skip to content

Conversation

@tcnichol
Copy link
Contributor

This feels more like a hack than an actual fix, so I could use some feedback.

Previously a dataset extractor would fail if the dataset had no files because it would try to download a zip of the dataset. That part of the code is in an ELSE block that happens if the dataset has no files, so it didn't really make sense to me, so I left some of the code but return empty lists if there are no files.

adding try/catch. I can't think of any cases where we should try to download a dataset with no files, but since it's in there, I'm doing this for now until I find out more.
@tcnichol
Copy link
Contributor Author

I think this one should be good to go.

The api route for downloading datasets returns a network error. The pyclowder.datasets.download method fails in chunking (the zip file is 0 bytes)

There might be a better fix, but this one should work for now.

@tcnichol tcnichol linked an issue Aug 29, 2021 that may be closed by this pull request
@CLAassistant
Copy link

CLAassistant commented Feb 15, 2022

CLA assistant check
All committers have signed the CLA.

log exceptin when downloading dataset
@robkooper robkooper merged commit 9e8d130 into master Feb 22, 2022
@robkooper robkooper deleted the bugfix/36-dataset-extractor-fails-empty-dataset branch February 22, 2022 23:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

dataset extractors do not work on empty dataset

7 participants