Skip to content

(WIP) fsspec compat #116

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
martindurant wants to merge 6 commits into from
Closed

(WIP) fsspec compat #116

martindurant wants to merge 6 commits into from

Conversation

@martindurant
Copy link
Member

@martindurant martindurant commented Oct 29, 2018

Start of compatibility with fsspec.

Note the large amount of removed code.

In [2]: from fsspec.core import open_files
In [3]: open_files('gcs://mdtemp/*.avro', storage_options={'token': 'anon'})
[<OpenFile 'mdtemp/one.avro'>, <OpenFile 'mdtemp/two.avro'>]

@martindurant
Copy link
Member Author

martindurant commented Oct 29, 2018

(will fail tests, not updated at all)

@martindurant martindurant changed the title Fsspec compat (WIP) fsspec compat Oct 29, 2018
@martindurant martindurant mentioned this pull request Nov 6, 2018
Open
Martin Durant added 2 commits November 6, 2018 18:25
@martindurant martindurant mentioned this pull request Nov 7, 2018
Open
Martin Durant added 2 commits November 22, 2018 21:01
Merge branch 'master' into fsspec_compat
b5947b2 
Base GCSFile on AbstractBuffered File

Missing: no route to _simple_upload, calls _initiate_upload always
Many tests working [skip ci]
ab50675
@martindurant martindurant mentioned this pull request Nov 26, 2018
Closed
@martindurant martindurant mentioned this pull request Dec 28, 2018
Closed
7 tasks
@martindurant
Copy link
Member Author

martindurant commented Jun 28, 2019

Will make new PR with recent changes included to supersede this one.

@martindurant martindurant deleted the fsspec_compat branch June 28, 2019 23:40
@ahmedx2 ahmedx2 mentioned this pull request Aug 27, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@martindurant