Skip to content

Split up spacy bin files #103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
honnibal merged 1 commit into from
May 29, 2020
Merged

Split up spacy bin files #103

honnibal merged 1 commit into from
May 29, 2020

Conversation

@ahalterman
Copy link
Contributor

@ahalterman ahalterman commented Apr 14, 2020

This fixes #102, but it's not the most elegant code. Splitting doc_bin into smaller files and writing them out separately resolves the object too large error.

@svlandeg svlandeg added the enhancement Feature requests and improvements label Apr 14, 2020
@ahalterman ahalterman mentioned this pull request Apr 16, 2020
Closed
@honnibal honnibal merged commit 5fe2247 into explosion:master May 29, 2020
@svlandeg svlandeg mentioned this pull request May 30, 2020
Closed
@svlandeg svlandeg linked an issue May 30, 2020 that may be closed by this pull request
Terminated when using 01_parse.py #109
Closed
@svlandeg svlandeg mentioned this pull request Jul 3, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

enhancement Feature requests and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Terminated when using 01_parse.py Object too large error in preprocessing script

3 participants

@ahalterman @honnibal @svlandeg