Skip to content

Conversation

@schneems
Copy link
Collaborator

@schneems schneems commented Jan 6, 2022

This file is 9k lines long and even with the currently optimized algorithm takes about 1.6s to search. The goal is to find a way to get it under 1 second.

If someone is working with such large files they can set their DEAD_END_TIMEOUT=2 and be perfectly fine, but perf improvements that would allow this file to parse under 1 second would hopefully also speed up other cases.

This file is 9k lines long and even with the currently optimized algorithm takes about 1.6s to search. The goal is to find a way to get it under 1 second.

If someone is working with such large files they can set their DEAD_END_TIMEOUT=2 and be perfectly fine, but perf improvements that would allow this file to parse under 1 second would hopefully also speed up other cases.
@schneems schneems force-pushed the schneems/partition branch from 094f202 to 86a3b58 Compare January 6, 2022 18:22
@schneems schneems merged commit 0170bf3 into main Jan 6, 2022
@schneems schneems deleted the schneems/partition branch January 6, 2022 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants