Skip to content

Conversation

@DavidStirling
Copy link
Member

Should fix #314

It turns out the old ('backup') method for writing class tables just doesn't work with the chunking functionality added in a recent version. To be honest the approach used by that method is overly complicated and much slower than it should have been. I've therefore just written a new non-Pandas method of putting the class data into the class table.

It's worth confirming whether this resolves the issues previously seen by users. It's not obvious what error would cause the Pandas-based method to fail, so it'd be worthwhile to investigate what the actual exception was that caused it to fall back to the alternative writing method in the first place.

I've also moved a bunch of print statements into the debug logging level so that the user can see them if desired.

@bethac07 bethac07 merged commit 4b9431f into master Feb 13, 2022
@bethac07 bethac07 deleted the class_tables branch February 13, 2022 22:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CPA does not export the classification results to database when more than 60000 image sets

3 participants