Skip to content

Comments

Persistent prefetch thread#2368

Closed
cypof wants to merge 4 commits intoBVLC:masterfrom
cypof:persistent_prefetch_thread
Closed

Persistent prefetch thread#2368
cypof wants to merge 4 commits intoBVLC:masterfrom
cypof:persistent_prefetch_thread

Conversation

@cypof
Copy link
Member

@cypof cypof commented Apr 25, 2015

Part of #2351. Makes sure the prefetch thread for data_layer is created only once, instead of for each batch. We discussed about switching to vector instead of Batch, which would probably be easy but I haven't looked at it.

@amuetzel
Copy link

Regarding the vector: do you mean using a vector<Blob> instead of the Batch with the data and label members?

If so, I would favor that option. An example use case for this would be custom data layers that expose more than 2 tops. I'm currently working on such a data layer for my research, and might be able to help with the change. (Though I'm still new to caffe.)

cypof added 4 commits May 18, 2015 17:24
- Interrupt the thread before waiting on join
- Provide a method for looping threads to exit on demand
- CHECK if start and stop succeed instead of returning an error
@cypof cypof force-pushed the persistent_prefetch_thread branch from 2f439ac to 01cbda5 Compare May 19, 2015 00:47
@shelhamer shelhamer mentioned this pull request May 30, 2015
@shelhamer
Copy link
Member

Closing since everything is bundled and updated in #2114 (and now #2870).

@shelhamer shelhamer closed this Aug 6, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants