Skip to content

Output accuracies per class.#1442

Closed
rmanor wants to merge 8 commits intoBVLC:devfrom
rmanor:accuracies
Closed

Output accuracies per class.#1442
rmanor wants to merge 8 commits intoBVLC:devfrom
rmanor:accuracies

Conversation

@rmanor
Copy link
Contributor

@rmanor rmanor commented Nov 16, 2014

No description provided.

@bhack
Copy link
Contributor

bhack commented Nov 17, 2014

Is this something like #759?

@rmanor
Copy link
Contributor Author

rmanor commented Nov 18, 2014

No, AFAIU, #759 is when a sample image has several labels and you just compute the accuracy differently (it still outputs one accuracy number, i.e. "correct classification").
Here I'm talking about the usual case when the problem is not binary classification but you have M classes, e.g. MNIST (10 classes), ImageNet (1000 classes), and you want to see the accuracy per class.

@seanbell
Copy link

While this is a nice feature, I think it should be an option that is enabled in AccuracyParam, where the default is not to use it. Otherwise, it breaks existing code if you simply overwrite existing functionality with your new feature.

@rmanor
Copy link
Contributor Author

rmanor commented Nov 19, 2014

I agree, I will update the code.

@sguada
Copy link
Contributor

sguada commented Nov 19, 2014

I think it should be a different top blob, that way if one ask for two tops
then the first blob will contain the overall accuracy, and the second could
contain the per class accuracy.

Also you have to make sure it works for top-k accuracy, and not only for top-1 accuracy.

2014-11-19 12:55 GMT-08:00 rmanor notifications@github.com:

I agree, I will update the code.


Reply to this email directly or view it on GitHub
#1442 (comment).

@rmanor
Copy link
Contributor Author

rmanor commented Jan 24, 2015

Hi, I refactored the change.
Now it will output per class accuracies in the second top blob, if exists.

@rmanor
Copy link
Contributor Author

rmanor commented Jan 31, 2015

ping? Thanks.

@shelhamer shelhamer added the JD label Mar 10, 2015
@rmanor rmanor closed this Aug 15, 2015
@rmanor rmanor deleted the accuracies branch August 15, 2015 16:30
@bhack
Copy link
Contributor

bhack commented Aug 15, 2015

@rmanor Can you wait forever?

@rmanor
Copy link
Contributor Author

rmanor commented Aug 15, 2015

@bhack What?
I didn't know how to update this PR so I'm going to start a new one synced to master.

@bhack
Copy link
Contributor

bhack commented Aug 15, 2015

OK I think that you was tired to waiting for a review

@rmanor
Copy link
Contributor Author

rmanor commented Aug 15, 2015

Yeah, but I thought I give it another try before giving up :)

On Sat, Aug 15, 2015 at 7:40 PM bhack notifications@github.com wrote:

OK I think that you was tired to waiting for a review


Reply to this email directly or view it on GitHub
#1442 (comment).

@rmanor
Copy link
Contributor Author

rmanor commented Aug 15, 2015

Replaced this with #2935

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

Comments