Skip to content

Compute backward for negative lr_mult#3007

Merged
jeffdonahue merged 1 commit intoBVLC:masterfrom
philkr:neg_lr_mult
Sep 1, 2015
Merged

Compute backward for negative lr_mult#3007
jeffdonahue merged 1 commit intoBVLC:masterfrom
philkr:neg_lr_mult

Conversation

@philkr
Copy link
Contributor

@philkr philkr commented Sep 1, 2015

Caffe currently does not update parameters for layers with negative lr_mult. This PR changes this behavior to update parameters for all layers with non-zero lr_mult.
I belief this is a bug after a conversation with @jeffdonahue .

@jeffdonahue
Copy link
Contributor

Thanks @philkr. This is indeed a bug since there is no CHECK_GE(lr_mult, 0) or the like, so Net will proceed thinking negative lr_mult layers don't "need backward", and the parameters aren't updated unless earlier layers do need backward.

jeffdonahue added a commit that referenced this pull request Sep 1, 2015
Compute backward for negative lr_mult
@jeffdonahue jeffdonahue merged commit 2d55e31 into BVLC:master Sep 1, 2015
@philkr philkr deleted the neg_lr_mult branch January 6, 2016 05:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments