Skip to content

Comments

weight updates should be done with beta=1#105

Merged
thatguymike merged 1 commit intoNVIDIA:caffe-0.14from
drnikolaev:fix2
Jan 21, 2016
Merged

weight updates should be done with beta=1#105
thatguymike merged 1 commit intoNVIDIA:caffe-0.14from
drnikolaev:fix2

Conversation

@drnikolaev
Copy link

As per Natalia:
Line 90 of cudnn_batch_norm_layer.cu should be
cudnn::dataType::one

  • weight updates should be done with beta=1, similar to how they are done for convolutional layers, so that updates can be potentially accumulated over a few batches.

thatguymike added a commit that referenced this pull request Jan 21, 2016
weight updates should be done with beta=1
@thatguymike thatguymike merged commit b9b83d4 into NVIDIA:caffe-0.14 Jan 21, 2016
@drnikolaev drnikolaev deleted the fix2 branch January 27, 2016 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants