Error in backpack when running a benchmark with fbopt, fishr, and erm.

[MatteoWohlrapp]

When running the pacs_fbopt_fishr_erm.yaml on the erm_hyper_init branch, I get the following error:

[smilesun]

I just reproduced the same error, my gut feeling is since fbopt calls some fishr subroutines and takes model, where model is not backpacked.

See #771

[MatteoWohlrapp]

But I get the same error when removing fbopt from the task and only use fishr. So I am not sure if it is connected to fbopt

[smilesun]

But I get the same error when removing fbopt from the task and only use fishr. So I am not sure if it is connected to fbopt

Backpack does not work with skip connections, seems like, see error message here
https://github.com/marrlab/DomainLab/pull/837/files

E               NotImplementedError: Encountered BatchNorm module in training mode. BackPACK's computation will pass, but resul
ts like individual gradients may not be meaningful, as BatchNorm mixes samples. Only proceed if you know what you are doing.   
                                                                                                                               
../anaconda3/lib/python3.9/site-packages/backpack/utils/errors.py:27: NotImplementedError                                      
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> entering PDB >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
                                                                                                                               
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> PDB post_mortem (IO-capturing turned off) >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
> /home/sunxd/anaconda3/lib/python3.9/site-packages/backpack/utils/errors.py(27)batch_norm_raise_error_if_train()              
     25         )                                                                                                              
     26         if raise_error:                                                                                                
---> 27             raise NotImplementedError(message)                                                                         
     28         else:                                                                                                          
     29             warn(message)                                                              

[smilesun]

maybe compare with alex net then? @MatteoWohlrapp , nname=alexnet instead of npath

[smilesun]

@MatteoWohlrapp , this one seems to be running without error on my acoucnt:

#838