Few-shot experiments: two issues (attn_mask in BiomedCLIPMultiHeadAttention, undefined VALIDATION in run_biomedical_training)

[KangST]

Thank you for your excellent paper and for sharing the codebase. While running few-shot experiments, I encountered two issues that I wanted to report:

1. TypeError in BiomedCLIPMultiHeadAttention.forward

TypeError: BiomedCLIPMultiHeadAttention.forward() got an unexpected keyword argument 'attn_mask'

As a temporary workaround, I added a no-op attn_mask parameter to the forward signature of BiomedCLIPMultiHeadAttention. Could you confirm whether this change is appropriate, or advise on a preferred fix?

2. NameError for VALIDATION in run_biomedical_training

NameError: name 'VALIDATION' is not defined

Unlike run_training, run_biomedical_training does not define VALIDATION, which raises this error. Defining VALIDATION = False allowed the script to run without further issues. Is this the intended behavior, or should VALIDATION be set elsewhere?

Thank you again for your work and for any guidance you can share.

[TahaKoleilat]

Hi @KangST. Thank you for your interest in our work. I fixed the second error, which was due to a missing VALIDATION variable. It is set to False by default but you can set it to True if you would like to use a validation set.

Regarding the first error, could you please point me to the specific file and line number in the stack trace? I ran the script in my environment and I didn't encounter this issue.