Skip to content

AttentionProcessor.group_norm num_channels should be query_dim #3046

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
williamberman merged 2 commits into from
Apr 11, 2023

add_{k,v}_proj should be projecting to inner_dim

33b4c02
Select commit
Loading
Failed to load commit list.
Merged

AttentionProcessor.group_norm num_channels should be query_dim #3046

add_{k,v}_proj should be projecting to inner_dim
33b4c02
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs