Add DINOv2 with registers (using diff)

[NielsRogge]

What does this PR do?

This PR is a follow-up of #31832 but uses the diff instead of rewriting from scratch.

Had 2 issues with the diff:

• the drop_path function was causing an issue. Applying the suggestion at #31832 fixed it.
• the diff doesn't properly add super().__init__() to the Backbone class. I manually added it in the modeling file as otherwise there's an error.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[ArthurZucker]

Super nice! thanks for using diff, really fits well

[NielsRogge]

@ArthurZucker thanks for the review, addressed your comments. Note that there were still some issues with the diff converter (see my first message), but other than that this PR seems ready

[codybum]

Support for dinov2 with registers would be very much appreciated!

[ArthurZucker]

#33248 will resolve all your issues 🤗

[ArthurZucker]

I'll ask you to wait a tiny little bit as it will conflict with this work!

[codybum]

@ArthurZucker thanks for the review, addressed your comments. Note that there were still some issues with the diff converter (see my first message), but other than that this PR seems ready

Looks like Modular transformers: modularity and inheritance for new model additions #33248 was merged a few hours ago!

[ArthurZucker]

Yep! Make sure to rebase!

[codybum]

I think I did the wrong @ initially. @NielsRogge do you have time to rebase and update? If not, we can give it a go.

@ArthurZucker thanks for the review, addressed your comments. Note that there were still some issues with the diff converter (see my first message), but other than that this PR seems ready

Looks like Modular transformers: modularity and inheritance for new model additions #33248 was merged a few hours ago!

[NielsRogge]

Hi, feel free to take over, it's probably easy as only one method needs to be overwritten.

[NielsRogge]

Closing this one, will try out the new modular Transformers when I have time