Gemma3 not supported in main branch

[xihuai18]

System Info

latest main branch of 0325

Who can help?

@amyeroberts, @qubvel

Gemma3Config is not supported in the lastest main branch.

ValueError: Unrecognized configuration class <class 'transformers.models.gemma3.configuration_gemma3.Gemma3Config'> for this kind of AutoModel: AutoModel.

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

run gemma3 using AutoModel.from_config

Expected behavior

No.

[zucchini-nlp]

@xihuai18 hey! We don't have a base Gemma3Model class yet, I am adding base classes for all vision LLMs currently in #36367. If you want to get last hidden state from the model, you can do as follows:

model = Gemma3ForConditionalGeneration.from_pretrained(model_id)
last_hidden_states = model(input_ids, pixel_values=pixel_values).hidden_states[-1]

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.