Skip to content

Update granite vision docs for 3.2 model#12105

Merged
ericcurtin merged 1 commit intoggml-org:masterfrom
alex-jw-brooks:granite_vision_doc_updates
Feb 28, 2025
Merged

Update granite vision docs for 3.2 model#12105
ericcurtin merged 1 commit intoggml-org:masterfrom
alex-jw-brooks:granite_vision_doc_updates

Conversation

@alex-jw-brooks
Copy link
Copy Markdown
Contributor

This PR updates the granite vision docs with a few changes, outlined below:

  • Updates docs from the 3.1 preview -> the newly released 3.2 2b model!
  • Updates the image grid pinpoints - there is a small change in the image grid pinpoints from the 3.1 preview
  • Adds guidance on quantization; the LLM can be quantized, but the visual encoder can't be since siglip has tensor dims nondivisible by 32, which could be a point of confusion for some, so adding some explicit guidance
  • Changes the example image to use the llama cpp banner, as the current link is no longer valid, and this model is good for things like doc understanding anyway

@danbev can you please take a look when you have a moment? 🙂

@alex-jw-brooks alex-jw-brooks force-pushed the granite_vision_doc_updates branch from 2534d2d to 07dab1b Compare February 28, 2025 07:40
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
@alex-jw-brooks alex-jw-brooks force-pushed the granite_vision_doc_updates branch from 07dab1b to c716fb8 Compare February 28, 2025 07:42
@ericcurtin ericcurtin merged commit 84d5f4b into ggml-org:master Feb 28, 2025
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Mar 19, 2025
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants