Skip to content

readme: add feature-rich rust bindings#6465

Merged
ggerganov merged 1 commit intoggml-org:masterfrom
francis2tm:patch-3
Apr 3, 2024
Merged

readme: add feature-rich rust bindings#6465
ggerganov merged 1 commit intoggml-org:masterfrom
francis2tm:patch-3

Conversation

@francis2tm
Copy link
Copy Markdown
Contributor

Hello,
We've been developing these rust bindings since 6months+ and we actively maintain them.
Our bindings' most relevant features:

  • safe and easy to use API for completions and embeddings
  • blocking or async API
  • support for cpu, cuda, vulkan, metal and rocm/hipblas
  • support for various sampling methods
  • session memory size estimation

Hope you like this project!

Cheers.

@francis2tm francis2tm changed the title readme: add (almost) full-featured rust bindings readme: add feature-rich rust bindings Apr 3, 2024
@ggerganov ggerganov merged commit 154d4ee into ggml-org:master Apr 3, 2024
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
phuongncn pushed a commit to phuongncn/llama.cpp-gx10-dgx-sparks-deepseekv4 that referenced this pull request Apr 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants