Replies: 3 comments
-
|
Microsoft has already provided the gguf model weight on huggingface |
Beta Was this translation helpful? Give feedback.
-
|
it's a good method to use github codespace, which network band is as big as disk io. bad news is codespace have time limit (60 hours per month). |
Beta Was this translation helpful? Give feedback.
-
|
Yes it is theoretically possible to try BitNet on your VPS but not with the default Hugging Face → GGUF conversion pipeline. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
My computer is suck(in fact it's an azure free vps), my local machine is more suck. I want to know whether I can run bitnet on my vps?
because I see that bitnet support bitnet_b1_58-large which only have 0.7 B parameters. And I tried it on my vps, but it always converting HF model to GGUF format. It run out my memory(1GB) even swap memory space(2 GB), unfortunately my computer broken down, I have to shutdown it and turn it on over and over again.
now I want to know: is it possible to try bitnet on my vps and how?
looking forward to your reply, thanks.
Beta Was this translation helpful? Give feedback.
All reactions