KV cache quantized to q8_0 (PR)#3

Nexesenex merged 1 commit intoNexesenex:master_kv_q8_0Nexesenex/croco.cpp:master_kv_q8_0from

JohannesGaessler:kv-q8_0JohannesGaessler/llama.cpp:kv-q8_0Copy head branch name to clipboard