Linux Support

[Exagram]

Will Linux be supported?

[G2G2G2G]

.... just compile it you literally have to clone it and type "make" read the readme...

[Lupul]

I compiled it and run it on Ubuntu 22.04 with AMD 5700G cpu and got ~300ms/token (7B), ~550ms/token (13B)

Works on Artix, i5-9400f. 180ms/tok on 7B.

[ggerganov]

Linux and Mac OS are full supported through the Makefile

[JonWhiteRA]

Is there a preferred version of gcc for linux?

[G2G2G2G]

bigger number = better