Option to use alternatives to Openai

[apcameron]

I am trying to use alternatives to openai
One alternative is to use https://github.com/go-skynet/LocalAI
Another is to use llama.cpp with the python API plugin which I have partially working. I just need to find a good model to use to generate code.

It would be nice to have official support for alternative locally housed alternatives

[d3287t328]

try this one https://huggingface.co/replit/replit-code-v1-3b/tree/main

[OWL7seven]

I would like to see an option to choose other local models for noobs like me.

[Dr-42]

Any progress on this yet? Or if someone has forked and implemented it that would be great too.

[shusso]

@apcameron I wonder would StarCoder be a good model
https://huggingface.co/bigcode/starcoder#intended-use

[apcameron]

@shusso It may be but I do not have enough RAM to try that model on my local computers.

[iamjameswalters]

Is anyone looking into this? I'd absolutely love this tool, but using a non-local LLM model is a no-go for me.