There is an open issue with Ollama that can cause the server to drop models or connections after long periods of dormancy. This issue is discussed in part here: ollama/ollama#3738
This becomes an issue for our system as we will need some mechanism to test for an absent model and respond to it.
There is an open issue with Ollama that can cause the server to drop models or connections after long periods of dormancy. This issue is discussed in part here: ollama/ollama#3738
This becomes an issue for our system as we will need some mechanism to test for an absent model and respond to it.