Skip to content

Lmstudio Models are not listed correctly #2456

@haltingstate

Description

@haltingstate

Bug: GPT-120B-oss and other loaded models are not displayed in /models in opencode, when using lmstudio

  1. It will use GPT-120B-oss if I set model that is not on lmstudio (like qwen)

  2. but if I set GPT-30B-oss; then it will tell lmstudio to load that model and it loads model

  3. the model I am actually using (GPT-120B) does not show up in /models); and is only used if I select a model that lmstudio has not loaded

Maybe, use API, to check

    1. which models lm studio has loaded/ready (and show in /models)
    1. to check the context size for the model (which I had to increase; maybe put warning)

Very good job on this tool


I have Lmstudio running with GPT-120-oss

I am using opencode (latest).

I did "opencode auth login" and set BS api key for lm studio

  • NOTE: for LMstudio put note "type in any code; unless configured" when doing auth
  • it wasted 2 minutes of my time, looking up that lmstudio does not need api key unless configured; so instructioners were confusing
  • bug: blank api key is rejected as invalid for lmstudio auth,

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions