Skip to content

LM Studio a local 7B model issue "Cannot truncate prompt with n_keep (15028) >= n_ctx (7424)" #11141

@abdulqadar

Description

@abdulqadar

When I try to ask something to local LM studio LLM it gives below error.

Did some R&D to find where to adjust this but could not find the right place for this config.

"Cannot truncate prompt with n_keep (15028) >= n_ctx (7424)"

Image

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions