when it support VLLM prompt optimizing?

[YanLiang0813]

now only support LLM prompt, when it support VLLM prompt?

[miangangzhen]

you can use OpenaiLLM

from prompt_scope.core.llms.openai_llm import OpenaiLLM
optim_llm = OpenaiLLM(
        openai_api_key="",
        openai_api_base="", # vllm url
        model="gpt-4o",
        temperature=0.0
    )