Skip to content

Do not hardcode agent llm and embedding model #43

@marcorosa

Description

@marcorosa

Currently, the LLM powering the agent is gpt-4, and this choice is not configurable as its value is hardcoded here.
Same goes for the embedding model text-embedding-ada-002.

They should be default values and overriding should be possible with environment variables (e.g., in .env).

Furthermore, gpt-4 is getting aged and we should consider replacing it with gpt-4o or a o-model. See SAP notes on model for the currently available

Metadata

Metadata

Assignees

No one assigned

    Labels

    agentIssues specifically about the agent

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions