Currently, LlamaDatasetGenerator and OpenAIDatasetGenerator fail silently or work opaquely. There is no visibility into the generated prompts or raw responses.
Task:
- Add a logger to
src/agentunit/generators/llm_generator.py.
- Log the generated prompt (debug level).
- Log the raw response text before parsing (debug level).
- Log any parsing errors (error/warning level).
Currently,
LlamaDatasetGeneratorandOpenAIDatasetGeneratorfail silently or work opaquely. There is no visibility into the generated prompts or raw responses.Task:
src/agentunit/generators/llm_generator.py.