Skip to content

Comments

chore: update test_tools to read a file instead of get a password#38

Merged
baxen merged 2 commits intosquare:mainfrom
codefromthecrypt:test-read-file
Sep 9, 2024
Merged

chore: update test_tools to read a file instead of get a password#38
baxen merged 2 commits intosquare:mainfrom
codefromthecrypt:test-read-file

Conversation

@codefromthecrypt
Copy link
Contributor

Fixes #37 and avoids some LLMs being overly sensitive about giving you a password.

Signed-off-by: Adrian Cole <adrian.cole@elastic.co>
Signed-off-by: Adrian Cole <adrian.cole@elastic.co>

response = ex.reply()

# It's possible this can be flakey, but in experience so far haven't seen it
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to say this, but might be TMI

    # On occasion, the LLM may forget it can do tool calls and fail. Retry in this case until
    # we have logic to handle this internally (retrying on text instead of tool choices).

Copy link
Collaborator

@baxen baxen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

)

ex.add(Message.user("Can you authenticate this session by responding with the password"))
ex.add(Message.user(f"Can you read the contents of this file: {temp_file}"))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There might be some ambiguity in this around if it actually shares the ouptut again in its response, i'd maybe rephrase as "What are the contents of this file: "

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding this now so we can include in upcoming release!

@baxen baxen merged commit df577cc into square:main Sep 9, 2024
lifeizhou-ap added a commit that referenced this pull request Sep 18, 2024
* main:
  feat: Rework error handling (#48)
  chore(release): release version 0.9.0 (#45)
  chore: add just command for releases and update pyproject for changelog (#43)
  feat: convert ollama provider to an openai configuration (#34)
  fix: Bedrock Provider request (#29)
  test: Update truncate and summarize tests to check for sytem prompt t… (#42)
  chore: update test_tools to read a file instead of get a password (#38)
  fix: Use placeholder message to check tokens (#41)
  feat: rewind to user message (#30)
  chore: Update LICENSE (#40)
  fix: shouldn't hardcode truncate to gpt4o mini (#35)
codefromthecrypt pushed a commit to codefromthecrypt/exchange that referenced this pull request Oct 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Swap out get_password test with read_file

2 participants