generated from amazon-archives/__template_Apache-2.0
-
Notifications
You must be signed in to change notification settings - Fork 609
Closed
Labels
area-providerRelated to model providersRelated to model providersenhancementNew feature or requestNew feature or request
Description
Problem Statement
The bedrock model provider stream method uses a thread by default to make a non-blocking call to converse_stream. Use of this thread disrupts the key interrupt mechanism in agent-builder. For this particular use case, we can accept a blocking call anyway and thus I propose we make this a configurable option on the bedrock provider.
Proposed Solution
Update the bedrock model provider to accept a threaded config that will control whether converse_stream is executed on the main thread or in a separate thread.
Use Case
- Prevent interference on key interrupts in
agent-builder.
Alternatives Solutions
No response
Additional Context
No response
Metadata
Metadata
Assignees
Labels
area-providerRelated to model providersRelated to model providersenhancementNew feature or requestNew feature or request