Skip to content

[FEATURE] Models - Bedrock - Configurable Thread Mode #560

@pgrayy

Description

@pgrayy

Problem Statement

The bedrock model provider stream method uses a thread by default to make a non-blocking call to converse_stream. Use of this thread disrupts the key interrupt mechanism in agent-builder. For this particular use case, we can accept a blocking call anyway and thus I propose we make this a configurable option on the bedrock provider.

Proposed Solution

Update the bedrock model provider to accept a threaded config that will control whether converse_stream is executed on the main thread or in a separate thread.

Use Case

  • Prevent interference on key interrupts in agent-builder.

Alternatives Solutions

No response

Additional Context

No response

Metadata

Metadata

Assignees

Labels

area-providerRelated to model providersenhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions