Skip to content

Added stream support for llm#142

Merged
vizsatiz merged 7 commits into
developfrom
CU-86d0nc7jr-Add-stream-support-in-flo-ai
Oct 21, 2025
Merged

Added stream support for llm#142
vizsatiz merged 7 commits into
developfrom
CU-86d0nc7jr-Add-stream-support-in-flo-ai

Conversation

@ananthu1997
Copy link
Copy Markdown
Contributor

Added the streaming support in LLMs

@vizsatiz
Copy link
Copy Markdown
Member

@ananthu1997 Please update the readme file

pass

@abstractmethod
async def stream(
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add an example in Readme on how to use this

Comment thread flo_ai/pyproject.toml Outdated
pypdf = "^4.2.0"
pymupdf4llm = "^0.0.17"
chardet = ">=3.dev0,<4.dev0"
pymupdf = "^1.26.5"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why was this added ?

Comment thread flo_ai/flo_ai/llm/gemini_llm.py Outdated
if hasattr(chunk, 'text') and chunk.text:
yield {'content': chunk.text}
except Exception as e:
raise Exception(f'Error in Gemini streaming API call: {str(e)}')
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove

@vizsatiz vizsatiz merged commit 92d62e8 into develop Oct 21, 2025
4 checks passed
@vizsatiz vizsatiz deleted the CU-86d0nc7jr-Add-stream-support-in-flo-ai branch October 21, 2025 06:41
thomastomy5 pushed a commit that referenced this pull request Apr 27, 2026
* Added stream support for llm

* fixed the build issue

* Added the testcases and fixed minor issues

* Added the testcases and fixed minor issues

* Fixed the poetry issues

* Fixed the poetry issues

* Removed the Exception block form stream functions

---------

Co-authored-by: Ananthu <ananthu@KANDOEWINs-MacBook-Pro.local>
Co-authored-by: Ananthu <ananthu@MacBookPro.localdomain>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants