Conversation
|
@fdwr Please try https://ibelem.github.io/webnn-developer-preview/demos/phi-3-mini/ with latest Chrome Canary 132.0.6831.0 or newer, and let us know your feedback. Thanks! |
There was a problem hiding this comment.
Thanks Belem! 🙌
FYI @yassermkhan one of the new WebNN demos.
|
|
||
| log(`Phi-3 Mini model size: ${Math.round(model_size / 1024 / 1024)} MB`); | ||
| this.ml_context = await navigator.ml.createContext({ deviceType: "gpu" }); | ||
| const session_options = { |
There was a problem hiding this comment.
| const session_options = { | |
| const sessionOptions = { |
This file has a weird mix of camelCase and snake_case?
const session_options = ...
...
let progressBarLabel ...
| } | ||
| } | ||
|
|
||
| async initialize_feed() { |
There was a problem hiding this comment.
| async initialize_feed() { | |
| async initializeFeed() { |
|
@fdwr The UI of this project are mostly camelCase, but the llm file generated by guschmue originally was snake_case, e.g. model inputs for model overrides, transformers.js tokens. Is that possible to keep them? |
Let's keep them for now so we can get the demo out sooner. 🐍🙈
👍 Given @Adele101 successfully ran it locally, I will merge it now. |
2 participants
Add Phi-3 Mini demo:
Some changes needed in next PRs
@fdwr @Honry PTAL