Skip to content

feat: moonshine and whisper streaming#110

Merged
mkopcins merged 34 commits intomainfrom
@mkopcins/moonshine
Mar 6, 2025
Merged

feat: moonshine and whisper streaming#110
mkopcins merged 34 commits intomainfrom
@mkopcins/moonshine

Conversation

@mkopcins
Copy link
Copy Markdown
Collaborator

Description

Moonshine and whisper with streaming mode in IOS

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update (improves or adds clarity to existing documentation)

Tested on

  • iOS
  • Android

Testing instructions

Screenshots

Related issues

Checklist

  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have updated the documentation accordingly
  • My changes generate no new warnings

Additional notes

@mkopcins mkopcins changed the title @mkopcins/moonshine feat: moonshine and whisper streaming Feb 27, 2025
@mkopcins mkopcins requested a review from chmjkb February 27, 2025 00:27
Mateusz Kopciński added 3 commits February 27, 2025 08:44
Refactored SpeechToText module on native side to work with both moonshine and whisper
Added ET execute function for calling arbitrary exported method
Refactored SpeecToTextController on TS side
Implemented transcribtion streaming like whisper_streaming
Comment thread examples/computer-vision/App.tsx
Comment thread examples/computer-vision/ios/Podfile.lock
Comment thread ios/RnExecutorch/models/stt/MoonshineDecoder.mm Outdated
Comment thread ios/RnExecutorch/models/stt/MoonshineEncoder.mm Outdated
Comment thread src/native/NativeSpeechToText.ts
Comment thread src/SpeechToTextController.ts Outdated
Comment thread src/SpeechToTextController.ts Outdated
Comment thread src/SpeechToTextController.ts Outdated
Comment thread src/SpeechToTextController.ts Outdated
Comment thread src/models/SpeechToText.ts Outdated
@mkopcins mkopcins force-pushed the @mkopcins/moonshine branch from 91aa69f to b844873 Compare February 27, 2025 22:27
Comment thread ios/RnExecutorch/models/stt/MoonshineDecoder.mm Outdated
Comment thread ios/RnExecutorch/models/stt/Whisper.mm Outdated
Comment thread src/constants/modelUrls.ts Outdated
Comment thread src/controllers/SpeechToTextController.ts Outdated
Comment thread src/controllers/SpeechToTextController.ts Outdated
Comment thread src/hooks/computer_vision/SpeechToText.ts Outdated
Comment thread src/modules/natural_language_processing/SpeechToTextModule.ts Outdated
Comment thread src/modules/natural_language_processing/SpeechToTextModule.ts
Comment thread examples/computer-vision/package.json Outdated
Comment thread examples/computer-vision/screens/SpeechToTextScreen.tsx Outdated
Comment thread src/controllers/SpeechToTextController.ts Outdated
Comment thread src/controllers/SpeechToTextController.ts Outdated
Comment thread android/src/main/java/com/swmansion/rnexecutorch/SpeechToText.kt
Comment thread android/src/main/java/com/swmansion/rnexecutorch/SpeechToText.kt Outdated
Comment thread examples/speech-to-text/screens/SpeechToTextScreen.tsx Outdated
Comment thread examples/speech-to-text/screens/SpeechToTextScreen.tsx Outdated
Comment thread examples/speech-to-text/screens/SpeechToTextScreen.tsx Outdated
Comment thread examples/speech-to-text/screens/SpeechToTextScreen.tsx
Comment thread examples/speech-to-text/screens/SpeechToTextScreen.tsx
@mkopcins mkopcins force-pushed the @mkopcins/moonshine branch from 4adc5b4 to 0801c82 Compare March 6, 2025 12:17
@mkopcins mkopcins merged commit ca02d17 into main Mar 6, 2025
@mkopcins mkopcins deleted the @mkopcins/moonshine branch March 6, 2025 14:51
JakubGonera pushed a commit that referenced this pull request Mar 12, 2025
## Description
Moonshine and whisper with streaming mode in IOS

### Type of change
- [ ] Bug fix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- [ ] Documentation update (improves or adds clarity to existing
documentation)

### Tested on
- [x] iOS
- [ ] Android

### Testing instructions
<!-- Provide step-by-step instructions on how to test your changes.
Include setup details if necessary. -->

### Screenshots
<!-- Add screenshots here, if applicable -->

### Related issues
<!-- Link related issues here using #issue-number -->

### Checklist
- [x] I have performed a self-review of my code
- [x] I have commented my code, particularly in hard-to-understand areas
- [ ] I have updated the documentation accordingly
- [ ] My changes generate no new warnings

### Additional notes
<!-- Include any additional information, assumptions, or context that
reviewers might need to understand this PR. -->

---------

Co-authored-by: Mateusz Kopciński <mateusz.kopcinski@swmansnion.com>
Co-authored-by: chmjkb <jakubchmura1607@gmail.com>
mkopcins added a commit that referenced this pull request Oct 15, 2025
## Description
Moonshine and whisper with streaming mode in IOS

### Type of change
- [ ] Bug fix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- [ ] Documentation update (improves or adds clarity to existing
documentation)

### Tested on
- [x] iOS
- [ ] Android

### Testing instructions
<!-- Provide step-by-step instructions on how to test your changes.
Include setup details if necessary. -->

### Screenshots
<!-- Add screenshots here, if applicable -->

### Related issues
<!-- Link related issues here using #issue-number -->

### Checklist
- [x] I have performed a self-review of my code
- [x] I have commented my code, particularly in hard-to-understand areas
- [ ] I have updated the documentation accordingly
- [ ] My changes generate no new warnings

### Additional notes
<!-- Include any additional information, assumptions, or context that
reviewers might need to understand this PR. -->

---------

Co-authored-by: Mateusz Kopciński <mateusz.kopcinski@swmansnion.com>
Co-authored-by: chmjkb <jakubchmura1607@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants