Skip to content

feat: add PARAPHRASE_MULTILINGUAL_MINILM_L12_V2 text embeddings model#1115

Draft
msluszniak wants to merge 1 commit into@bo/bumpTokenizerCapabilitiesfrom
@ms/paraphrase-multilingual-minilm
Draft

feat: add PARAPHRASE_MULTILINGUAL_MINILM_L12_V2 text embeddings model#1115
msluszniak wants to merge 1 commit into@bo/bumpTokenizerCapabilitiesfrom
@ms/paraphrase-multilingual-minilm

Conversation

@msluszniak
Copy link
Copy Markdown
Member

Description

Adds the paraphrase-multilingual-MiniLM-L12-v2 sentence-transformer model — the second multilingual embeddings model after distiluse, completing #945. Ships all four export variants (xnnpack/{fp32,8da4w}, coreml/{fp32,fp16}) under MODEL_REGISTRY.ALL_MODELS; the playground exposes the two RNE-recommended variants (_8DA4W and _COREML).

384-d output, max 126 tokens, 50+ languages. Tokenizer is Unigram + Precompiled normalizer + Metaspace decoder — requires the bumped pytorch/extension/llm/tokenizers runtime from #1114, so this PR blocks on that landing first and should be rebased onto main once #1114 merges.

HF repo: software-mansion/react-native-executorch-paraphrase-multilingual-MiniLM-L12-v2 (v0.9.0 tag, layout mirrors distiluse).

Introduces a breaking change?

  • Yes
  • No

Type of change

  • Bug fix (change which fixes an issue)
  • New feature (change which adds functionality)
  • Documentation update (improves or adds clarity to existing documentation)
  • Other (chores, tests, code style improvements etc.)

Tested on

  • iOS
  • Android

Testing instructions

  1. cd apps/text-embeddings && npx expo run:ios.
  2. Pick "Multilingual Paraphrase (8da4w)" in the model picker.
  3. Add a sentence in one language, query with an aligned sentence in another (e.g. Polish "Słoneczko" against "It's so sunny outside!"). The cross-lingual pair should top the matches.

Screenshots

Related issues

Closes the paraphrase-multilingual half of #945 (the distiluse half landed in #1098).

Checklist

  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have updated the documentation accordingly
  • My changes generate no new warnings

Additional notes

Blocks on #1114. The local commit needed --no-verify only because this branch sits on top of #1114, whose base predates the vision-camera v5 typecheck fix #1088; once #1114 rebases / merges with main, the lefthook noise resolves.

@msluszniak msluszniak self-assigned this Apr 30, 2026
@msluszniak msluszniak added the feature PRs that implement a new feature label Apr 30, 2026
@msluszniak msluszniak linked an issue Apr 30, 2026 that may be closed by this pull request
@msluszniak msluszniak added the blocked Issue blocked by some problems (but not other issue, use relationship -> blocker instead) label Apr 30, 2026
@msluszniak msluszniak force-pushed the @bo/bumpTokenizerCapabilities branch from 78b5a13 to f1341d2 Compare April 30, 2026 12:14
@msluszniak msluszniak force-pushed the @ms/paraphrase-multilingual-minilm branch from 9cd7623 to 27e7204 Compare April 30, 2026 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

blocked Issue blocked by some problems (but not other issue, use relationship -> blocker instead) feature PRs that implement a new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature request: multilingual text embeddings model

1 participant