#

tinysegmenter

Here is 1 public repository matching this topic...

jestasgameland / Japanese_tokenizer

A small experiment using both Mecab and Tinysegmenter to create a tokenized list of Japanese sentences in JSON, taken from the Tatoeba corpus.

mecab tokenization tinysegmenter japanese-sentences tatoeba-corpus

Updated Mar 25, 2021
Python

Improve this page

Add a description, image, and links to the tinysegmenter topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the tinysegmenter topic, visit your repo's landing page and select "manage topics."