Skip to content

Add public SentencePieceTokenizer factory methods for Unigram from vocab list and tokenizer.json#7625

Open
Copilot wants to merge 4 commits into
mainfrom
copilot/add-sentencepiece-tokenizer-api
Open

Add public SentencePieceTokenizer factory methods for Unigram from vocab list and tokenizer.json#7625
Copilot wants to merge 4 commits into
mainfrom
copilot/add-sentencepiece-tokenizer-api

Commits

Commits on Jun 10, 2026

Commits on Jun 11, 2026