Project
Reverse Dependencies for sentencepiece
The projects listed here declare sentencepiece as a runtime or development dependency
0.0
Pure-Ruby facade over Hugging Face `tokenizers`, OpenAI `tiktoken_ruby`, and
SentencePiece bindings that maps ruby_llm model identifiers (gpt-4o,
llama-3, mistral, ...) to the correct tokenizer and exposes a small API for
counting, analyzing, and truncating text against a model's context window.
Includes an opt-in approximation backend for models with no published
tokenizer (Claude).
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026