Project
Reverse Dependencies for sentencepiece
The projects listed here declare sentencepiece as a runtime or development dependency
0.0
Pure-Ruby facade over Hugging Face `tokenizers`, OpenAI `tiktoken_ruby`, and
SentencePiece bindings that maps ruby_llm model identifiers (gpt-4o,
llama-3, mistral, ...) to the correct tokenizer and exposes a small API for
counting, analyzing, and truncating text against a model's context window.
...
2021
2022
2023
2024
2025
2026