The TokenEx gem provides a convenient Ruby wrapper for the TokenEx API.

A simple string tokenizer designed to capture punctuation and sentence flow information.

Generates friendly (to urls and humans) tokens

tokenify is a utility class to generate and decrypt tokens using AES-256 encryption

Tokenize attributes in active record object.

The SDK allows framework independent two-factor authentication for your web application. Client handles both token generation and validation.

A simple multilingual tokenizer for NLP tasks. This tool provides a CLI and a library for linguistic tokenization which is an anavoidable step for many HLT (human language technology) tasks in the preprocessing phase for further syntactic, semantic and other higher level processing goals. Use it for tokenization of German, English and French texts.

This rubygem does not have a description or summary.

Adds token-based finders to ActiveRecord

TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

User management using tokens

Celluloid based Events manager (experimental)

Provides page token based pagination for your active record

Find and tokenise files!

A session store that uses session, json serialization, and gets session fullmeasure from an http header

🪙 Token::Resolver provides configurable PEG-based (parslet) parsing and resolution of structured tokens (e.g., {KJ|GEM_NAME}) in arbitrary text. Useful for template ETL pipelines where tokens in template files must be resolved before format-specific merging.

Simple token+secret authentication gem for use with has_secure_password for one-way encrypted secrets.

Toki.app command-line client: read your Toki data from the local database or from the App.net backup channel. Show the log for an app, the top apps, the grand total, usage by day or range of days, etc. Use the API in another app, or launch the local server.

Tools to process Toki Pona language

Japanese relative date/time string parser.