Project

tokenwise

0.0
Repository is gone
No release in over 3 years
A library for splitting your string up into words and sentences. * Comprehensive: Handles the cases that you miss with .split(" ") or .split(/W+/) * Lossless: Stores whitespacing for re-assembling the source string * Flexible: Extend the grammar with your own rules
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
 Dependencies