Compare projects

Project comparisons allow you to view any selection of projects side by side just like they're shown on regular categories or in search results. You can try out an example or start yourself by adding a library to the comparison via the input below. You can also easily share your current comparison with others by sending the URL of the current page.

twpipeline
0.0
The project is in a healthy, maintained state
Nine JSONL stages from a raw web crawl to dispersion-corrected frequency and n-gram tables: source gating, Taiwan-standard punctuation normalization, sentence segmentation, character-inventory and lexical-origin filtering, block-level evidence judgment, type deduplication, Viterbi word segmentation and external-sort counting. Resource-bounded by declared cores and memory.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026