dorian-csv-uniq
Deduplicate CSV rows, optionally by selected keys.
Install
gem install dorian-csv-uniqAlso included in the aggregate gem:
gem install dorianUsage
csv-uniq [options] [key ...] [file ...]Run csv-uniq -h for generated option details and csv-uniq -v for the installed version.
Notes
- Without keys it deduplicates whole rows. With
--headers, keys can be header names.
Examples
Deduplicate rows
printf 'a,1\nb,2\na,1\n' | csv-uniqDeduplicate by a header
csv-uniq --headers -p key input.csv