Skip to content
/ qwc Public

Quick Word Count bash script, samples text files to give quick, approximate "wc -l" responses for large files

Notifications You must be signed in to change notification settings

epheph/qwc

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

Repository files navigation

This is a very specific bash script which gives quick line count results (similar to `wc -l`) by sampling the first few lines of a file (configurable) and dividing into the average of the reported file size. My need for this utility arose when dealing with multi-GB fixed-width data files.

It's worth noting that for fixed-width files, the results of qwc should be identical to "wc -l".

To run, simply run as you would wc -l:

$ qwc data.txt
2129950

$ qwc -l data.txt
2129950


The "-l" is optional, so you can perform an operation like this (using bash):

$ wc -l data2.txt
( taking too long, Ctrl+C)
$ q!! 
qwc -l data2.txt
9342447

About

Quick Word Count bash script, samples text files to give quick, approximate "wc -l" responses for large files

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages