Cool bash command for summary bot visited
I just found quite cool bash combination cat test.log | awk -F\" '{print $6}' | sort | uniq -c | sort -n from this http://www.blogtips.org/web-crawlers-love-the-good-but-kill-the-bad-and-the-ugly/ I try it with nginx log, the result is look good. :)