-h, --help show this help message and exit
-u URL Specify the begin url
-d DEPTH Specify the crawling depth
--logfile FILE The log file path, Default: spider.log
--loglevel {1,2,3,4,5}
The level of logging details. Larger number record
more details. Default:3
--thread NUM The amount of threads. Default:10
--dbfile FILE The SQLite file path. Default:data.sql
--key KEYWORD The keyword for crawling. Default: None. For more than
one word, quote them. example: --key 'Hello world'
--testself Crawler self test