I really like the way Smart Spidey is designed. Its crwals websites very quickley. Once you have scanned crawled all your files further crawling time is decrease by I guess more than 70% its very very cool unlike other softwares. The search engine which it generates is also very effective and works smoothly for large websites.