Replaces the old search code with something that's not quite as much
spaghetti (e.g. not evolved over too much time), and more stable (actual
error handling instead of random crashes)
Crawlers are now also multithreaded to deal with higher latency to some
sites.
