5 Commits

Author	SHA1	Message	Date
Brian Warner	c6a061e600	crawler: provide for one-shot crawlers, which stop after their first full cycle, for share-upgraders and database-populaters	2009-02-20 15:19:11 -07:00
Brian Warner	ef4ff21ae7	crawler: modify API to support upcoming bucket-counting crawler	2009-02-19 19:31:42 -07:00
Brian Warner	dfd72c6483	crawler: use fileutil.move_info_place in preference to our own version	2009-02-18 23:13:42 -07:00
Brian Warner	b949ea4f32	crawler: fix problems on windows and our slow cygwin slave	2009-02-18 22:24:31 -07:00
Brian Warner	193889f793	#633: first version of a rate-limited interruptable share-crawler	2009-02-18 21:46:33 -07:00