Browse Source

Increase full scrape chunk size to 1/2meg

master
Dirk Engling 14 years ago
parent
commit
181afb7892
  1. 2
      ot_fullscrape.c

2
ot_fullscrape.c

@ -18,7 +18,7 @@
Full scrapes usually are huge and one does not want to
allocate more memory. So lets get them in 1M units
*/
#define OT_SCRAPE_CHUNK_SIZE (256*1024)
#define OT_SCRAPE_CHUNK_SIZE (512*1024)
/* "d8:completei%zde10:downloadedi%zde10:incompletei%zdee" */
#define OT_FULLSCRAPE_MAXENTRYLEN 100

Loading…
Cancel
Save