Although web crawlers have been around for twenty years by now, there is virtually no freely available, open-source crawling software that guarantees high throughput, over- comes the limits of single-machine tools and at the same time scales linearly with the amount of resources available. This paper aims at filling this gap.

BUbiNG: Massive Crawling for the Masses

MARINO, ANDREA;
2014

Abstract

Although web crawlers have been around for twenty years by now, there is virtually no freely available, open-source crawling software that guarantees high throughput, over- comes the limits of single-machine tools and at the same time scales linearly with the amount of resources available. This paper aims at filling this gap.
9781450327459
9781450327459
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11568/790766
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 61
  • ???jsp.display-item.citation.isi??? ND
social impact