Posted Sat, 28 Mar 2015 19:05:32 +0100 in reply to RASOLOFONIAINA Menjanahary Razafindranto
Am 28.03.2015 um 16:59 schrieb RASOLOFONIAINA Menjanahary Razafindranto:
Are the Client requests components of the framework fitted to write a web crawler/scraper?
You could certainly do that. vibe.http.client.requestHTTP
uses a
connection pool internally, so that existing server (keep-alive)
connections will be reused, so this kind of access pattern should be
efficient. Running multiple parallel requests using runTask
is also
not a problem. The only thing you'd potentially have to write on your
own is a throttling logic to avoid using up too many server resources.