Issues

• Study on OSS maven library vulnerabilities: httpcomponents library

  soulgalore/crawler#14 · Filter by author raux opened on Oct 2, 2016

• Upgrade to latest HTTPClient 4.3.X

  enhancement
  soulgalore/crawler#7 · Filter by author soulgalore opened on Jan 24, 2014
  

• Make it possible to follow multiple domains (lex http://us.yahoo.com/)

  enhancement
  soulgalore/crawler#6 · Filter by author soulgalore opened on Jan 4, 2014

• Check & make sure that the links are sorted with the first found one first

  question
  soulgalore/crawler#5 · Filter by author soulgalore opened on Dec 27, 2013

• Add parameter to limit the number of fetched links

  enhancement
  soulgalore/crawler#4 · Filter by author soulgalore opened on Dec 27, 2013

• Cleanup the use of the request header

  enhancement
  soulgalore/crawler#3 · Filter by author soulgalore opened on Nov 1, 2013

• Make HTMLPageResponse less memory intensive

  soulgalore/crawler#1 · Filter by author soulgalore opened on Mar 29, 2013
  2