Update to use tasks/workers to speed up scrapes

[timstapl]

This should offer significant improvements.

Shouldn't be too difficult to implement.