First of all it's really great news that v2 is out, I have moved all my bots to the latest release and I'm experimenting with the new avoid duplicate feature, thanks for all this amazing work !
Now that Queueing is out I was wondering if we could revisit the idea of spacing out posts in the queue when there is more than 2 posts in the queue, simply set a timer to space each posts of X minutes that could be configurable via the config.json
In previous exchanges about this I had concern about :
use cases of news bots that have high volume of posts :
- what if there is a queue of 10 posts, spaced out by 5 minutes between each posts and while this first queue is still flushing out, 5 or 10 new posts comes in the queue, how could we solve not accumulating perpetually the queue by either dropping posts in the queue or accelerating the rate to make sure to flush the queue completely at least every 30 minutes.
I know this may be very edgy use case, but I'm worried about queue filling up and flushing out too slowly creating a whole new set of issues but perhaps the only fix for this is to lower the overall volume of post of the bot at the source (rss feed)
Let me know what you think, perhaps you'll have a better idea, maybe @garaytc can chime in if he has some time :)
First of all it's really great news that v2 is out, I have moved all my bots to the latest release and I'm experimenting with the new avoid duplicate feature, thanks for all this amazing work !
Now that Queueing is out I was wondering if we could revisit the idea of spacing out posts in the queue when there is more than 2 posts in the queue, simply set a timer to space each posts of X minutes that could be configurable via the config.json
In previous exchanges about this I had concern about :
use cases of news bots that have high volume of posts :
I know this may be very edgy use case, but I'm worried about queue filling up and flushing out too slowly creating a whole new set of issues but perhaps the only fix for this is to lower the overall volume of post of the bot at the source (rss feed)
Let me know what you think, perhaps you'll have a better idea, maybe @garaytc can chime in if he has some time :)