Content not getting pulled in due to timing issues

[evoltech]

On my sweeper installation content from channels is not getting pulled in. I keep getting messages like:

Jan 19 23:35:30     [debug] Core::Modules::SiSPS::Parsers::TwitterParser::GetForTwitterSearch [Skipped feed item as date 2011-01-19T23:12:35-08:00 less than last sucessful run (2011-01-19T23:34:29-08:00)]

and

Jan 19 23:35:39     [debug] Core::Modules::SiSPS::Parsers::GoogleNewsParser::GetAndParse [Skipped feed item as date 2011-01-19T10:47:00-08:00 less than last sucessful run (2011-01-19T23:34:39-08:00)]

The problem I think is due to lag of the internet compared with the frequency that each channel is getting updated. Each channel will be checked about once a minute and will have its lastSucecess time updated. The next time content items are looked for they will be skipped if they are older then the channels lastSuccess value.

I am not sure what the solution is here, but this is preventing any content from getting pulled.

[jgosier]

Thanks for posting this. It's definitely in our short term roadmap to move over to PubSubHubBub in the near feature which will improve the way content is pulled in. We also want to put some options in place for controlling just how frequently each channel updates.

However skipping any sort of content is certainly a bug, so we'll work on a shorter term solution for the next release.