Skip to content

crawl refresh under the Seen-set TTL (ADR-0007) #70

Description

@filipeforattini

What to build

Add crawl refresh: re-seed a done Crawl so only URLs older than the Seen-set TTL re-admit (a bounded refresh, not a full recrawl). See ADR-0007.

Acceptance criteria

  • crawl refresh re-seeds a Crawl; only TTL-stale URLs re-admit.
  • A refresh with everything fresh is a near no-op.
  • Tests cover bounded refresh behaviour.

Blocked by

Metadata

Metadata

Assignees

No one assigned

    Labels

    blocked:dependencyWaiting on other issues (req:N edges); auto-unblocks when the last dependency closesreq:62Blocked on #62req:65Blocked on #65

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions