Skip to content

Use etags in addition to modified date for files to skip reprocessing #253

Description

@kyteinsky

Describe the feature you'd like to request

Right now only modified date is used to check if a file changed. If a newer modification date arrives than what is stored in the vector db, we re-index the file. It may be possible that the content of the file did not change but some other metadata changed.
This needs a little investigation on the modification date change specifics in the nextcloud server side and in context_chat side if that case is already covered like file name changes.

Thanks @miaulalala

Describe the solution you'd like

Use etag in addition to modified date to consider re-index of a file.

Describe alternatives you've considered

/

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions