Skip to content

Add shapefile version and error count to upload metadata (C-15) #12

Description

@Polichinel

Context

Both dsm.upload_data() calls in _save() carry metadata but lack enrichment provenance. An enrichment timestamp was added, but the following are still missing:

  • Shapefile version/hash (which GAUL/Natural Earth version produced the assignments)
  • Enrichment error count (how many GIDs had geometry errors or were unmapped)
  • Unmapped cell count

Without this, the FAO cannot audit the quality of received data or detect when a shapefile update changed assignments between deliveries.

Requirements

  • Add shapefile version identifier to upload metadata (at minimum, a hash or modification date of the loaded shapefiles)
  • Add enrichment error count if batch failures occurred
  • Determine whether upload_data() API supports additional metadata fields, or if description is the only free-text field

Risk Register

C-15 (Tier 3). Partially fixed (timestamp added). Remaining: no shapefile provenance.

Note

If ADR-011 is implemented (precomputed lookup table), the provenance becomes the lookup table's version/hash instead of shapefile metadata. The requirement for provenance remains regardless of enrichment method.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions