Skip to content

Feature Request: Community‑driven hardware benchmark sharing database #363

Description

@mayipiaopiao

Describe the feature

I hope to add a community benchmark sharing feature:
Users can submit their real‑world test data, including:

  1. Machine hardware config: GPU model, VRAM, CPU, RAM
  2. Model name & quant version running on FreeToken
  3. Real measured performance: token/s prefill/decode speed
  4. Max context length achieved, stable or limitation

These submitted benchmark records can be browsed/searchable for other users.

Use case

Users who are making hardware purchase decisions can directly look up real‑world test results from other community users.
Help people know what performance/context size to expect on their hardware before buying GPU or running large models.

Alternative ideas considered

Option A: Maintain a markdown table in repo docs for manual PR contributions.
Option B: Simple UI inside desktop app to upload benchmark entries.
Option C: Discussion page to collect benchmark reports first.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions