Where: ROADMAP.md Phase 5, results/ (results_fairness.csv, results_performance.csv, summary.csv, figures/), profiler.html (as the existing web/CLI split precedent).
Current gap: ROADMAP.md's Phase 5 checklist has one remaining unchecked item: - [ ] Fairness dashboard for the benchmark harness results (interactive results/ explorer, mirroring the Open Dataset Profiler's web/CLI split) - every other Phase 5 item is checked off, including the Open Dataset Profiler itself and the benchmark harness that produces results/. Right now faircode benchmark only writes static CSVs and PNG figures with no browser-based way to explore/filter them (by audit, model, strategy, metric, protected attribute) the way profiler.html lets you explore a single dataset's profile interactively.
Repro:
$ grep -n "Fairness dashboard for the benchmark harness" ROADMAP.md
- [ ] Fairness dashboard for the benchmark harness results (interactive `results/` explorer, mirroring the Open Dataset Profiler's web/CLI split)
Suggested approach: a new static page (e.g. benchmark.html + assets/benchmark-dashboard.js) that fetches/parses results/results_fairness.csv and results/results_performance.csv client-side (or accepts a drag-and-drop of a user's own results/ export) and renders filterable tables/charts - audit × model × strategy × metric - reusing the existing bootstrap-CI/permutation-p-value columns already in those CSVs, styled consistently with the design tokens shared by index.html/profiler.html.
Where:
ROADMAP.mdPhase 5,results/(results_fairness.csv, results_performance.csv, summary.csv, figures/),profiler.html(as the existing web/CLI split precedent).Current gap: ROADMAP.md's Phase 5 checklist has one remaining unchecked item:
- [ ] Fairness dashboard for the benchmark harness results (interactive results/ explorer, mirroring the Open Dataset Profiler's web/CLI split)- every other Phase 5 item is checked off, including the Open Dataset Profiler itself and the benchmark harness that producesresults/. Right nowfaircode benchmarkonly writes static CSVs and PNG figures with no browser-based way to explore/filter them (by audit, model, strategy, metric, protected attribute) the wayprofiler.htmllets you explore a single dataset's profile interactively.Repro:
Suggested approach: a new static page (e.g.
benchmark.html+assets/benchmark-dashboard.js) that fetches/parsesresults/results_fairness.csvandresults/results_performance.csvclient-side (or accepts a drag-and-drop of a user's ownresults/export) and renders filterable tables/charts - audit × model × strategy × metric - reusing the existing bootstrap-CI/permutation-p-value columns already in those CSVs, styled consistently with the design tokens shared byindex.html/profiler.html.