Repository navigation
docs(exp-18): judge-capability rerun on v0.1.0, plus speed and cost - #38
Merged
Merged
Conversation
…1k (mizan Exp 07b)
Owner
Author
|
Added the speed and cost results (mizan Experiment 07b, ghchinoy/mizan#111), measured on the production G4 endpoint as-is:
Docs sync, link check and |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This updates EXP-18, the mizan Experiment 07 judge study, with a full same-session rerun on serving image v0.1.0. Vertex G4 reported
version v0.1.0,revision f241b77; Cloud Run served the same digest. The 2026-09-26 run on the older images is kept as a replication.vertex_first), 182 ms on Cloud Run, and 3,125 ms for gemini-3.8-flash.Checks: docs sync (43/43 pages), link check (0 broken) and
make check-publicall pass. The full report is mizandocs/experiments/07-judge-capability-rerun.md, landing in ghchinoy/mizan#110.