Commit graph

13 commits

Author SHA1 Message Date
PeterChrz
7e57fb5e16
Split band total into Devlogic and Sysops; remove config badge
Replace the single Band total with two adjacent metric groups:
- Devlogic total: softbench, prosebench, psychbench, depthsweep
  (all non-infra, non-scenario suites)
- Sysops total: infrabench + scenariobench

Each group independently shows geo-mean tok/s, total tokens, and
pass/fail counts. Scenariobench contributes per-observation
gen_tokens/wall rates to the sysops geo-mean.

Remove the server-config badge (e.g. 'llama.cpp DFlash spec-decode,
131k ctx, fa on') from the front-page card header. Label, quant, and
engine badges remain.

Migration drops the old total_* columns and adds devlogic_* and
sysops_* columns to session_summaries.
2026-10-04 23:38:13 -04:00
PeterChrz
9bf17dba6f
Make label part of band identity; correct ASUS GPU attribution
Labels now define distinct sessions — different power-cap configs
(asus_210w, sapphire_210w, asus_uncapped) render as separate bands
instead of merging into one. The label badge displays alongside
quant/engine/config badges rather than replacing them.

Scenario drilldown filters by label to prevent cross-band mixing.

Data fix: runs 22-32 (asus_210w) and 43-46 (asus_uncapped) reassigned
from Sapphire (gpu_id=11) to ASUS (gpu_id=12) — they were run on the
ASUS card but imported with the Sapphire GPU identity.
2026-10-04 23:18:21 -04:00
PeterChrz
f96fd1ad77
Exclude scenariobench from band total geo mean; label tok/s 2026-10-01 14:53:59 -04:00
PeterChrz
8c9e512fc2
Add geometric-mean band total (tok/s + tokens) under each band header 2026-09-30 15:47:01 -04:00
PeterChrz
f334538866
Surface thinking level for scenariobench bands; backfill Ollama Cloud runs to low 2026-09-30 10:30:55 -04:00
PeterChrz
163a16a386
Add cloud providers to GPU catalog; relink hosted runs to Ollama Cloud 2026-09-30 09:42:54 -04:00
PeterChrz
06908e252d
v2.4: per-band scenariobench aggregation, band scenario detail page, nickname badges, orderBy fix 2026-09-20 22:49:23 -04:00
PeterChrz
9f9327bb27
v2.3: group runs by actual harness config, per-level depthsweep, scenario gen speed, named server configs 2026-09-19 23:45:04 -04:00
PeterChrz
e406b52a2d
CLI device login flow (Sanctum + device_codes, authorize screen, /api/me, /api/gpus) + canonical GPU catalog (gpus table, seeder, import normalizer, my-runs confirm picker, festbench:gpus + festbench:tokens) 2026-09-19 12:56:40 -04:00
PeterChrz
2e205ef792
v2.1: session-grouped summary home page (GPU/model/quant/runner bands, per-suite pass/fail, avg + weighted tok/s), flat task table moved to /results, summary command + tables on schedule and after import 2026-09-18 20:12:30 -04:00
PeterChrz
11e720f6f3
v2 Phase D: home_snapshot table + refresh command, TTL caching, public CDN cache headers for guest pages 2026-09-18 15:01:41 -04:00
PeterChrz
8c75db59f0
v2 Phase A+B: Postgres, partitioned per-suite tables, suite registry, all_results view, import rework, surgical re-import of deterministic session 2026-09-18 14:41:33 -04:00
PeterChrz
8863585fd6
Phase 4: festbench:import artisan command, real-schema fixture tests, imported 109 real runs 2026-09-16 22:42:38 -04:00