festbench-web/app/Console/Commands
PeterChrz ac941fdd27
fix: switch devlogic/sysops totals from geo-mean to token-weighted average
The headline totals were using a per-task geometric mean, which gave
disproportionate weight to short responses with low effective user_tps
(e.g. 2-token SoftBench answers at ~1.2 tok/s). This produced misleadingly
low Devlogic totals (20.5 for asus_210w) when the displayed suite speeds
were all in the 40-50 tok/s range.

Replace geo-mean accumulators (ln_sum/ln_n) with token-weighted
accumulators (rate_token_sum = sum(user_tps × tokens)). The headline total
is now rate_token_sum / total_tokens, matching the methodology already used
by each displayed suite row.

For ScenarioBench, the suite aggregate gen_tps (sum(gen_tokens)/sum(wall))
is weighted by the suite's total generated tokens, keeping the headline
total consistent with the displayed ScenarioBench row.

Results for the 210W bands:
  asus_210w:    devlogic 20.5 → 47.0, sysops 19.5 → 10.6
  sapphire_210w: devlogic 19.6 → 43.7, sysops 8.3 → 8.8
2026-10-05 00:00:19 -04:00
..
FestbenchImport.php v2.3: group runs by actual harness config, per-level depthsweep, scenario gen speed, named server configs 2026-09-19 23:45:04 -04:00
Gpus.php Add cloud providers to GPU catalog; relink hosted runs to Ollama Cloud 2026-09-30 09:42:54 -04:00
HomeSnapshot.php v2 Phase D: home_snapshot table + refresh command, TTL caching, public CDN cache headers for guest pages 2026-09-18 15:01:41 -04:00
SessionSummary.php fix: switch devlogic/sysops totals from geo-mean to token-weighted average 2026-10-05 00:00:19 -04:00
SuitesRefresh.php v2 Phase A+B: Postgres, partitioned per-suite tables, suite registry, all_results view, import rework, surgical re-import of deterministic session 2026-09-18 14:41:33 -04:00
Tokens.php CLI device login flow (Sanctum + device_codes, authorize screen, /api/me, /api/gpus) + canonical GPU catalog (gpus table, seeder, import normalizer, my-runs confirm picker, festbench:gpus + festbench:tokens) 2026-09-19 12:56:40 -04:00