pch/festbench-llm
1
0
Fork 0
Code Issues Pull requests Projects Releases 6 Packages Wiki Activity Actions

6 releases 6 tags

RSS feed
  • v0.3.4 430c0dd644

    v0.3.4 Stable

    pch released this 2026-09-21 12:11:00 +00:00 | 1 commits to main since this release

    Hosted OpenAI-compatible providers (Ollama Cloud, and anything speaking the same protocol), plus --inference-args.

    benchlib assumed llama.cpp on every axis: /health for liveness, /props for
    identity, a single served model so the request body could say "x", and
    reasoning_content as the only spelling of reasoning. A hosted provider fails
    all four, quietly -- a run filed under whichever model sorts first, reasoning
    counted as zero, and TTFT timing the reasoning phase as prefill.

    --model name the model to request, e.g. deepseek-v4-flash:cloud
    --engine record the inference host, e.g. ollama-cloud
    --inference-args renamed from --server-config; the old flag still works

    Every change is a widening: llama.cpp keeps its existing path and stays
    zero-config. A hosted endpoint now reports thinking level n/a rather than
    claiming a level it has no mechanism to honour.

    Downloads