Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -214,6 +214,21 @@ of `--runtime-path`. BaseRT 0.2.4 and newer can also start this client with
BaseRT remains responsible for choosing a compatible backend artifact,
downloading split files, conversion, and writing `hub.json` provenance.

ComputeArena says when the BaseRT it found is worth updating, and never
refuses to run an older one. A harness that does not advertise the
headline-first protocol (BaseRT 0.2.4 and older) is named before the benchmark
plan, with what its report will be signed as; this needs no network, because
the harness describes itself. A newer BaseRT release is mentioned the same way.
That lookup asks GitHub for BaseRT's latest release in the background, keeps
the answer for 24 hours in `basert-update-check.json`, and never delays or
fails a run; when it has not answered before a benchmark starts, the notice
follows the run instead. `computearena basert install` installs the latest
release where the official installer does, and the full-screen interface
offers the same with `u` on its menu, asking for a second press before it
replaces anything. A harness chosen with `--runtime-path` or
`COMPUTEARENA_BASERT_HARNESS` is yours to update, and on platforms without a
prebuilt BaseRT the notice points at the release to build from instead.

### llama.cpp

The adapter asks for a GGUF file rather than scanning the disk, and lists the
Expand Down Expand Up @@ -346,6 +361,7 @@ minimumClientVersion for an actionable upgrade message.
| `COMPUTEARENA_API_URL` | API base URL, same as `--api-url` |
| `COMPUTEARENA_BASERT_HARNESS` | Path to `basert-benchmark-harness`, same as `--runtime-path` for BaseRT |
| `BASERT_INSTALL_DIR` | Where BaseRT is looked for and installed; `~/.basert` by default |
| `COMPUTEARENA_BASERT_RELEASE_API` | Where BaseRT's latest release is looked up, for mirrors and tests; GitHub's API for `basecompute/baseRT` by default. Only a version number is read from the answer |
| `BASERT_MODELS_DIR` | Where installed BaseRT models are listed from; BaseRT's own model cache by default |
| `CUDA_VISIBLE_DEVICES` | Respected by the CUDA chip fallback; a mask leaves the chip unresolved |
| `NO_COLOR` | Plain output |
Expand Down
4 changes: 2 additions & 2 deletions crates/computearena-cli/src/adapters/basert.rs
Original file line number Diff line number Diff line change
Expand Up @@ -17,14 +17,14 @@ enum TelemetryMode {
NativeSameRun,
}

fn supports_isolated_workloads(descriptor: &Value) -> bool {
pub(crate) fn supports_isolated_workloads(descriptor: &Value) -> bool {
descriptor
.pointer("/features/isolated_workload_contexts")
.and_then(Value::as_bool)
== Some(true)
}

fn supports_headline_capacity(descriptor: &Value) -> Result<bool> {
pub(crate) fn supports_headline_capacity(descriptor: &Value) -> Result<bool> {
let supported = descriptor
.pointer("/features/headline_context_capacity")
.and_then(Value::as_bool)
Expand Down
Loading
Loading