Skip to content

sync: engine 0.1.7 — hub cache fix, MLX import fix, default-q6 profile#24

Merged
prabod merged 1 commit into
mainfrom
sync/engine-0.1.7
Jul 21, 2026
Merged

sync: engine 0.1.7 — hub cache fix, MLX import fix, default-q6 profile#24
prabod merged 1 commit into
mainfrom
sync/engine-0.1.7

Conversation

@prabod

@prabod prabod commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Sync with engine 0.1.7 (path-mapped from the internal v0.1.7 tag — exact tag-to-tag diff, no drift).

  • base-convert / hub: basert pull no longer duplicates pulled models in the global HF cache (staged download + rename, sha-gated cleanup, resume preserved; opt-out BASERT_KEEP_HF_SOURCES=1). Catalog updates.
  • base-readers: MLX 3/5/6-bit little-endian bitstream unpack fix (fixes wrong weights when converting MLX-quantized models at those widths) + new dequant fixture tests.
  • Profiles: new bundled default-q6 target (--target base-q6).
  • Headers (+ swift binding mirror): new baseRT_decode_token_raw() — length-preserving raw-byte token decode for byte-level BPE tokens that can contain NUL. No struct-layout changes, so binding size guards are unaffected.
  • CLI workspace version → 0.1.7.

Merge with (or after) the v0.1.7 engine release.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: a48581a3ba

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment on lines +132 to +133
if std::fs::rename(&real, dst).is_ok() {
return Ok(());

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Clean staging before returning from a moved install

In install_file, the owned-cache path renames the real hf-hub blob into model.base but leaves the snapshot symlink in .src/hf dangling until a later caller invokes cleanup_staging. If the process is interrupted after this return and before cleanup (for example during catalog SHA verification or sidecar writing), retries see a broken staged snapshot for the same repo and can remain wedged until the user manually deletes the staging directory. Please remove the repo staging immediately after a successful move, or otherwise avoid returning with a dangling hf-hub cache entry.

Useful? React with 👍 / 👎.

@prabod
prabod merged commit c42d056 into main Jul 21, 2026
10 checks passed
@prabod
prabod deleted the sync/engine-0.1.7 branch July 21, 2026 03:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant