Conversation
|
你好你好,Thank you for putting this together — the amount of work behind collecting, cleaning, indexing, quantizing, and documenting 188,512 catalog records is genuinely impressive. The manifest and reference client also make the dataset much easier to understand. After reviewing the proposal, we don’t think the dataset is a good fit for the main
This is not a negative assessment of the dataset itself. The offline TF-IDF index, embeddings, similarity graph, and clusters could be valuable for offline or semantic-search use cases that Primo does not provide. A better architecture would be to publish the dataset separately—such as in a dedicated repository, a versioned GitHub Release asset, or a standalone data package—and let the CLI download it optionally in the future. That would preserve the work while keeping the core repository and default installation lightweight. For those reasons, we’re going to close this PR without merging it. We’d be very happy to discuss a smaller follow-up proposal for optional dataset downloading/caching, or improvements that build on the existing live Primo integration. Thank you again for the thoughtful contribution and for documenting it so thoroughly. 🤗 |
What
Adds an offline library catalog database for
library search/library detail,compiled from the public Primo VE catalog export (2026-09-18, 188,512 records).
No code changes in this PR.
Contents (
data/library-catalog/)cards.jsonl.gzembeddings_int8.bin(+size scale, PCA components)knn_indptr/indices/simsclusters.i32.bin+clusters.jsontfidf/subjects.json/shelves.jsonmanifest.jsonexamples/node-client.jsREADME.mdSize note
Total ~131 MB (largest file 72.4 MB). Happy to convert to Git LFS, or trim to a
smaller core subset, if you prefer — let me know.
Primo mapping
docId = L:alma<mms>; official detailUrl template inmanifest.jsoncreators <- creator.split(";");date <- year;format <- typeSource
Public bibliographic facts from the library's public read-only Primo interface
(no login required).