Repository navigation
paper: arXiv-ready LaTeX source + reviewer risks (session 19) - #148
Merged
Merged
Conversation
paper/main.tex (article class, one- or two-column via the Makefile), seven table files, refs.bib (39 entries; arXiv author lists and titles read from the abstract pages), a static checker (check.py: braces, environments, inputs, cite keys, labels, ASCII) and REVIEWER-RISKS.md (the ten hardest objections, our answer, the missing experiment). Integrates session 19: SWE-Gym third holdout, learned-reranker negative result, opt-in dense short-list vote on Lite-274 (func Acc@5 0.460 -> 0.485). Verified dense-vote number is a \todo. Positioned honestly below SweRankEmbed-Small and CodeRankEmbed. Not compiled (no TeX on this machine); check.py passes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Turns
docs/research/paper-draft.mdinto an arXiv-ready LaTeX paper inpaper/. No benchmarks or builds were run.paper-draft.mdandcontributions-log.mdare unchanged.Files
paper/main.tex:articleclass. One column by default;make twocolbuilds the two-column version from the same source.paper/tables/*.tex: seven tables. They cover the Lite-274 head-to-head (same subset and metric only), all holdouts (BM25 vs engine, file and function level), the dense short-list vote, the ablation, the plain-language holdouts, cost, and negative results. Each table's header comment names the log section its numbers come from.paper/refs.bib: 39 entries, all of them cited. The author lists and titles of the 28 arXiv entries come from their arXiv abstract pages, and each entry carries its eprint id. Venues follow the related-work file (docs: related work and competitor table (session 19) #146).paper/Makefile: targetsall,twocol,tectonic,check,todo(fails while any\todois left),arxiv(packs the.bblwith the sources) andclean.paper/check.py: static checks for a machine with no TeX installed. It checks brace and environment balance,\inputfiles, cite keys, labels and ASCII-only source, and it lists TODOs.paper/REVIEWER-RISKS.md: the 10 hardest reviewer objections, with our current answer to each and the experiment that is still missing.What the paper adds beyond the draft:
Positioning: the paper states up front that the engine is below CodeRankEmbed and SweRankEmbed-Small (0.664 / 0.631) and below the LLM agents. The claim is the no-model, CPU-only, zero-token, holdout corner of the trade-off.
Still open (
make checklists them):Not verified: the source has not been compiled, because there is no pdflatex or tectonic on this machine.
python paper/check.pypasses. Runmakeonce wherever TeX is available.🤖 Generated with Claude Code