Repository navigation
Session 19: SWE-Gym split, opt-in dense function vote (Lite func@5 0.460 -> 0.485) - #147
Merged
Merged
Conversation
…miss buckets; learned reranker prototype Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… the bar on SWE-Gym halves; decision locked before Lite/Verified gym-a/gym-b func Acc@5 +0.030/+0.059; pooled dev+gym n=476 +0.032 [0.015,0.050], 17 gained / 2 lost, p=0.0007. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…cted, dense vote accepted; abstract numbers fixed Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… top-30, RRF w=0.5) Decided on dev + pre-registered SWE-Gym split (func Acc@5 +0.032, p=0.0007); port check on SWE-Gym +0.037/+0.045; Lite LocAgent-274 run once 0.460 -> 0.485. Off by default; falls back silently. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
….007); paper tables Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
ParsaVictor
added a commit
that referenced
this pull request
Oct 17, 2026
* paper: arXiv-ready LaTeX source, competitor table, reviewer risks paper/main.tex (article class, one- or two-column via the Makefile), seven table files, refs.bib (39 entries; arXiv author lists and titles read from the abstract pages), a static checker (check.py: braces, environments, inputs, cite keys, labels, ASCII) and REVIEWER-RISKS.md (the ten hardest objections, our answer, the missing experiment). Integrates session 19: SWE-Gym third holdout, learned-reranker negative result, opt-in dense short-list vote on Lite-274 (func Acc@5 0.460 -> 0.485). Verified dense-vote number is a \todo. Positioned honestly below SweRankEmbed-Small and CodeRankEmbed. Not compiled (no TeX on this machine); check.py passes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * paper: fill Verified dense-vote number (459: func Acc@5 0.429 -> 0.458, +0.028 [0.009,0.048], p=0.007) Source: contributions-log.md sec. 8.18 at ce0dceb (PR #147). Abstract, contributions, sec. 5.3, threats and reviewer risk #5 updated to match. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * paper: dense table footnote covers Verified too Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Session 19.
NM_DENSE=1, opt-in): jina-code-v2 on the top-30 functions, RRF w=0.5. Dev+gym pooled func Acc@5 +0.032 (p=0.0007); Rust port on gym +0.037/+0.045; Lite LocAgent-274 run once: func Acc@5 0.460 → 0.485, Acc@1 0.223 → 0.252. Verified run once: func Acc@5 0.429 → 0.458 (p=0.007).🤖 Generated with Claude Code