Skip to content

docs: related work and competitor table (session 19) - #146

Merged
ParsaVictor merged 2 commits into
mainfrom
s19-related-work
Oct 17, 2026
Merged

ParsaVictor merged 2 commits into
mainfrom
s19-related-work

Conversation

@ParsaVictor

Copy link
Copy Markdown
Owner

Adds docs/research/related-work-2026.md (new file only; paper-draft.md and contributions-log.md untouched). Research only: no benchmarks or builds were run.

  • Table 1: methods measured on the same protocol as our §5.1 (274 SWE-bench Lite instances, LocAgent Acc@k). It covers BM25, E5, Jina, CodeSage, CodeRankEmbed, SFR, GTE-Qwen2, SweRankEmbed S/L, SweRank+ Multi, SweRankLLM rerankers, Agentless, Moatless, SWE-agent, OpenHands, LocAgent and SWE-Adept, each with its source table, LLM, GPU and cost per issue.
  • Table 2: methods with other protocols or metrics, not directly comparable: Agentless, RepoGraph, OrcaLoca, CoSIL, KGCompass, SHERLOC, RepoMem, ToolTrain/RepoSearcher, CodeScout, FuseSearch, CoRet, SWE-Fixer, BLAZE and MULocBench.
  • An honest positioning paragraph, a drop-in ## 2. Related work section and a bibtex-ish reference list.

Every number cites the paper table it was read from. Any figure a paper does not report is marked –.

🤖 Generated with Claude Code

ParsaVictor and others added 2 commits October 17, 2026 08:09
Number-exact competitor table (LocAgent protocol, 274 Lite) plus other-protocol table,
honest positioning paragraph and a drop-in Related work section. Every number cites the
paper table it was read from; research only, no runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…es at func Acc@5

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@ParsaVictor
ParsaVictor merged commit 9945789 into main Oct 17, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant