Continuous Empirical Benchmarking

Workflow runs for Continuous Empirical Benchmarking

• Continuous Empirical Benchmarking

  completed successfully:
  Continuous Empirical Benchmarking#345:Scheduled
  main

  Oct 18, 20261m 50s
  More actions for workflow run 345

• docs: session 20 prompt and fast phases (#154)

  completed successfully:
  Continuous Empirical Benchmarking#344:Commit2b9b18dpushedbyParsaVictor
  main

  Oct 17, 20261m 54s
  More actions for workflow run 344

• docs: session 20 prompt

  completed successfully:
  Continuous Empirical Benchmarking#343:Pull request#154openedbyParsaVictor
  s19-next-prompt

  Oct 17, 20261m 51s
  More actions for workflow run 343

• paper: rerank ceiling as a headline result; SweRankEmbed-Small short-…

  completed successfully:
  Continuous Empirical Benchmarking#342:Commitd26d3e0pushedbyParsaVictor
  main

  Oct 17, 20261m 48s
  More actions for workflow run 342

• paper: rerank ceiling as headline; SweRankEmbed-Small short-list vote

  completed successfully:
  Continuous Empirical Benchmarking#341:Pull request#153openedbyParsaVictor
  s19-paper-ceiling

  Oct 17, 20261m 53s
  More actions for workflow run 341

• Measured: SweRankEmbed-Small vote once on Lite/Verified (func Acc@5 0…

  completed successfully:
  Continuous Empirical Benchmarking#340:Commit8668e5fpushedbyParsaVictor
  main

  Oct 17, 20262m 0s
  More actions for workflow run 340

• Measured: SweRankEmbed-Small vote once on Lite/Verified (func@5 0.496 / 0.472)

  completed successfully:
  Continuous Empirical Benchmarking#339:Pull request#152openedbyParsaVictor
  s19-swerank-holdout

  Oct 17, 20261m 51s
  More actions for workflow run 339

• research: SweRankEmbed-Small short-list vote (k=30 passes pre-registe…

  completed successfully:
  Continuous Empirical Benchmarking#338:Commit549c977pushedbyParsaVictor
  main

  Oct 17, 20261m 49s
  More actions for workflow run 338

• research: SweRankEmbed-Small short-list vote (k=30 passes pre-registered bar on all 4 halves; k=100 fails dev-rest)

  completed successfully:
  Continuous Empirical Benchmarking#337:Pull request#150synchronizebyParsaVictor
  s19-swerank

  Oct 17, 20261m 47s
  More actions for workflow run 337

• research: SweRankEmbed-Small short-list vote (k=30 passes pre-registered bar on all 4 halves; k=100 fails dev-rest)

  completed successfully:
  Continuous Empirical Benchmarking#336:Pull request#150synchronizebyParsaVictor
  s19-swerank

  Oct 17, 20261m 54s
  More actions for workflow run 336

• log: §8.20 rerank ceiling (Lite gold functions in engine top-300: 0.8…

  completed successfully:
  Continuous Empirical Benchmarking#335:Commit6a5c072pushedbyParsaVictor
  main

  Oct 17, 20261m 58s
  More actions for workflow run 335

• log: rerank ceiling §8.20 (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#334:Pull request#151openedbyParsaVictor
  s19-ceiling

  Oct 17, 20261m 55s
  More actions for workflow run 334

• research: SweRankEmbed-Small short-list vote (k=30 passes pre-registered bar on all 4 halves; k=100 fails dev-rest)

  completed successfully:
  Continuous Empirical Benchmarking#333:Pull request#150synchronizebyParsaVictor
  s19-swerank

  Oct 17, 20261m 53s
  More actions for workflow run 333

• research: SweRankEmbed-Small short-list vote (k=30 passes pre-registered bar on all 4 halves; k=100 fails dev-rest)

  completed successfully:
  Continuous Empirical Benchmarking#332:Pull request#150synchronizebyParsaVictor
  s19-swerank

  Oct 17, 20261m 52s
  More actions for workflow run 332

• docs: gap analysis vs best published localisers, rerank ceiling, phas…

  completed successfully:
  Continuous Empirical Benchmarking#331:Commit18e081dpushedbyParsaVictor
  main

  Oct 17, 20261m 20s
  More actions for workflow run 331

• docs: gap analysis + phased plan (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#330:Pull request#149openedbyParsaVictor
  s19-gap-plan

  Oct 17, 20261m 51s
  More actions for workflow run 330

• paper: arXiv-ready LaTeX source + reviewer risks (session 19) (#148)

  completed successfully:
  Continuous Empirical Benchmarking#329:Commit40f9fa9pushedbyParsaVictor
  main

  Oct 17, 20261m 54s
  More actions for workflow run 329

• Session 19: SWE-Gym split, opt-in dense function vote (Lite func@5 0.…

  completed successfully:
  Continuous Empirical Benchmarking#328:Commit41c5700pushedbyParsaVictor
  main

  Oct 17, 20261m 51s
  More actions for workflow run 328

• paper: arXiv-ready LaTeX source + reviewer risks (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#327:Pull request#148synchronizebyParsaVictor
  s19-paper-latex

  Oct 17, 20261m 14s
  More actions for workflow run 327

• paper: arXiv-ready LaTeX source + reviewer risks (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#326:Pull request#148synchronizebyParsaVictor
  s19-paper-latex

  Oct 17, 20261m 48s
  More actions for workflow run 326

• Session 19: SWE-Gym split, opt-in dense function vote (Lite func@5 0.460 -> 0.485)

  completed successfully:
  Continuous Empirical Benchmarking#325:Pull request#147synchronizebyParsaVictor
  s19-gym-split

  Oct 17, 20261m 47s
  More actions for workflow run 325

• paper: arXiv-ready LaTeX source + reviewer risks (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#324:Pull request#148openedbyParsaVictor
  s19-paper-latex

  Oct 17, 20261m 44s
  More actions for workflow run 324

• docs: related work and competitor table (session 19) (#146)

  completed successfully:
  Continuous Empirical Benchmarking#323:Commit9945789pushedbyParsaVictor
  main

  Oct 17, 20265m 4s
  More actions for workflow run 323

• Session 19: SWE-Gym split, opt-in dense function vote (Lite func@5 0.460 -> 0.485)

  completed successfully:
  Continuous Empirical Benchmarking#322:Pull request#147openedbyParsaVictor
  s19-gym-split

  Oct 17, 20263m 48s
  More actions for workflow run 322

• docs: related work and competitor table (session 19)

  completed successfully:
  Continuous Empirical Benchmarking#321:Pull request#146openedbyParsaVictor
  s19-related-work

  Oct 17, 20263m 33s
  More actions for workflow run 321