Repository navigation
ocr: lighton-ocr3-live.py, LightOnOCR-3 with a live view of the run (experimental) - #191
Merged
Merged
Conversation
…pages (experimental) Same OCR, flags and output as lighton-ocr3-saturate.py, plus --live-port: a page served from the Job that shows each finished page moving past at the rate the pages finish, pages per second, one finished page with its text, and counters. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ
…entences, one text sample) Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ
…its text Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ
…TATUS Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
An experimental LightOnOCR-3 recipe with a live view of the run.
lighton-ocr3-saturate.pyis not changed and stays the recipe for normal runs.What it does
lighton-ocr3-saturate.py(the OCR code is a copy), withsaturatepinned to 0.3.1.--live-portserves a page from inside the Job. Each finished page moves past on a belt, and the belt moves at the rate the pages finish. Under it: the pages read a second, the model and GPU, the page count, and the text the model wrote for one recent page.?view=singleon the same link shows one page at a time, each laid on the last at the same pace, with that page's text beside it.rtx-pro-6000. The Job, and the page, end 20 seconds after the run.Cost of the live view
One 480 px JPEG per page in the preparation threads, and one small request per open tab every half second. It does not change what is sent to the model or what is written.
Measured
One run with the live view open, on one
rtx-pro-6000: 14,483 typed pages (about 780 output tokens a page) in 1,881 s, 7.7 pages a second, 0 error rows.saturatereported the engine as the limit in 910 of 911 samples. That run fed pages from multi-page TIFFs with a one-off source and this recipe's settings; it is not the committed file.A run of the first version on 2,724 dense pages from a 1771 encyclopaedia read 1.5 pages a second and was input-bound, so the belt is slow on material like that.
Checks
0c07326), header only, 60 rows: 60 of 60, 0 error rows, everyfinish_reasonstop. During the run the page,?view=single, a page image and the feed were fetched and were correct. Record inmaintenance/verifications.jsonl.tools/build-catalog.py --verify-modelsandtools/recipe-status.py --checkpass.ruff checkpasses.Known gaps
--live-portbut not--expose-public, so the page is not reachable from that command as written.unlimited-ocr2-live.pyhas the same gap.🤖 Generated with Claude Code
https://claude.ai/code/session_016isSPqmhWLsJ9njKL2JUSQ