Skip to content

refactor: Experimental optimizations#47

Draft
crueter wants to merge 1 commit into
PolyMC:masterfrom
crueter:optimizations-exp
Draft

refactor: Experimental optimizations#47
crueter wants to merge 1 commit into
PolyMC:masterfrom
crueter:optimizations-exp

Conversation

@crueter

@crueter crueter commented Jul 20, 2026

Copy link
Copy Markdown
Collaborator

Some experimental and presently untested optimizations to a few of the scripts. Most of this is bypassing Pydantic's incredibly slow model parsing.

  • Larger chunk sizes for download writes, which should reduce syscall overload.
  • Avoid pydantic's slow parse_obj method, might be faster?
  • Rewrote Neoforge generation to write a dict directly rather than deal with Pydantic nonsense
  • Got rid of the thousands of sort operations on recommended_versions
  • Faster dict conversion to sidestep Pydantic's recursive parsing

Python sucks.

Some experimental and presently untested optimizations to a few of the
scripts. Most of this is bypassing Pydantic's incredibly slow model
parsing.

- Larger chunk sizes for download writes, which should reduce syscall
  overload.
- Avoid pydantic's slow parse_obj method, might be faster?
- Rewrote Neoforge generation to write a dict directly rather than deal
  with Pydantic nonsense
- Got rid of the thousands of sort operations on recommended_versions
- Faster dict conversion to sidestep Pydantic's recursive parsing

Python sucks.

Signed-off-by: crueter <crueter@eden-emu.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant