chore: update constraints-dev.txt (2026-02-02) #652
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,114 +1,118 @@ | ||
| absl-py==2.4.0 # via tensorboard | ||
| accelerate==1.12.0 # via peft, trl, -r requirements-cuda.txt, -r requirements-rocm.txt | ||
| aiofiles==25.1.0 # via -r requirements.txt | ||
| aiohappyeyeballs==2.6.1 # via aiohttp | ||
| aiohttp==3.13.3 # via fsspec | ||
| aiosignal==1.4.0 # via aiohttp | ||
| annotated-types==0.7.0 # via pydantic | ||
| anyio==4.12.1 # via httpx, jupyter-server | ||
| argon2-cffi==25.1.0 # via jupyter-server | ||
| argon2-cffi-bindings==25.1.0 # via argon2-cffi | ||
| arrow==1.4.0 # via isoduration | ||
| astroid==4.0.3 # via pylint | ||
| asttokens==3.0.1 # via stack-data | ||
| async-lru==2.1.0 # via jupyterlab | ||
| attrs==25.4.0 # via aiohttp, jsonschema, referencing | ||
| babel==2.18.0 # via jupyterlab-server | ||
| beautifulsoup4==4.14.3 # via nbconvert | ||
| bitsandbytes==0.49.1 # via -r requirements-cuda.txt | ||
| bleach==6.3.0 # via nbconvert | ||
| cachetools==7.0.0 # via tox | ||
| causal-conv1d==1.6.0 # via mamba-ssm | ||
| certifi==2026.1.4 # via httpcore, httpx, requests, sentry-sdk | ||
| cffi==2.0.0 # via argon2-cffi-bindings | ||
| cfgv==3.5.0 # via pre-commit | ||
| chardet==5.2.0 # via tox | ||
| charset-normalizer==3.4.4 # via requests | ||
| click==8.3.1 # via typer-slim, wandb | ||
| colorama==0.4.6 # via tox | ||
| comm==0.2.3 # via ipykernel, ipywidgets | ||
| contourpy==1.3.3 # via matplotlib | ||
| cycler==0.12.1 # via matplotlib | ||
| datasets==4.5.0 # via trl, -r requirements.txt | ||
| debugpy==1.8.20 # via ipykernel | ||
| decorator==5.2.1 # via ipython | ||
| deepspeed==0.18.5 # via -r requirements-deepspeed.txt | ||
| defusedxml==0.7.1 # via nbconvert | ||
| dill==0.4.0 # via datasets, multiprocess, pylint | ||
| distlib==0.4.0 # via virtualenv | ||
| einops==0.8.2 # via deepspeed, flash-attn, mamba-ssm | ||
| executing==2.2.1 # via stack-data | ||
| fastjsonschema==2.21.2 # via nbformat | ||
| filelock==3.20.3 # via datasets, huggingface-hub, torch, tox, transformers, virtualenv | ||
| flash-attn==2.7.4.post1 # via -c constraints-dev.txt.in, -r requirements-cuda.txt, -r requirements-rocm.txt | ||
| fonttools==4.61.1 # via matplotlib | ||
| fqdn==1.5.1 # via jsonschema | ||
| frozenlist==1.8.0 # via aiohttp, aiosignal | ||
| fsspec==2025.10.0 # via datasets, huggingface-hub, torch | ||
| gitdb==4.0.12 # via gitpython | ||
| gitpython==3.1.46 # via wandb | ||
| grpcio==1.76.0 # via tensorboard | ||
| h11==0.16.0 # via httpcore | ||
| hf-xet==1.2.0 # via huggingface-hub | ||
| hjson==3.1.0 # via deepspeed | ||
| httpcore==1.0.9 # via httpx | ||
| httpx==0.28.1 # via datasets, huggingface-hub, jupyterlab | ||
| huggingface-hub==1.3.5 # via accelerate, datasets, kernels, peft, tokenizers, transformers, -r requirements-dev.txt | ||
| identify==2.6.16 # via pre-commit | ||
| idna==3.11 # via anyio, httpx, jsonschema, requests, yarl | ||
| iniconfig==2.3.0 # via pytest | ||
| ipykernel==7.1.0 # via jupyter, jupyter-console, jupyterlab, -r requirements-dev.txt | ||
| ipython==9.9.0 # via ipykernel, ipywidgets, jupyter-console, -r requirements-dev.txt | ||
| ipython-pygments-lexers==1.1.1 # via ipython | ||
| ipywidgets==8.1.8 # via jupyter | ||
| isoduration==20.11.0 # via jsonschema | ||
| isort==7.0.0 # via pylint, -r requirements-dev.txt | ||
| jedi==0.19.2 # via ipython | ||
| jinja2==3.1.6 # via jupyter-server, jupyterlab, jupyterlab-server, nbconvert, torch | ||
| json5==0.13.0 # via jupyterlab-server | ||
| jsonpointer==3.0.0 # via jsonschema | ||
| jsonschema==4.26.0 # via jupyter-events, jupyterlab-server, nbformat | ||
| jsonschema-specifications==2025.9.1 # via jsonschema | ||
| jupyter==1.1.1 # via -r requirements-dev.txt | ||
| jupyter-client==8.8.0 # via ipykernel, jupyter-console, jupyter-server, nbclient | ||
| jupyter-console==6.6.3 # via jupyter | ||
| jupyter-core==5.9.1 # via ipykernel, jupyter-client, jupyter-console, jupyter-server, jupyterlab, nbclient, nbconvert, nbformat | ||
| jupyter-events==0.12.0 # via jupyter-server | ||
| jupyter-lsp==2.3.0 # via jupyterlab | ||
| jupyter-server==2.17.0 # via jupyter-lsp, jupyterlab, jupyterlab-server, notebook, notebook-shim | ||
| jupyter-server-terminals==0.5.4 # via jupyter-server | ||
| jupyterlab==4.5.3 # via jupyter, notebook | ||
| jupyterlab-pygments==0.3.0 # via nbconvert | ||
| jupyterlab-server==2.28.0 # via jupyterlab, notebook | ||
| jupyterlab-widgets==3.0.16 # via ipywidgets | ||
| kernels==0.12.1 # via -r requirements-cuda.txt | ||
| kiwisolver==1.4.9 # via matplotlib | ||
| lark==1.3.1 # via rfc3987-syntax | ||
| librt==0.7.8 # via mypy | ||
| liger-kernel==0.6.4 # via -r requirements-cuda.txt | ||
| llvmlite==0.46.0 # via numba | ||
| mamba-ssm==2.3.0 # via -r requirements-cuda.txt, -r requirements-rocm.txt | ||
| markdown==3.10.1 # via tensorboard | ||
| markdown-it-py==4.0.0 # via rich | ||
| markupsafe==3.0.3 # via jinja2, nbconvert, werkzeug | ||
| matplotlib==3.10.8 # via -r requirements-dev.txt | ||
| matplotlib-inline==0.2.1 # via ipykernel, ipython | ||
| mccabe==0.7.0 # via pylint | ||
| mdurl==0.1.2 # via markdown-it-py | ||
| mistune==3.2.0 # via nbconvert | ||
| mpmath==1.3.0 # via sympy | ||
| msgpack==1.1.2 # via deepspeed | ||
| multidict==6.7.1 # via aiohttp, yarl | ||
| multiprocess==0.70.18 # via datasets | ||
| mypy==1.19.1 # via -r requirements-dev.txt | ||
| mypy-extensions==1.1.0 # via mypy | ||
| nbclient==0.10.4 # via nbconvert | ||
| nbconvert==7.17.0 # via jupyter, jupyter-server | ||
| nbformat==5.10.4 # via jupyter-server, nbclient, nbconvert | ||
| nest-asyncio==1.6.0 # via ipykernel | ||
| networkx==3.6.1 # via torch | ||
| ninja==1.13.0 # via causal-conv1d, deepspeed, mamba-ssm | ||
| nodeenv==1.10.0 # via pre-commit | ||
| notebook==7.5.3 # via jupyter | ||
| notebook-shim==0.2.4 # via jupyterlab, notebook | ||
| numba==0.63.1 # via -r requirements.txt | ||
| numpy==2.3.5 # via accelerate, bitsandbytes, contourpy, datasets, deepspeed, matplotlib, numba, pandas, peft, tensorboard, transformers, -r requirements-dev.txt, -r requirements.txt | ||
| nvidia-cublas-cu12==12.4.5.8 # via nvidia-cudnn-cu12, nvidia-cusolver-cu12, torch | ||
| nvidia-cuda-cupti-cu12==12.4.127 # via torch | ||
| nvidia-cuda-nvrtc-cu12==12.4.127 # via torch | ||
|
|
@@ -123,92 +127,92 @@ nvidia-nccl-cu12==2.21.5 # via torch | |
| nvidia-nvjitlink-cu12==12.4.127 # via nvidia-cusolver-cu12, nvidia-cusparse-cu12, torch | ||
| nvidia-nvtx-cu12==12.4.127 # via torch | ||
| overrides==7.7.0 # via jupyter-server | ||
| packaging==26.0 # via accelerate, bitsandbytes, causal-conv1d, datasets, deepspeed, huggingface-hub, ipykernel, jupyter-events, jupyter-server, jupyterlab, jupyterlab-server, kernels, mamba-ssm, matplotlib, nbconvert, peft, pyproject-api, pytest, tensorboard, tox, tox-uv, transformers, trl, wandb, wheel, -r requirements.txt | ||
| pandas==3.0.0 # via datasets | ||
| pandocfilters==1.5.1 # via nbconvert | ||
| parso==0.8.5 # via jedi | ||
| pathspec==1.0.4 # via mypy | ||
| peft==0.18.1 # via -r requirements.txt | ||
| pexpect==4.9.0 # via ipython | ||
| pillow==12.1.0 # via matplotlib, tensorboard | ||
| platformdirs==4.5.1 # via jupyter-core, pylint, tox, virtualenv, wandb | ||
| pluggy==1.6.0 # via pytest, tox | ||
| pre-commit==4.5.1 # via -r requirements-dev.txt | ||
| prometheus-client==0.24.1 # via jupyter-server | ||
| prompt-toolkit==3.0.52 # via ipython, jupyter-console | ||
| propcache==0.4.1 # via aiohttp, yarl | ||
| protobuf==6.33.5 # via tensorboard, wandb | ||
| psutil==7.2.2 # via accelerate, deepspeed, ipykernel, peft | ||
| ptyprocess==0.7.0 # via pexpect, terminado | ||
| pure-eval==0.2.3 # via stack-data | ||
| py-cpuinfo==9.0.0 # via deepspeed, -r requirements.txt | ||
| pyarrow==23.0.0 # via datasets | ||
| pycparser==3.0 # via cffi | ||
| pydantic==2.12.5 # via deepspeed, pylint-pydantic, wandb, -r requirements.txt | ||
| pydantic-core==2.41.5 # via pydantic | ||
| pygments==2.19.2 # via ipython, ipython-pygments-lexers, jupyter-console, nbconvert, pytest, rich | ||
|
Comment on lines
+151
to
153
There was a problem hiding this comment. 🧩 Analysis chain🌐 Web query:
💡 Result: Below are the important breaking changes introduced in Pydantic 2.12.x and a short, actionable migration checklist. Key breaking changes (what changed and impact)
Migration checklist (practical steps)
Important links (read first)
References Would you like a targeted migration patch plan for your codebase? If so, paste a few representative models/serializers/validator snippets and I’ll produce exact changes. 🏁 Script executed: # Check constraints-dev.txt for full context
head -n 160 constraints-dev.txt | tail -n 30Repository: instructlab/training Length of output: 1701 🏁 Script executed: # Search for Pydantic imports and usage in codebase
rg -i "from pydantic|import pydantic" --type py -A 2 | head -50Repository: instructlab/training Length of output: 360 🏁 Script executed: # Check for Pydantic model definitions in codebase
rg "BaseModel|ConfigDict|field_validator" --type py | head -30Repository: instructlab/training Length of output: 1015 🌐 Web query:
💡 Result: Short answer: DeepSpeed has migrated to Pydantic v2 (PRs/merges for v2 support exist), so it is generally compatible with Pydantic v2 releases — but you must use a matching pydantic_core version (Pydantic v2.12 enforces an exact pydantic-core pairing). If you see errors, upgrade DeepSpeed to the latest release/commit and ensure pydantic and pydantic-core versions match. (app.semanticdiff.com) What to do if you hit problems
If you want, tell me the DeepSpeed version and your installed pydantic / pydantic-core versions and I’ll verify compatibility and give exact pip commands. Citations:
🌐 Web query:
💡 Result: Short answer: Recent wandb SDK releases declare pydantic v2 compatibility (wandb added pydantic>=2.6,<33 in v0.19.0 and later relaxed support for v1/v2), so pydantic 2.12 is within the allowed range — but there are user-reported warnings/bugs when importing wandb with pydantic 2.12 that may require a patch or a temporary pin to an earlier 2.x release. [1][2][3] Details / action:
Sources: 🏁 Script executed: # Read the config.py file to check for usage patterns affected by breaking changes
wc -l src/instructlab/training/config.pyRepository: instructlab/training Length of output: 102 🏁 Script executed: # Check the actual config.py implementation
cat -n src/instructlab/training/config.py | head -100Repository: instructlab/training Length of output: 3328 🏁 Script executed: # Continue reading config.py to see model implementations and validators
cat -n src/instructlab/training/config.py | tail -n +100 | head -150Repository: instructlab/training Length of output: 5630 🏁 Script executed: # Check if there are any custom serializers, computed fields, or RootModel usage
rg -i "computed_field|root_model|field_serializer|model_serializer|serialize_as_any" --type pyRepository: instructlab/training Length of output: 46 🏁 Script executed: # Check for any JSON schema generation or Examples usage in config
rg "json_schema|Examples|model_json_schema" --type pyRepository: instructlab/training Length of output: 46 🏁 Script executed: # Check rest of config.py for more details on LoraOptions and any other Config class usage
cat -n src/instructlab/training/config.py | sed -n '135,200p'Repository: instructlab/training Length of output: 2234 🏁 Script executed: # Search for any old-style Config class usage (v1 pattern)
rg "class Config:" --type py -B 5Repository: instructlab/training Length of output: 413 🏁 Script executed: # Check requirements.txt and constraints-dev.txt to understand version pinning strategy
cat requirements.txt | grep -i "pydantic\|deepspeed\|wandb"Repository: instructlab/training Length of output: 79 Migrate LoraOptions to Pydantic v2 ConfigDict and evaluate wandb compatibility with 2.12.5. Pydantic 2.12.5 has documented breaking changes (JSON Schema merging, annotation handling, serialization behavior, and validator signatures). The pinned versions are compatible with deepspeed and pydantic-core, but:
🤖 Prompt for AI Agents |
||
| pylint==4.0.4 # via pylint-plugin-utils, pylint-pydantic, -r requirements-dev.txt | ||
| pylint-plugin-utils==0.9.0 # via pylint-pydantic | ||
| pylint-pydantic==0.4.1 # via -r requirements-dev.txt | ||
| pyparsing==3.3.2 # via matplotlib | ||
| pyproject-api==1.10.0 # via tox | ||
| pytest==9.0.2 # via -r requirements-dev.txt | ||
| python-dateutil==2.9.0.post0 # via arrow, jupyter-client, matplotlib, pandas | ||
| python-json-logger==4.0.0 # via jupyter-events | ||
| pyyaml==6.0.3 # via accelerate, datasets, huggingface-hub, jupyter-events, kernels, peft, pre-commit, transformers, wandb, -r requirements.txt | ||
| pyzmq==27.1.0 # via ipykernel, jupyter-client, jupyter-console, jupyter-server | ||
| referencing==0.37.0 # via jsonschema, jsonschema-specifications, jupyter-events | ||
| regex==2026.1.15 # via transformers | ||
| requests==2.32.5 # via datasets, jupyterlab-server, wandb | ||
| rfc3339-validator==0.1.4 # via jsonschema, jupyter-events | ||
| rfc3986-validator==0.1.1 # via jsonschema, jupyter-events | ||
| rfc3987-syntax==1.1.0 # via jsonschema | ||
| rich==14.3.2 # via -r requirements.txt | ||
| rpds-py==0.30.0 # via jsonschema, referencing | ||
| ruff==0.14.14 # via -r requirements-dev.txt | ||
| safetensors==0.7.0 # via accelerate, peft, transformers | ||
| send2trash==2.1.0 # via jupyter-server | ||
| sentry-sdk==2.51.0 # via wandb | ||
| setuptools==80.10.2 # via jupyterlab, mamba-ssm, tensorboard | ||
| shellingham==1.5.4 # via huggingface-hub | ||
| six==1.17.0 # via python-dateutil, rfc3339-validator | ||
| smmap==5.0.2 # via gitdb | ||
| soupsieve==2.8.3 # via beautifulsoup4 | ||
| stack-data==0.6.3 # via ipython | ||
| sympy==1.13.1 # via torch | ||
| tensorboard==2.20.0 # via -r requirements-dev.txt | ||
| tensorboard-data-server==0.7.2 # via tensorboard | ||
| terminado==0.18.1 # via jupyter-server, jupyter-server-terminals | ||
| tinycss2==1.4.0 # via bleach | ||
| tokenizers==0.22.2 # via transformers | ||
| tomlkit==0.14.0 # via pylint | ||
| torch==2.6.0 # via accelerate, bitsandbytes, causal-conv1d, deepspeed, flash-attn, liger-kernel, mamba-ssm, peft, -c constraints-dev.txt.in, -r requirements.txt | ||
| tornado==6.5.4 # via ipykernel, jupyter-client, jupyter-server, jupyterlab, notebook, terminado | ||
| tox==4.34.1 # via tox-uv, -r requirements-dev.txt | ||
| tox-uv==1.29.0 # via -r requirements-dev.txt | ||
| tqdm==4.67.2 # via datasets, deepspeed, huggingface-hub, peft, transformers | ||
| traitlets==5.14.3 # via ipykernel, ipython, ipywidgets, jupyter-client, jupyter-console, jupyter-core, jupyter-events, jupyter-server, jupyterlab, matplotlib-inline, nbclient, nbconvert, nbformat | ||
| transformers==5.0.0 # via mamba-ssm, peft, trl, -r requirements.txt | ||
| triton==3.2.0 # via liger-kernel, mamba-ssm, torch | ||
| trl==0.27.1 # via -r requirements.txt | ||
| typer-slim==0.21.1 # via huggingface-hub, transformers | ||
| types-pyyaml==6.0.12.20250915 # via -r requirements-dev.txt | ||
| types-requests==2.32.4.20260107 # via types-tqdm | ||
| types-tqdm==4.67.0.20250809 # via -r requirements-dev.txt | ||
| typing-extensions==4.15.0 # via aiosignal, anyio, beautifulsoup4, grpcio, huggingface-hub, ipython, mypy, pydantic, pydantic-core, referencing, torch, typer-slim, typing-inspection, wandb | ||
| typing-inspection==0.4.2 # via pydantic | ||
| tzdata==2025.3 # via arrow | ||
| uri-template==1.3.0 # via jsonschema | ||
| urllib3==2.6.3 # via requests, sentry-sdk, types-requests | ||
| uv==0.9.28 # via tox-uv | ||
| virtualenv==20.36.1 # via pre-commit, tox | ||
| wandb==0.24.1 # via -r requirements-dev.txt | ||
| wcwidth==0.5.3 # via prompt-toolkit | ||
| webcolors==25.10.0 # via jsonschema | ||
| webencodings==0.5.1 # via bleach, tinycss2 | ||
| websocket-client==1.9.0 # via jupyter-server | ||
| werkzeug==3.1.5 # via tensorboard | ||
| wheel==0.46.3 # via -r requirements.txt | ||
| widgetsnbextension==4.0.15 # via ipywidgets | ||
| xxhash==3.6.0 # via datasets | ||
| yarl==1.22.0 # via aiohttp | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧩 Analysis chain
🏁 Script executed:
Repository: instructlab/training
Length of output: 1129
🏁 Script executed:
Repository: instructlab/training
Length of output: 798
🌐 Web query:
wandb 0.24.0 pydantic 2.12 UnsupportedFieldAttributeWarning compatibility💡 Result:
pydantic.warnings.UnsupportedFieldAttributeWarningwith Pydantic 2.12.x + wandb (including 0.24.0) is caused by how W&B defines someAnnotated[...]type aliases inwandb/_pydantic/field_types.py:Typename = Annotated[T, Field(repr=False, frozen=True, alias="__typename")]GQLId = Annotated[StrictStr, Field(repr=False, frozen=True)]In Pydantic 2.12,
reprandfrozenare treated as unsupported/ineffective when used in this “standalone FieldInfo inside a type alias” pattern, so Pydantic emits a warning during import; behavior is unchanged (it was already ignoring those attributes). [1]What to do
Best fix (eliminate warning): patch W&B locally (until your W&B version includes the change):
.../site-packages/wandb/_pydantic/field_types.pyrepr=False, frozen=Truefrom thoseField(...)calls (keepalias="__typename"onTypename). [1]If you just want it quiet: suppress the warning in your app entrypoint:
(Or target
pydantic.warnings.UnsupportedFieldAttributeWarningif you import it.)If you want, paste the exact warning traceback from your wandb 0.24.0 + pydantic 2.12 environment and I’ll point to the precise file/line(s) it’s coming from in your install.
Sources: [1]
Patch wandb locally to resolve Pydantic 2.12.5 UnsupportedFieldAttributeWarning.
wandb 0.24.0 does not resolve the
UnsupportedFieldAttributeWarningwith Pydantic 2.12.5. The warning occurs inwandb/_pydantic/field_types.pywhererepr=False, frozen=Trueare used inField()calls within type aliases, which Pydantic 2.12+ treats as unsupported attributes. This will cause warnings during import.Apply one of these fixes:
site-packages/wandb/_pydantic/field_types.py: Removerepr=False, frozen=Truefrom theField()calls (keepalias="__typename"onTypename).warnings.filterwarnings("ignore", category=UserWarning, module="pydantic").Also applies to: 206-206
🤖 Prompt for AI Agents