Skip to content

OpenAI: sort request body keys so prompt caches can hit - #432

Open
gtokman wants to merge 1 commit into
huggingface:mainfrom
gtokman:sort-request-body-keys
Open

gtokman wants to merge 1 commit into
huggingface:mainfrom
gtokman:sort-request-body-keys

Sort request body keys so prompt caches can hit

8117244
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs