Skip to content

内网本地部署的大模型无法使用 #565

@m729448362

Description

@m729448362

Pre-checks

Deployment Method

Docker

Steps to Reproduce

Image 部署的模型是vllm部署的openai响应接口形式。

Expected vs Actual Behavior

Logs / Screenshots

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions