Skip to content

feat: Support for OpenAI-compatible and Azure OpenAI endpoints #64

@thedtvn

Description

@thedtvn

Please add support for connecting to both OpenAI-compatible endpoints and Azure OpenAI endpoints.
This would allow users to leverage a wider range of LLM providers and enterprise deployments, improving flexibility and compatibility for various use cases.

Motivation:

  • Many organizations use Azure OpenAI for compliance and enterprise integration.
  • Supporting OpenAI-compatible APIs would enable broader adoption and easier integration with self-hosted or third-party LLM providers.

Proposed Solution:

  • Add configuration options for endpoint URLs, API keys, and any Azure-specific parameters (like resource name, deployment name, etc.).
  • Ensure compatibility with both OpenAI and Azure OpenAI API schemas.

Additional context:

If possible, provide example configuration snippets and document any differences in authentication or API usage.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions