-
Notifications
You must be signed in to change notification settings - Fork 49
Open
Description
Please add support for connecting to both OpenAI-compatible endpoints and Azure OpenAI endpoints.
This would allow users to leverage a wider range of LLM providers and enterprise deployments, improving flexibility and compatibility for various use cases.
Motivation:
- Many organizations use Azure OpenAI for compliance and enterprise integration.
- Supporting OpenAI-compatible APIs would enable broader adoption and easier integration with self-hosted or third-party LLM providers.
Proposed Solution:
- Add configuration options for endpoint URLs, API keys, and any Azure-specific parameters (like resource name, deployment name, etc.).
- Ensure compatibility with both OpenAI and Azure OpenAI API schemas.
Additional context:
If possible, provide example configuration snippets and document any differences in authentication or API usage.
Metadata
Metadata
Assignees
Labels
No labels