Skip to content

Add option for Custom AI functionality using URL of OpenAI compatible API #3223

@cmgriffing

Description

@cmgriffing

I would like to be able to set a custom URL for an OpenAI compatible API. This would be useful for fine tuned custom LLMs for specific projects. It would also be really useful in an Enterprise environment that wants to prevent exfiltrating data outside of their network.

It seems to me that the custom URL setting for OpenAI could be repurposed for this use case. However, a setting for a custom model name might be necessary.

Metadata

Metadata

Assignees

No one assigned

    Labels

    triageNeeds to be looked at

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions