Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support more than one llm #9

Open
tibroc opened this issue Feb 9, 2024 · 0 comments
Open

Support more than one llm #9

tibroc opened this issue Feb 9, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@tibroc
Copy link
Member

tibroc commented Feb 9, 2024

We would want the option to configure the llms used. E.g. we might want to use ollama or something else instead of ChatGPT.

This could look like this:

  • A config file on the server that specifies llm options and their APIs, Tokens, etc.
  • A menu option for the user where they can choose which model to use in the session/assistant/…
@Odrec Odrec added the enhancement New feature or request label Feb 20, 2024
Odrec referenced this issue May 27, 2024
Add environment variable for mapping user to model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants