Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add azure openai services client support #24

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

lucinvitae
Copy link

@lucinvitae lucinvitae commented Feb 7, 2024

This PR adds support for using Azure OpenAI Services deployments instead of directly calling OpenAI. I was testing out this tool, and figured I would push the change upstream in case the maintainers want to support Azure integrations from potential future users. See the readme for additional instructions.

@cmungall
Copy link
Member

cmungall commented Feb 9, 2024

Thanks!

We are thinking of using https://github.com/BerriAI/litellm for this kind of thing in future, see #15

However we appreciate it's an issue having another server running so I think we can merge this

@lucinvitae
Copy link
Author

@cmungall sure thing! This (CurateGPT) is an exciting project, and I was happy to test it out.

Note: To get e2e ask commands working with the llm lib for my use case, I noticed that I needed to add some additional configuration (in extra-openai-models.yaml), and support for the azure deployment name. See:

Setting the deployment name isn't required in most cases. The current latest llm lib version may work out-of-the-box if the Azure deployment identifier is identical to the model name, but that was not the case for us.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants