-
Notifications
You must be signed in to change notification settings - Fork 252
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
What is the difference between RAG Agent and question Answer? #1103
Comments
Hey @aliabbasjp the RAG agent is a multi-turn LLM agent, which can choose to answer a query with or without a search. It makes a tool call to conduct the search. Question and answer always does a search, and is single-turn. In #1104 you mention that you're running a local LLM—in the sidebar to the left here you need to specify the model. Right now it defaults to OpenAI(which, as you noted, you're not using, so it's throwing a 500 error.) This is going to be updated in our next release such that we don't set the model on the UI by default. This question is related to #1104, so I'll keep this one open and close the other. Let me know if this solves it for you! |
Thanks, so how can i configure the tooling the rag agent uses? |
I see when i use question answer it defaults to using openAI even if other config is configured to use only localllm and i see no way to configure it. It errors out in the logs showing unable to connect to openai
The text was updated successfully, but these errors were encountered: