Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Bug Report: Error While trying to generate a response Local LLM #745

Open
2 tasks done
Aiman-astios opened this issue Oct 31, 2023 · 5 comments
Open
2 tasks done

Comments

@Aiman-astios
Copy link

📜 Description

This error popped up when DocsGPT trying to response.

👟 Reproduction steps

  1. execute setup.sh 2. ask question on the web browser. 3. got 500 error and message Something went wrong. Please try again later. 4. check on the logs found the cause (image attached above).

👍 Expected behavior

it should response to the question.

👎 Actual Behavior with Screenshots

image

image

💻 Operating system

Linux

What browsers are you seeing the problem on?

Chrome

🤖 What development environment are you experiencing this bug on?

Local dev server

🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)

No response

📃 Provide any additional context for the Bug.

No response

📖 Relevant log output

No response

👀 Have you spent some time to check if this bug has been raised before?

  • I checked and didn't find similar issue

🔗 Are you willing to submit PR?

None

🧑‍⚖️ Code of Conduct

  • I agree to follow this project's Code of Conduct
@Antonio-Vela
Copy link

In settings change this line:
EMBEDDINGS_NAME: str = "openai_text-embedding-ada-002"
by this one:
EMBEDDINGS_NAME: str = "huggingface_sentence-transformers/all-mpnet-base-v2"

@dartpain
Copy link
Contributor

Also please upload your own docs. as default ones use the openai embeddings

@Aiman-astios
Copy link
Author

In settings change this line: EMBEDDINGS_NAME: str = "openai_text-embedding-ada-002" by this one: EMBEDDINGS_NAME: str = "huggingface_sentence-transformers/all-mpnet-base-v2"

Orait thanks for that insight will test it out.

@Aiman-astios
Copy link
Author

Also please upload your own docs. as default ones use the openai embeddings

owh thanks for the information, but when i upload my custom docs other issue arise where the response take too long to have a feedback and i think Antonio-Vela idea will solved that issue.

@dartpain
Copy link
Contributor

What issue did you get @Aiman-astios

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants