You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Using a HuggingFace model from the Mistral family.
👟 Reproduction steps
with the parameters from the documentation: LLM_NAME=huggingface EMBEDDINGS_NAME=sentence-transformers/all-mpnet-base-v2
and setting the llm_name to 'mistralai/Mistral-7B-Instruct-v0.1' instead of 'Arc53/DocsGPT-7B' in the DocsGPT/application/llm/huggingface.py file. You launch the app and ask a question.
In the DocsGPT/application/api/answer/routes.pycompletion = llm.gen_stream( call must be also replaced by completion = llm.gen( to avoid NotImplementedErrorand get a reponse
👍 Expected behavior
It should work and answer
👎 Actual Behavior with Screenshots
It crashes with KeyError: 'mistral'
💻 Operating system
Linux
What browsers are you seeing the problem on?
No response
🤖 What development environment are you experiencing this bug on?
Docker
🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)
📜 Description
Using a HuggingFace model from the Mistral family.
👟 Reproduction steps
with the parameters from the documentation:
LLM_NAME=huggingface
EMBEDDINGS_NAME=sentence-transformers/all-mpnet-base-v2
and setting the
llm_name
to'mistralai/Mistral-7B-Instruct-v0.1'
instead of'Arc53/DocsGPT-7B'
in theDocsGPT/application/llm/huggingface.py
file. You launch the app and ask a question.In the
DocsGPT/application/api/answer/routes.py
completion = llm.gen_stream(
call must be also replaced bycompletion = llm.gen(
to avoidNotImplementedError
and get a reponse👍 Expected behavior
It should work and answer
👎 Actual Behavior with Screenshots
It crashes with
KeyError: 'mistral'
💻 Operating system
Linux
What browsers are you seeing the problem on?
No response
🤖 What development environment are you experiencing this bug on?
Docker
🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)
LLM_NAME
EMBEDDINGS_NAME
FLASK_APP
FLASK_DEBUG
CELERY_BROKER_URL
CELERY_RESULT_BACKEND
📃 Provide any additional context for the Bug.
The bug is corrected updating the transformers library
pip install -U transformers
📖 Relevant log output
👀 Have you spent some time to check if this bug has been raised before?
🔗 Are you willing to submit PR?
Yes, I am willing to submit a PR!
🧑⚖️ Code of Conduct
The text was updated successfully, but these errors were encountered: