Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider https://simonwillison.net/2023/Sep/4/llm-embeddings/ #2

Open
cmungall opened this issue Sep 5, 2023 · 1 comment
Open

Comments

@cmungall
Copy link
Member

cmungall commented Sep 5, 2023

https://simonwillison.net/2023/Sep/4/llm-embeddings/

Note currently we let chromadb handle all things embeddings but the above may provide a better way to decouple the choice of object store (e.g. sqlite, mongodb) vs dedicated vector database

@oneilsh
Copy link
Contributor

oneilsh commented Sep 6, 2023

fyi, the sentence-transformers package contains a few different embedding models, SPECTER in particular might be useful as it was trained on scientific citations, https://www.sbert.net/docs/pretrained_models.html

iQuxLE added a commit to iQuxLE/curate-gpt that referenced this issue Sep 11, 2024
# This is the 1st commit message:

impl abstractmethod & refactor to new API

# This is the commit message monarch-initiative#2:

refactor dimension function

# This is the commit message monarch-initiative#3:

refactor abstractmethod

# This is the commit message monarch-initiative#4:

refactor abstractmethod 2
iQuxLE added a commit to iQuxLE/curate-gpt that referenced this issue Sep 11, 2024
# This is the 1st commit message:

impl abstractmethod & refactor to new API

# This is the commit message monarch-initiative#2:

refactor dimension function

# This is the commit message monarch-initiative#3:

refactor abstractmethod

# This is the commit message monarch-initiative#4:

refactor abstractmethod 2

# This is the commit message monarch-initiative#5:

impl abstractmethod & refactor to new API

# This is the commit message monarch-initiative#6:

refactor dimension function
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants