Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stanza is not ThreadSafe like Spacy? #1313

Open
singhkumaranuj opened this issue Nov 28, 2023 · 1 comment
Open

Stanza is not ThreadSafe like Spacy? #1313

singhkumaranuj opened this issue Nov 28, 2023 · 1 comment

Comments

@singhkumaranuj
Copy link

What I came to know that :
Stanza does not work with multiple async workers if they are accessing the same model.

Is there any way to handle this ?
Or Am I missing any point here ?

@AngledLuffa
Copy link
Collaborator

There really hasn't been much effort put into making it thread safe, but at the same time I'm not sure we'd get a lot of benefit from even trying. Pytorch will use up the GPU in just one thread if available, or fork a bunch on the CPU if there is no GPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants