-
Notifications
You must be signed in to change notification settings - Fork 129
Issues: Lightning-AI/LitServe
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
More complex model management (multiple models, model reloading etc...)
enhancement
New feature or request
help wanted
Extra attention is needed
#282
opened Sep 19, 2024 by
bsergean
Is it possible to support multiple endpoints for one server?
enhancement
New feature or request
help wanted
Extra attention is needed
#271
opened Sep 6, 2024 by
arkohut
Feature Request: Customize FastAPI Metadata
enhancement
New feature or request
help wanted
Extra attention is needed
#270
opened Sep 6, 2024 by
bhimrazy
May I ask if it is possible to deploy complex pipelines such as ControlNet and IP Adapter in Stable Diffusion? Do you have any examples
enhancement
New feature or request
help wanted
Extra attention is needed
#236
opened Aug 28, 2024 by
libai-lab
Map New feature or request
help wanted
Extra attention is needed
decode_request
during dynamic batching using a threadpool
enhancement
#166
opened Jul 8, 2024 by
aniketmaurya
Evict requests if the client has disconnected
enhancement
New feature or request
help wanted
Extra attention is needed
#165
opened Jul 8, 2024 by
aniketmaurya
API monitoring metrics
enhancement
New feature or request
help wanted
Extra attention is needed
#146
opened Jun 19, 2024 by
aniketmaurya
failed to start and serve HTTP while server is in intermediate state i.e. shutting down
bug
Something isn't working
help wanted
Extra attention is needed
#116
opened May 25, 2024 by
gulshansainis
Feat: Add support for fastapi lifespan events
enhancement
New feature or request
help wanted
Extra attention is needed
#110
opened May 23, 2024 by
robTheBuildr
enable users to override the default api endpoint path
enhancement
New feature or request
help wanted
Extra attention is needed
#90
opened May 16, 2024 by
aniketmaurya
avoid sending content past the last token during batching / batched streaming
#57
opened Apr 23, 2024 by
aniketmaurya
Add a detached mode
enhancement
New feature or request
help wanted
Extra attention is needed
#56
opened Apr 22, 2024 by
rasbt
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.