Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can one deploy grobid on AWS lambda? #1157

Open
rgranit opened this issue Aug 22, 2024 · 3 comments
Open

Can one deploy grobid on AWS lambda? #1157

rgranit opened this issue Aug 22, 2024 · 3 comments

Comments

@rgranit
Copy link

rgranit commented Aug 22, 2024

Hi,

Does anyone know if it is possible to run this grobid on AWS Lamda? and if so, how much time it takes to load?

@Siedlerchr
Copy link

Siedlerchr commented Aug 25, 2024

I don't know about AWS lambda, but I guess you could deploy it on fargate/ECS.
We have deployed it on Azure container

@lfoppiano
Copy link
Collaborator

@rgranit never tried, but I'd be happy to hear if you manage. There are a few other issues opened about it, but I don't remember there was any conclusive information.

@vegarab
Copy link

vegarab commented Sep 2, 2024

Hi @rgranit

I've experimented with Lambda setups for GROBID. Although it works, the cold-start times are problematic. We've opted to use ECS Fargate directly with the public docker images.

I do think it is possible to get a Lambda runtime working with acceptable cold-starts though. My lack of familiarity with the Java runtimes and environment is keeping me from exploring further, but the Lambda SnapStart [0] (only available for Java) could potentially get you what you want, if you build a custom runtime for it. Simply using the public docker images are not suitable for the Lambda Firecraker VMs

[0] https://docs.aws.amazon.com/lambda/latest/dg/snapstart.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants