Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

global: remove caching mechanism #788

Open
mdonadoni opened this issue Mar 6, 2024 · 0 comments
Open

global: remove caching mechanism #788

mdonadoni opened this issue Mar 6, 2024 · 0 comments

Comments

@mdonadoni
Copy link
Member

REANA's current caching mechanism has been disabled by default for quite some time and it has some drawbacks:

  • big disk usage, as the whole workspace is copied every time a new job needs to be cached
  • slowness in job creation (see perf(cache): avoid caching jobs when the cache is disabled (#435) reana-job-controller#435)
  • caching does not always work as expected and some tricky cases are not handled correctly
  • this caching mechanism is only supported by serial workflows, and would not work with other engines as it does not handle multiple jobs running concurrently

For these reasons, we should consider removing this caching mechanism from REANA:

  • remove all related code
  • drop related columns in the database (migration script is needed)
  • update docs (reana/reana-client)
  • update API, e.g. do not accept CACHE option for serial workflows (breaking change!)
  • delete the cache directory from current deployments of REANA
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Ready for work
Development

No branches or pull requests

1 participant