Add workflow support #23
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
koparasy
force-pushed
the
feature/restructure-rebase
branch
from
bf988aa
to
e11b108
Compare
* Add wrapper to start flux with proxy * Add infrastructure of connecting to and receiving from RMQ * Add initial daemon implementation
…messages to a RabbitMQ queue Signed-off-by: Loic Pottier <[email protected]>
* Added initial script to bootstrap Flux on CORAL/IBM machine * Added support Slurm based system, tested with flux-core 0.49 on Ruby/Lassen * Added script to launch AMS miniapp with Flux * Reverted script to support older version of flux, Lassen bootstrap only works wityh Flux<= 0.45 (tested with 0.45) * Added scripts to add secrets on OC * Added new scripts to launch the entire AMS workflow * Upgrade all scripts, they are now fully functional (main script communicates with AMS daemon via RMQ) --------- Signed-off-by: Loic Pottier <[email protected]>
Signed-off-by: Loic Pottier <[email protected]>
Signed-off-by: Loic Pottier <[email protected]>
* This commit addresses multiple problems in the broker part of AMS - we are not sending input/output as encoded string anymore, we send binary blobs - base64 has been removed - a bug has been fixed with (very) old libevent version (<= 2.0.21-stable) - offloading inputs/outputs to the thread managing RMQ is now much faster * Moved to ResourceManager, created AMSMessage structures, moved to smart pointers. * Complete re-design of the RabbitMQ backend * Removed EventBuffer, removed pthread and signals. Big cleanup of the code. * Added documentation and new AMSMsgHeader class + moved from memcpy to ResourceManager::copy
…des 'views' for kosh data
…ipt to run AMS in sequential steps.
Signed-off-by: Loic Pottier <[email protected]>
Signed-off-by: Loic Pottier <[email protected]>
…already registered.' Signed-off-by: Loic Pottier <[email protected]>
…HOST is already registered.'" This reverts commit 50d1588.
koparasy
force-pushed
the
feature/restructure-rebase
branch
from
d7063a2
to
a520727
Compare
lpottier
approved these changes
Nov 10, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.