Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[PAL/vm-common] Check the "break" variable less frequently in
delay()
Previously, `delay()` function accessed the "break out of loop early" variable `continue_gate` basically on every CPU cycle. This variable is typically a global variable causing high contention on multi-core workloads. This e.g. manifested in the Candle Quantized LLaMA app. This commit fixes this by checking the variable less frequently. The current heuristic is to check it every 1 ms. Signed-off-by: dimstav23 <[email protected]>
- Loading branch information