[Feature] Is asynchronous metric computation during training possible?

[flytocc]

Describe the feature
Request to add support for asynchronous Metric computation, enabling the calculation of metrics in parallel with other operations to improve performance and reduce overall latency during training.

Motivation
It is inconvenient when metric calculations block the main training loop, especially when working with large datasets or complex models that result in long-running evaluations. Asynchronous computation would allow metrics to be computed without halting the rest of the process, optimizing the time spent waiting for results.