[8.0] Change the updating logic of the TS FileStatus

[chaen]

This aims at solving #7116
It is quite a big change of logic, but should not impact anybody but LHCb, as it mostly matters for complex body plugin

Also, it speeds up a lot the RequestTaskAgent.
Hotfixed in LHCb, we observe a huge speedup on a transformation with 4M files:

# Before
2024-08-13 05:24:33 UTC Transformation/RequestTaskAgent/[231355] ._execute INFO: Processed transformation in 2134.9 seconds

# After
2024-08-13 09:29:19 UTC Transformation/RequestTaskAgent/[231355] ._execute INFO: Processed transformation in 62.4 seconds

BEGINRELEASENOTES
*TS
FIX: RequestTaskAgent only considers requests in final states, and consider files in intermediate state as problematic (#7116)
NEW: RequestTaskAgent uses getBulkRequestStatus instead of getRequestStatus

RMS:
NEW: implement getRequestStatus

ENDRELEASENOTES

[andresailer]

Some questions for my understanding.

Do you mean

Implement getBulkRequestStatus

In the release notes?

[andresailer]

Can you clarify this comment?

I don't understand what we "don't care" about here?

Or like:

Suggested change

	# We don't care updating the tasks to Assigned while the request is being processed
	# We do not update the tasks to Assigned while the request is being processed

But why? (what is the status while it is being processed?)

[chaen]

It's Assigned for the RMS request, that is, it is currently bewing treated by the REA, so it is a very temporary status

[DIRACGridBot]

Sweep summary

Sweep ran in https://github.com/DIRACGrid/DIRAC/actions/runs/10993993193

Failed:

• integration
  cherry-pick 8d7c3e6 into integration failed
  check merge conflicts on a local copy of this repository

  git fetch upstream
  git checkout upstream/integration -b cherry-pick-2-8d7c3e650-integration
  git cherry-pick -x -m 1 8d7c3e650
  # Fix the conflicts
  git cherry-pick --continue
  git commit --amend -m 'sweep: #7741 Change the updating logic of the TS FileStatus' --author='Christophe Haen <[email protected]>'
  git push -u origin cherry-pick-2-8d7c3e650-integration
  
  # If you have the GitHub CLI installed the PR can be made with
  gh pr create \
       --label 'sweep:from rel-v8r0' \
       --base integration \
       --repo DIRACGrid/DIRAC \
       --title '[sweep:integration] Change the updating logic of the TS FileStatus' \
       --body 'Sweep #7741 `Change the updating logic of the TS FileStatus` to `integration`.
  
  Adding original author @chaen as watcher.
  
  BEGINRELEASENOTES
  *TS
  FIX: RequestTaskAgent only considers requests in final states, and consider files in intermediate state as problematic (https://github.com/DIRACGrid/DIRAC/issues/7116)
  NEW: RequestTaskAgent uses getBulkRequestStatus instead of getRequestStatus
  
  RMS:
  NEW: implement getRequestStatus
  
  
  
  ENDRELEASENOTES
  Closes #7804'