the download request will hang

[chenshibin-vip]

Bug report:

When attempting to download non-existent data for an extended period, the download request will hang.

Expected behavior:

When attempting to download non-existent data for an extended period, return a 'data not found' response instead of hanging.

How to reproduce it:

A total of 20 instances each request to download non-existent S3 data every 3-5 seconds.

Environment:

• Dragonfly version: 2.1.23
• OS: ubuntu
• Kernel (e.g. uname -a): 4.15.0-42-generic x86_64 GNU/Linux
• Others:

The daemonset and scheduler logs are in the attachment.
daemon.log
scheduler.log

[gaius-qi]

Set watchdogTimeout to open watchdog feature in client.