V2 Performance Signal Detected by TorchBench CI on '2.6.0.dev20240919+cu124'

[xuzhao9]

TorchBench CI has detected a performance signal.

Base PyTorch version: 2.4.0.dev20240606+cu121

Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1

Affected PyTorch version: 2.6.0.dev20240919+cu124

Affected PyTorch commit: e037bb326fdafca243bdb08023bbef93b29a4513

Affected Tests:

• test_train[Super_SloMo-cuda-eager]: +14.62943%
• test_eval[Super_SloMo-cuda-eager]: +11.07308%
• test_train[Super_SloMo-cuda-jit]: +14.75310%
• test_eval[Super_SloMo-cuda-jit]: +11.21929%
• test_eval[alexnet-cuda-eager]: +10.56490%
• test_eval[alexnet-cuda-jit]: +13.79772%
• test_train[dcgan-cuda-eager]: +63.66190%
• test_train[dcgan-cuda-jit]: +63.58292%
• test_eval[pyhpc_equation_of_state-cpu-jit]: +17.08329%
• test_eval[pytorch_stargan-cpu-eager]: -14.51072%
• test_eval[pytorch_stargan-cpu-jit]: -9.68358%
• test_eval[resnext50_32x4d-cpu-jit]: +26.96671%
• test_eval[shufflenet_v2_x1_0-cpu-eager]: +14.71172%
• test_eval[shufflenet_v2_x1_0-cuda-jit]: -27.58208%
• test_train[timm_nfnet-cpu-jit]: -13.35092%
• test_eval[timm_regnet-cuda-eager]: +169.96523%
• test_eval[timm_regnet-cuda-jit]: +355.28978%
• test_train[yolov3-cuda-eager]: -9.77666%

cc @xuzhao9

Result json:

{
  "start": "ffaea656b5d8ff6518669494cc8f664b94f8e8b1",
  "end": "e037bb326fdafca243bdb08023bbef93b29a4513",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "187d55018ae",
      "commit1_time": "2024-08-20 16:12:04 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.24741940470412374
      },
      "commit2": "8d93fe510e5",
      "commit2_time": "2024-08-20 16:16:30 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2774291805922985
      }
    },
    {
      "commit1": "8d93fe510e5",
      "commit1_time": "2024-08-20 16:16:30 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.2774291805922985
      },
      "commit2": "33f1ee036ef",
      "commit2_time": "2024-08-20 16:27:44 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.24583374997600912
      }
    },
    {
      "commit1": "33f1ee036ef",
      "commit1_time": "2024-08-20 16:27:44 +0000",
      "commit1_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.24583374997600912
      },
      "commit2": "c3d02fa3906",
      "commit2_time": "2024-08-20 16:33:26 +0000",
      "commit2_digest": {
        "test_eval[pytorch_stargan-cpu-jit]": 0.30004308177158234
      }
    }
  ]
}

Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/10945734159