Skip to content

Commit

Permalink
_
Browse files Browse the repository at this point in the history
  • Loading branch information
satyaog committed Apr 15, 2024
1 parent 8248260 commit a4616db
Show file tree
Hide file tree
Showing 268 changed files with 120 additions and 42 deletions.

This file was deleted.

38 changes: 38 additions & 0 deletions paice-v1-10-g1243bba/NVIDIA_A100_80GB_PCIe/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
```
=================
Benchmark results
=================
fail n perf sem% std% peak_memory score weight
bert-fp16 0 1 149.82 0.1% 0.4% 24616 149.818434 0.00
bert-fp32 0 1 27.22 0.0% 0.1% 31580 27.217099 0.00
bert-tf32 0 1 116.65 0.1% 0.5% 31582 116.647454 0.00
bert-tf32-fp16 0 1 150.16 0.1% 0.4% 24616 150.156416 3.00
bf16 0 1 270.83 0.1% 0.8% 1804 270.832982 0.00
convnext_large-fp16 0 1 310.32 1.9% 10.0% 27478 310.322641 0.00
convnext_large-fp32 0 1 42.56 2.2% 11.7% 49598 42.558568 0.00
convnext_large-tf32 0 1 124.27 4.0% 21.4% 49598 124.274883 0.00
convnext_large-tf32-fp16 0 1 309.84 1.6% 8.5% 27478 309.838750 3.00
davit_large 0 1 290.43 0.7% 5.6% 34016 290.434243 1.00
davit_large-multi 0 1 290.77 0.7% 5.4% 34260 290.773492 5.00
dlrm 0 1 418230.56 0.1% 0.4% 7120 418230.564140 1.00
focalnet 0 1 381.31 0.5% 3.5% 25794 381.313064 2.00
fp16 0 1 252.71 0.1% 0.5% 1804 252.706435 0.00
fp32 0 1 18.93 0.0% 0.3% 2182 18.931403 0.00
llama 0 1 453.97 11.5% 71.6% 28442 453.966564 1.00
reformer 0 1 55.60 0.0% 0.2% 25420 55.599417 1.00
regnet_y_128gf 0 1 78.11 0.9% 6.5% 31570 78.106848 2.00
resnet152 0 1 637.53 0.8% 5.9% 35958 637.529996 1.00
resnet152-multi 0 1 638.26 0.7% 5.6% 35422 638.255791 5.00
resnet50 0 1 1013.93 1.6% 12.6% 4746 1013.930919 1.00
rwkv 1 1 NaN NaN NaN 1574 NaN 1.00
stargan 0 1 38.18 3.0% 22.9% 37442 38.177830 1.00
super-slomo 0 1 41.83 1.2% 9.6% 33816 41.828308 1.00
t5 0 1 46.26 0.6% 4.3% 35460 46.264485 2.00
tf32 0 1 133.34 0.0% 0.4% 2182 133.344138 0.00
whisper 0 1 214.83 0.1% 0.5% 36740 214.828130 1.00
Scores
------
Failure rate: 3.70% (FAIL)
Score: 245.06
```
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
38 changes: 38 additions & 0 deletions paice-v1-11-g010135f/NVIDIA_A100_80GB_PCIe/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
```
=================
Benchmark results
=================
fail n perf sem% std% peak_memory score weight
bert-fp16 0 3 150.27 0.1% 0.7% 24616 300.011282 0.00
bert-fp32 0 3 27.25 0.2% 2.2% 31580 54.455513 0.00
bert-tf32 0 3 115.27 0.1% 1.2% 31582 230.122251 0.00
bert-tf32-fp16 0 3 149.22 0.1% 0.8% 24616 297.987446 3.00
bf16 0 3 268.52 0.2% 2.9% 1804 536.612601 0.00
convnext_large-fp16 0 3 306.17 1.2% 11.5% 27478 614.515028 0.00
convnext_large-fp32 0 3 42.77 1.3% 12.8% 49598 85.028380 0.00
convnext_large-tf32 0 3 124.43 2.3% 21.7% 49598 249.263266 0.00
convnext_large-tf32-fp16 0 3 308.44 1.2% 11.3% 27478 616.772433 3.00
davit_large 0 3 291.78 0.4% 5.9% 34016 583.029676 1.00
davit_large-multi 0 2 431.63 3.0% 32.8% 37565 431.631903 5.00
dlrm 0 2 461813.93 1.6% 17.0% 7120 461813.929762 1.00
focalnet 0 3 378.80 0.5% 6.2% 26078 760.320817 2.00
fp16 0 3 252.99 0.1% 1.3% 1804 506.831795 0.00
fp32 0 3 18.95 0.1% 1.3% 2182 37.869296 0.00
llama 0 3 471.88 7.1% 77.6% 28442 921.048609 1.00
reformer 0 3 55.41 0.2% 2.6% 25420 110.828259 1.00
regnet_y_128gf 0 3 78.30 0.6% 7.9% 31570 156.621543 2.00
resnet152 0 3 633.17 0.5% 6.7% 35443 1265.788254 1.00
resnet152-multi 0 2 946.21 3.1% 34.0% 43101 946.214334 5.00
resnet50 0 3 992.36 1.2% 16.3% 4746 1983.133170 1.00
rwkv 3 3 NaN NaN NaN 1574 NaN 1.00
stargan 0 3 38.04 2.0% 27.0% 37442 75.945645 1.00
super-slomo 0 3 41.08 0.6% 8.5% 33816 82.433797 1.00
t5 0 3 46.30 0.3% 4.3% 35460 92.612285 2.00
tf32 0 3 132.81 0.1% 1.3% 2182 265.201409 0.00
whisper 0 3 214.88 0.1% 1.4% 36740 428.640005 1.00
Scores
------
Failure rate: 3.85% (FAIL)
Score: 427.84
```
1 change: 1 addition & 0 deletions paice-v1-11-g010135f/NVIDIA_A100_80GB_PCIe/badge.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
40 changes: 40 additions & 0 deletions paice-v1-9-g03d3434/NVIDIA_A100_80GB_PCIe/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
```
=================
Benchmark results
=================
fail n perf sem% std% peak_memory score weight
bert-fp16 0 1 154.48 0.0% 0.3% 24616 154.483482 0.00
bert-fp32 0 1 28.06 0.1% 0.5% 31580 28.060602 0.00
bert-tf32 0 1 116.74 0.3% 1.5% 31582 116.735928 0.00
bert-tf32-fp16 0 1 150.69 0.1% 0.3% 24616 150.688708 3.00
bf16 0 1 271.78 0.1% 1.1% 1804 271.778801 0.00
convnext_large-fp16 0 1 308.86 1.6% 8.6% 27478 308.861596 0.00
convnext_large-fp32 0 1 43.02 2.2% 11.8% 49598 43.022425 0.00
convnext_large-tf32 0 1 124.52 3.8% 20.4% 49598 124.522512 0.00
convnext_large-tf32-fp16 0 1 309.11 1.6% 8.5% 27478 309.106568 3.00
davit_large 0 1 291.05 0.7% 5.5% 34016 291.052985 1.00
davit_large-multi 0 1 293.28 0.7% 5.2% 34260 293.275288 5.00
dlrm 0 1 418797.28 0.1% 0.6% 7120 418797.282781 1.00
focalnet 0 1 380.78 0.4% 3.4% 26112 380.781357 2.00
fp16 0 1 252.23 0.1% 0.9% 1804 252.232285 0.00
fp32 0 1 19.17 0.0% 0.2% 2182 19.167969 0.00
llama 0 1 459.81 11.3% 70.7% 28442 459.812667 1.00
opt-1_3b 1 1 NaN NaN NaN -1 NaN 5.00
opt-6_7b 1 1 NaN NaN NaN 1534 NaN 5.00
reformer 0 1 56.47 0.1% 0.5% 25420 56.474529 1.00
regnet_y_128gf 0 1 78.29 1.0% 7.6% 31570 78.291422 2.00
resnet152 0 1 643.39 0.8% 6.0% 35464 643.386597 1.00
resnet152-multi 0 1 650.24 0.7% 5.4% 35478 650.239930 5.00
resnet50 0 1 1001.67 1.7% 13.0% 4746 1001.666359 1.00
rwkv 1 1 NaN NaN NaN -1 NaN 1.00
stargan 0 1 37.97 2.9% 21.9% 37442 37.973348 1.00
super-slomo 0 1 41.49 1.1% 8.6% 33816 41.492501 1.00
t5 0 1 46.10 0.5% 3.6% 35460 46.097973 2.00
tf32 0 1 133.58 0.0% 0.4% 2182 133.575008 0.00
whisper 0 1 215.00 0.1% 0.4% 36740 215.000159 1.00
Scores
------
Failure rate: 10.34% (FAIL)
Score: 66.37
```
Loading

0 comments on commit a4616db

Please sign in to comment.