Skip to content

(Single-card) Model perf tests #7613

(Single-card) Model perf tests

(Single-card) Model perf tests #7613

Triggered via schedule February 19, 2025 07:00
Status Failure
Total duration 1h 39m 12s
Artifacts 7

perf-models.yaml

on: schedule
build-artifact  /  ...  /  check-docker-images
6s
build-artifact / build-docker-image / check-docker-images
build-artifact  /  ...  /  🐳️ Build image
0s
build-artifact / build-docker-image / 🐳️ Build image
build-artifact  /  🛠️ Build Release ubuntu 20.04
2m 57s
build-artifact / 🛠️ Build Release ubuntu 20.04
Matrix: models-perf / models-perf
Fit to window
Zoom out
Zoom in

Annotations

2 errors, 6 warnings, and 31 notices
models-perf / llm_javelin GS
Process completed with exit code 2.
models-perf / llm_javelin GS
Process completed with exit code 1.
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
weka-mount-hugepages-service-not-found
Hugepages service not found. Using old rc.local method
hugepages-service-not-found-startup
Hugepages service not found. Using old rc.local method
printing-out-smi-info-cleanup
Touching and printing out SMI info
disk-usage-after-startup
Disk usage is 50 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 50 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
disk-usage-after-startup
Disk usage is 50 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 73 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.
weka-mount-hugepages-service-found
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
disk-usage-after-startup
Disk usage is 72 %
printing-smi-info-startup
Touching and printing out SMI info
reset-successful-startup
tt-smi reset was successful
hugepages-service-found-startup
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
hugepages-setup-success-startup
Hugepages is now setup.

Artifacts

Produced during runtime
Name Size
TTMetal_build_any
163 MB
packages-ubuntu-20.04-amd64-Release-x86_64-linux-clang-17-libcpp
89.2 MB
perf-report-csv-cnn_javelin-grayskull-bare_metal
332 Bytes
perf-report-csv-cnn_javelin-wormhole_b0-bare_metal
538 Bytes
perf-report-csv-llm_javelin-wormhole_b0-bare_metal
1.18 KB
perf-report-csv-other-grayskull-bare_metal
1.26 KB
perf-report-csv-other-wormhole_b0-bare_metal
879 Bytes