Skip to content
ATOM Benchmark

ATOM Benchmark #6

Sign in to view logs

ATOM Benchmark

ATOM Benchmark #6

Triggered via schedule April 4, 2026 17:08
@tjtanaatjtanaa
⁠ b883c5c
main
Status Cancelled
Total duration 1d 0h 14m 53s
Artifacts –

atom-benchmark.yaml

on: schedule
Parse parameter lists
3s
Parse parameter lists
Load model configs
3s
Load model configs
Matrix: benchmark
Summarize benchmark result
10s
Summarize benchmark result
Generate regression rerun matrix
0s
Generate regression rerun matrix
Matrix: regression-rerun
Collect regression traces
0s
Collect regression traces
Profiler trace analysis
0s
Profiler trace analysis
Fit to window
Zoom out
Zoom in

Annotations

137 errors and 1 warning
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MTP3 (isl=8192 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4 (isl=8192 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=16)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=8192 osl=1024 c=2)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
gpt-oss-120b (isl=1024 osl=1024 c=1)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=8192 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
DeepSeek-R1-0528 MXFP4-MTP3 (isl=1024 osl=1024 c=64)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=256)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
GLM-5-FP8 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=8)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=32)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
MiniMax-M2.5 (isl=8192 osl=1024 c=4)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Kimi-K2.5-MXFP4 (isl=1024 osl=1024 c=128)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
Summarize benchmark result
No benchmark result was found in /home/runner/work/ATOM/ATOM/benchmark-action-input.json. Benchmark output was '[]'
Summarize benchmark result
Failed to download baseline artifacts