geohot
4e6bdac412
hotfix: disable HCQ2
2026-08-27 18:23:52 -07:00
sirhcm and GitHub
0820c7a424
benchmarks: openpilot matrix ( #17714 )
Autogen / In-tree Autogen (comgr 2) (push) Failing after 1m19s
Deploy Docs / deploy (push) Successful in 4m30s
Autogen / In-tree Autogen (push) Failing after 11m39s
Unit Tests / Docs (push) Successful in 3m32s
Unit Tests / Torch Backend Tests (push) Successful in 5m1s
Unit Tests / Torch Backend Training (push) Successful in 4m3s
Unit Tests / Python Backend (push) Successful in 3m47s
Unit Tests / Linters (push) Successful in 2m30s
Unit Tests / Null Tests (push) Successful in 3m50s
Unit Tests / Unit Tests (push) Successful in 4m36s
Unit Tests / SPEC=2 (1) (push) Successful in 5m3s
Unit Tests / SPEC=2 (2) (push) Successful in 4m39s
Unit Tests / Fuzzing (push) Successful in 2m56s
Unit Tests / CL IMAGE Tests (push) Successful in 4m8s
Unit Tests / openpilot Compile Tests (push) Successful in 3m45s
Unit Tests / ONNX (CPU) Tests (push) Successful in 6m17s
Unit Tests / Optimization Tests (push) Successful in 4m48s
Unit Tests / Models (push) Successful in 2m19s
Unit Tests / Linux (DSP) (push) Successful in 2m32s
Unit Tests / Linux (DEV=CL) (push) Successful in 4m43s
Unit Tests / Linux (DEV=CPU:CLANG) (push) Successful in 5m12s
Unit Tests / Linux (DEV=CPU:LLVM) (push) Successful in 4m28s
Unit Tests / Linux (DEV=CPU:LVP) (push) Successful in 4m24s
Unit Tests / Linux (DEV=CPU:X86) (push) Successful in 3m53s
Unit Tests / Linux (DEV=WEBGPU) (push) Successful in 4m44s
Unit Tests / AMD ASM IDE (push) Successful in 3m36s
Unit Tests / hcq2 (push) Successful in 3m40s
Unit Tests / Linux (am) (push) Successful in 4m49s
Unit Tests / Linux (amd gfx1100) (push) Successful in 4m59s
Unit Tests / Linux (amdllvm gfx1100) (push) Successful in 4m33s
Unit Tests / Linux (amd gfx1201) (push) Successful in 4m51s
Unit Tests / Linux (amdllvm gfx1201) (push) Successful in 3m44s
Unit Tests / Linux (amd gfx950) (push) Successful in 4m29s
Unit Tests / Linux (amdllvm gfx950) (push) Successful in 3m14s
Unit Tests / Linux (nv) (push) Successful in 3m48s
Unit Tests / Linux (ptx) (push) Successful in 3m5s
Unit Tests / Compile-only (DEV=NULL:IR3:a630) (push) Successful in 2m21s
Unit Tests / Compile-only (DEV=NULL:NAK:sm_120) (push) Successful in 1m46s
Unit Tests / Compile-only (DEV=NULL:QCOMCL:a630) (push) Successful in 3m45s
Unit Tests / Test LLM (push) Failing after 1m40s
Autogen / In-tree Autogen (macos) (push) Canceled after 0s
Benchmarks / Mac pytest (push) Canceled after 0s
Benchmarks / LLM (DEV=AMD) (push) Canceled after 0s
Benchmarks / LLM (DEV=METAL) (push) Canceled after 0s
Benchmarks / LLM (DEV=NV) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=AMD) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=METAL) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=NV) (push) Canceled after 0s
Benchmarks / MLPerf (AMD) (push) Canceled after 0s
Benchmarks / MLPerf (NV) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=AMD) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=METAL) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=NV) (push) Canceled after 0s
Benchmarks / Multi-GPU Benchmarks (DEV=AMD) (push) Canceled after 0s
Benchmarks / Multi-GPU Benchmarks (DEV=NV) (push) Canceled after 0s
Benchmarks / Tests (DEV=AMD) (push) Canceled after 0s
Benchmarks / Tests (DEV=METAL) (push) Canceled after 0s
Benchmarks / Tests (DEV=NV) (push) Canceled after 0s
Benchmarks / UsbGPU Benchmark (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 dmonitoring (DEV=QCOM) (push) Canceled after 0s
Benchmarks / openpilot 0.11.2 compile3 dmonitoring (DEV=QCOM) (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 policy (DEV=QCOM) (push) Canceled after 0s
Benchmarks / openpilot 0.11.2 compile3 supercombo (DEV=QCOM) (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 vision (DEV=QCOM) (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 dmonitoring (DEV=QCOM:IR3) (push) Canceled after 0s
Benchmarks / openpilot 0.11.2 compile3 dmonitoring (DEV=QCOM:IR3) (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 policy (DEV=QCOM:IR3) (push) Canceled after 0s
Benchmarks / openpilot 0.11.2 compile3 supercombo (DEV=QCOM:IR3) (push) Canceled after 0s
Benchmarks / openpilot 0.11.0 compile3 vision (DEV=QCOM:IR3) (push) Canceled after 0s
Benchmarks / DSP Benchmark (push) Canceled after 0s
Benchmarks / UsbGPU Benchmark (comma) (push) Canceled after 0s
Benchmarks / PCI Driver Benchmark (DEV=AMD) (push) Canceled after 0s
Benchmarks / PCI Driver Benchmark (DEV=NV) (push) Canceled after 0s
Benchmarks / LLVM Speed (push) Canceled after 0s
Platform Tests / MacOS (unit) (push) Canceled after 0s
Platform Tests / MacOS (unit, mock) (push) Canceled after 0s
Platform Tests / MacOS (DEV=METAL) (1) (push) Canceled after 0s
Platform Tests / MacOS (DEV=METAL) (2) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:CLANG) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:LLVM) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:LVP) (push) Canceled after 0s
Platform Tests / MacOS (DEV=WEBGPU) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:CLANG) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:LLVM) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:X86) (push) Canceled after 0s
Platform Tests / Windows (DEV=WEBGPU) (push) Canceled after 0s
2026-08-26 18:53:55 -04:00
sirhcm and GitHub
b49c03fb1c
benchmarks: don't use sudo on mac ( #17740 )
2026-08-25 21:06:04 -04:00
sirhcm and GitHub
7fef98c86e
benchmarks: remove usage of sudo from linux runners ( #17735 )
2026-08-25 16:21:08 -04:00
sirhcm and GitHub
021c015eb4
benchmarks: more aggressive timeouts ( #17715 )
2026-08-24 18:32:36 -04:00
sirhcm and GitHub
2e7790f16c
benchmarks: cleanup dsp benchmark ( #17706 )
2026-08-24 18:09:01 -04:00
geohot
9d0cd0ebcb
hotfix: switch benchmark to qwen3.8
2026-08-23 20:34:30 -07:00
nimlgen and GitHub
4fd4eafb23
nv: hevc ( #17661 )
...
* nv: hevc
* x
* nv: zero the nvdec scratch buffers
2026-08-21 23:37:09 +03:00
nimlgen and GitHub
1cf8a2c7fe
hcq2: use shrink.bitcast ( #17653 )
...
* hcq2: shrink.bitcast
* x
* x
* x
* s
* x
* Dx
* Revert "hotfix: disable HCQ2"
This reverts commit a57188ea6d
2026-08-21 21:24:34 +03:00
geohot
a57188ea6d
hotfix: disable HCQ2
2026-08-20 13:39:48 -07:00
sirhcm and GitHub
eba5b7e750
benchmarks: cleanups ( #17631 )
2026-08-20 16:12:14 -04:00
sirhcm and GitHub
c63d94e059
benchmarks: split multigpu ( #17615 )
2026-08-19 21:36:07 -04:00
chenyu and GitHub
0a0b6cb596
fix TestDevCopySpeeds command ( #17607 )
2026-08-19 15:54:41 -04:00
nimlgen and GitHub
0725acc392
reenable hcq2 ci ( #17532 )
2026-08-14 23:13:18 +03:00
George Hotz and GitHub
673c6463f9
disable HCQ2 for AMD CI ( #17523 )
2026-08-13 13:14:40 -07:00
nimlgen and GitHub
874d33128b
hcq2 benchmark ( #17235 )
...
* hcq2 in ci?
* fix
* traning
* x
* x
* x
* recover
* debug
* impler
* x
* x
* x
* hcq2: group input scatter plans by destination
* hcq2: simplify input scatter tables
* x
2026-08-05 10:00:42 +03:00
sirhcm and GitHub
de57be1f26
kill nvidia pids at benchmarks start ( #17406 )
2026-08-04 23:45:49 -04:00
sirhcm and GitHub
15d515299e
heuristics: try multiple TC axes ( #17341 )
2026-07-31 19:25:18 -04:00
sirhcm and GitHub
b95bd5b2a5
don't reset chestnut in benchmark ( #17333 )
2026-07-31 12:39:04 -04:00
sirhcm and GitHub
13452b3775
benchmark comma big model ( #17312 )
2026-07-31 01:37:34 -04:00
sirhcm and GitHub
b290372121
ftdi reset chestnut before running comma benchmark ( #17306 )
2026-07-30 14:28:45 -04:00
sirhcm and GitHub
da15c43e51
update openpilot benchmarks ( #17304 )
2026-07-30 14:22:20 -04:00
chenyu and GitHub
291ee435bb
qwen3.6 for 27b and 35b-a3b ( #17268 )
2026-07-28 21:11:49 -04:00
sirhcm and GitHub
6f1176ea90
benchmarks: test usbgpu copy speeds on comma ( #17060 )
2026-07-17 02:02:21 -04:00
George Hotz and GitHub
d8fbbff260
EXPAND adds dims to the front (glm) ( #16908 )
...
* EXPAND adds dims to the front (glm)
* more read images
* simpler + spec
* spec should use n instead of s'
* bump comma to 12
2026-07-07 11:03:06 -07:00
George Hotz and GitHub
c92a4c0442
move devectorizer remains into coalese ( #16869 )
...
* move devectorizer remains into coalese
* fix flaky
2026-07-04 15:36:45 -07:00
sirhcm and GitHub
e0d7696ccd
split benchmarks ( #16812 )
2026-07-01 22:28:15 -04:00
sirhcm and GitHub
f8ddca9a00
qcom: ir3 needs SP_MODE_CNTL.CONSTANT_DEMOTION_ENABLE ( #16769 )
2026-06-26 19:48:29 -04:00
George Hotz and GitHub
a94a32ff71
move image to post coalese ( #16749 )
...
* move image to post coalese
* fix types
* dv2
* work
* load_store_indexing
* lsi
* simplify indexing
* always simplify
* more
* whitespace
* no simplify
* no early opt
* fix linter
* exit early without valid
* always simplify
* relax ir3
* no gep
* Revert "no gep"
This reverts commit 3fa4dd6dfa
2026-06-25 23:33:07 -07:00
chenyu and GitHub
db2257ad09
don't run tinyboxbenchmark on fork ( #16741 )
2026-06-25 09:12:56 -04:00
sirhcm and GitHub
63f0e08593
start benchmarks cleanup ( #16729 )
2026-06-24 23:33:46 -04:00
sirhcm and GitHub
091ec8d10d
use tinygrad.llm in benchmarks ( #16670 )
2026-06-19 00:03:57 -04:00
sirhcm and GitHub
bcdb988df0
split comma benchmark, dsp on c4 [PR] ( #16598 )
2026-06-12 23:26:05 -04:00
qazal and GitHub
7d4a77dce4
relax comma benchmark timeout ( #16568 )
2026-06-11 18:03:37 +09:00
George Hotz and GitHub
fd76ac992e
cstyle renderer is new style [pr] ( #16484 )
...
* cstyle new style
* switch cstyle renderer to new style
* fix hip
* fixes
* fix webgpu
* correct webgpu is_packed
* fix dsp
* fixes
* fix Ops.RANGE must be CONST
* old style render access
* this is correct
* fix cstyle to good
* dl/dr
* as array
* fix spec
* remove define_local/define_reg
* buffer in shrink
* fix test_tiny
* all tests fix
* param args aren't realized
* wgsl fix
* work
* new gate
* fix opencl qcom
* process replay
* sort order
* fix render index
2026-06-09 18:36:01 -07:00
George Hotz and GitHub
ffadd7a315
remove intel and amx support ( #16482 )
2026-06-02 18:53:05 -07:00
sirhcm and GitHub
a909acb882
move llvmspeed to benchmarks ( #16422 )
2026-05-28 22:26:22 -04:00
geohot
322693dcd3
hotfix: bump Mac pytest timeout to 4 minutes (try 2)
2026-05-25 18:23:21 -07:00
geohot
942cb42b97
Revert "hotfix: bump Mac pytest timeout to 4 minutes"
...
This reverts commit 695a0069ed
2026-05-25 17:25:11 -07:00
geohot
695a0069ed
hotfix: bump Mac pytest timeout to 4 minutes
2026-05-25 17:20:19 -07:00
chenyu and GitHub
7af7b6703a
relax policy ASSERT_MIN_STEP_TIME to 3.2 ( #16273 )
2026-05-19 22:29:09 -04:00
nimlgen and GitHub
a708542308
fix ci spec ( #16156 )
2026-05-12 17:57:11 +03:00
geohot
1d1b726cf6
hotfix: disable flaky framework pytest
2026-05-07 17:05:06 -07:00
qazal and GitHub
f9083cf901
use subactions for benchmark.yml process replay [pr] ( #13396 )
2026-05-08 03:46:25 +09:00
nimlgen and GitHub
5b4f62519d
cache buffer_views as well ( #16039 )
...
* cache buffer_views as well
* reuse
* back
* x
2026-05-05 00:00:09 +03:00
nimlgen and GitHub
77965a22e5
local optimize as rewrite ( #15953 )
...
* local optimize as rewrite
* better
* x
* slighly rename
* fix
* ugh
* remove
* x
* remove
* not weak
2026-04-28 22:51:04 +03:00
nimlgen and GitHub
b8d3bf8970
run_linear in jit ( #15827 )
...
* run_linear in jit
* x
* x
* f
* casts
* ugh
* f
* x
* x
* simple
2026-04-20 23:03:30 +03:00
George Hotz and GitHub
16f50a40a5
remove REMU from tree ( #15706 )
...
* no more compare emulators
* remove remu from tree
2026-04-13 20:43:08 +08:00
nimlgen and GitHub
0ff30b003d
am: reset queues from spi ( #15664 )
...
* am: reset queues from spi
* move
2026-04-09 18:25:50 +03:00
sirhcm and GitHub
19e96497ee
interface in DEV ( #15620 )
2026-04-06 19:59:28 -04:00
geohot
sirhcmandGitHub