George Hotz and GitHub
e103fb2a10
more lil llm improvements ( #17514 )
...
Autogen / In-tree Autogen (comgr 2) (push) Successful in 47s
Unit Tests / Torch Backend Tests (push) Failing after 1m3s
Unit Tests / Linters (push) Failing after 1m27s
Unit Tests / Python Backend (push) Failing after 3m8s
Unit Tests / Fuzzing (push) Failing after 21s
Unit Tests / Docs (push) Successful in 3m32s
Unit Tests / Null Tests (push) Successful in 4m8s
Unit Tests / Unit Tests (push) Successful in 3m30s
Unit Tests / CL IMAGE Tests (push) Failing after 44s
Unit Tests / openpilot Compile Tests (push) Failing after 47s
Unit Tests / Test LLM (push) Failing after 13s
Unit Tests / SPEC=2 (1) (push) Successful in 3m53s
Deploy Docs / deploy (push) Successful in 5m1s
Unit Tests / Optimization Tests (push) Failing after 49s
Unit Tests / SPEC=2 (2) (push) Successful in 3m42s
Unit Tests / Linux (DEV=CL) (push) Failing after 38s
Unit Tests / Models (push) Successful in 1m39s
Unit Tests / Linux (DEV=CPU:X86) (push) Failing after 23s
Unit Tests / Linux (DSP) (push) Successful in 1m47s
Unit Tests / hcq2 (push) Failing after 48s
Unit Tests / Linux (am) (push) Failing after 52s
Unit Tests / Linux (DEV=CPU:LLVM) (push) Successful in 3m13s
Unit Tests / Linux (DEV=CPU:LVP) (push) Successful in 3m6s
Unit Tests / AMD ASM IDE (push) Failing after 2m46s
Unit Tests / Linux (DEV=CPU:CLANG) (push) Successful in 4m19s
Unit Tests / ONNX (CPU) Tests (push) Successful in 5m24s
Autogen / In-tree Autogen (push) Successful in 10m40s
Unit Tests / Linux (DEV=WEBGPU) (push) Failing after 5m0s
Unit Tests / Linux (amdllvm gfx1100) (push) Successful in 3m40s
Unit Tests / Linux (amd gfx1100) (push) Successful in 4m13s
Unit Tests / Linux (amdllvm gfx1201) (push) Successful in 3m35s
Unit Tests / Compile-only (DEV=NULL:IR3:a630) (push) Failing after 30s
Unit Tests / Linux (amd gfx1201) (push) Successful in 4m10s
Unit Tests / Compile-only (DEV=NULL:NAK:sm_120) (push) Failing after 28s
Unit Tests / Compile-only (DEV=NULL:QCOMCL:a630) (push) Failing after 40s
Unit Tests / Linux (amdllvm gfx950) (push) Successful in 3m36s
Unit Tests / Linux (ptx) (push) Failing after 3m17s
Unit Tests / Linux (amd gfx950) (push) Successful in 5m25s
Unit Tests / Linux (nv) (push) Failing after 5m17s
Autogen / In-tree Autogen (macos) (push) Canceled after 0s
Benchmarks / Mac pytest (push) Canceled after 0s
Benchmarks / LLM (DEV=AMD) (push) Canceled after 0s
Benchmarks / LLM (DEV=METAL) (push) Canceled after 0s
Benchmarks / LLM (DEV=NV) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=AMD) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=METAL) (push) Canceled after 0s
Benchmarks / HLB-CIFAR10 (DEV=NV) (push) Canceled after 0s
Benchmarks / MLPerf (AMD) (push) Canceled after 0s
Benchmarks / MLPerf (NV) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=AMD) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=METAL) (push) Canceled after 0s
Benchmarks / Stable Diffusion (DEV=NV) (push) Canceled after 0s
Benchmarks / Tests (DEV=AMD) (push) Canceled after 0s
Benchmarks / Tests (DEV=METAL) (push) Canceled after 0s
Benchmarks / Tests (DEV=NV) (push) Canceled after 0s
Benchmarks / UsbGPU Benchmark (push) Canceled after 0s
Benchmarks / comma Benchmark (0.11.2) (push) Canceled after 0s
Benchmarks / comma Benchmark (0.11.0) (push) Canceled after 0s
Benchmarks / DSP Benchmark (push) Canceled after 0s
Benchmarks / UsbGPU Benchmark (comma) (push) Canceled after 0s
Benchmarks / PCI Driver Benchmark (DEV=AMD) (push) Canceled after 0s
Benchmarks / PCI Driver Benchmark (DEV=NV) (push) Canceled after 0s
Benchmarks / LLVM Speed (push) Canceled after 0s
Platform Tests / MacOS (unit) (push) Canceled after 0s
Platform Tests / MacOS (unit, mock) (push) Canceled after 0s
Platform Tests / MacOS (DEV=METAL) (1) (push) Canceled after 0s
Platform Tests / MacOS (DEV=METAL) (2) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:CLANG) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:LLVM) (push) Canceled after 0s
Platform Tests / MacOS (DEV=CPU:LVP) (push) Canceled after 0s
Platform Tests / MacOS (DEV=WEBGPU) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:CLANG) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:LLVM) (push) Canceled after 0s
Platform Tests / Windows (DEV=CPU:X86) (push) Canceled after 0s
Platform Tests / Windows (DEV=WEBGPU) (push) Canceled after 0s
* more lil llm improvements
* default float
2026-08-12 20:13:20 -07:00
George Hotz and GitHub
2297118541
lil llm improvements ( #17513 )
2026-08-12 19:29:32 -07:00
sirhcm and GitHub
479ffb0cda
remove Ops.SLICE ( #17492 )
2026-08-11 18:50:04 -04:00
b1tg and GitHub
abe2256299
fix symbolic sharded reshape ( #17463 )
2026-08-08 09:18:02 -07:00
b1tg and GitHub
8c49a7a34b
support symbolic shapes in copy ( #17461 )
...
* pad_to is no-op when same shape
* support symbolic shapes in copy
2026-08-08 09:16:59 -07:00
chenyu and GitHub
baa6148066
fix var of large half input ( #17444 )
...
* fix var of large half input
similar to mean, we use sum_acc_dtype for denominator
* mypy
2026-08-06 23:14:32 -04:00
chenyu and GitHub
7a9cd8e329
move weak function and pm to uop/weak [PR] ( #17429 )
2026-08-05 22:27:40 -04:00
sirhcm and GitHub
be25207a7a
scope variable names inside CALLs ( #17424 )
2026-08-05 20:59:09 -04:00
chenyu and GitHub
c2f1e5ae2a
fix weak cast to strong dtype [pr] ( #17418 )
...
weak can mean higher than that strong dtype, so always use that strong dtype is wrong
2026-08-05 15:32:23 -04:00
chenyu and GitHub
6cb419b9b7
regression test for bert nan with weak ( #17412 )
2026-08-05 12:14:26 -04:00
chenyu and GitHub
3bf9e70b19
Revert "don't cast weak in _broadcasted [pr] ( #17408 )" ( #17409 )
...
This reverts commit b45058b5ec
2026-08-05 02:40:33 -04:00
chenyu and GitHub
b45058b5ec
don't cast weak in _broadcasted [pr] ( #17408 )
...
* don't cast weak in _broadcasted [pr]
* fine now?
2026-08-05 02:19:31 -04:00
George Hotz and GitHub
46f0003776
more KernelCountException ( #17407 )
2026-08-04 22:55:38 -07:00
George Hotz and GitHub
e1f42681fa
add new schedule tests + format better ( #17402 )
...
* add new schedule tests + format better
* assert_kernel_count
2026-08-04 18:46:38 -07:00
chenyu and GitHub
3eab809e06
update minimum to not create strong type const [PR] ( #17401 )
2026-08-04 21:29:24 -04:00
b1tg and GitHub
0796853845
support symbolic shapes in allreduce ( #17364 )
2026-08-04 07:53:12 -07:00
George Hotz and GitHub
c21a552f3d
llm: bugfixes + warmup ( #17384 )
2026-08-03 18:23:14 -07:00
George Hotz and GitHub
3cb786f447
llm: update test_llm_server tests ( #17382 )
2026-08-03 16:06:17 -07:00
George Hotz and GitHub
05bc7c6994
fix llm reasoning and Linear import ( #17372 )
2026-08-02 12:31:52 -07:00
chenyu and GitHub
6c0ec39279
UOp.is_invalid [PR] ( #17351 )
...
helper to prep ConstArg
2026-08-01 02:36:32 -04:00
chenyu and GitHub
b502fc1367
more const arg -> val ( #17350 )
2026-08-01 02:18:10 -04:00
George Hotz and GitHub
a88f832f0c
remove UOp.val ( #17345 )
2026-07-31 18:58:38 -07:00
chenyu and GitHub
ad24750487
const(value, dtype) -> const(value).cast(dtype) in tests ( #17335 )
2026-07-31 13:24:31 -04:00
chenyu and GitHub
7f4dbb8090
remove shape= from UOp.const [PR] ( #17331 )
...
inlined to const_like
2026-07-31 11:18:59 -04:00
chenyu and GitHub
8e2f175542
const(dtype, b) -> const(b, dtype) [PR] ( #17328 )
...
prep for dtype removal
2026-07-31 09:46:37 -04:00
chenyu and GitHub
fe8ece7efa
fix weak for image gate fusion [pr] ( #17310 )
2026-07-30 19:47:47 -04:00
chenyu and GitHub
ce500c1946
broadcast doesn't cast CONST [pr] ( #17308 )
...
* broadcast doesn't cast CONST [pr]
it might change arg from python int to python float, but not cast the CONST, so we don't need or_casted in symbolic. we lower the weak dtype right before decomp
* fix
2026-07-30 18:51:59 -04:00
chenyu and GitHub
b488cc7df2
update dtype_from_uop for SHR/SHL ( #17307 )
...
certain backend cast the distance, and we should not re-broadcast it
2026-07-30 13:57:58 -04:00
b1tg and GitHub
e25bf77ce9
kimi delta attention ( #17281 )
...
* kimi delta attention
* config
* test
2026-07-30 08:23:56 -07:00
George Hotz and GitHub
b30c7e00d4
support 2d on UNSHARD (kimi) ( #17285 )
...
* support 2d on UNSHARD
* fixes
* Fix test and spec
* single barrier
* 2d sharding works for devices too
* cleanups
* no _rewrap
2026-07-29 12:01:59 -07:00
chenyu and GitHub
dd86a30798
test case for weakfloat cast to weakint INDEX ( #17287 )
2026-07-29 14:15:52 -04:00
George Hotz and GitHub
57ae1bc7a7
rename MULTI to UNSHARD ( #17267 )
...
* rename MULTI to UNSHARD
* comment updates (glm)
* rename method to unshard
2026-07-28 16:51:41 -07:00
George Hotz and GitHub
1757067fa6
add device range as src[1] to multi (kimi) ( #17264 )
...
* add device range as src[1] to multi (kimi)
* cleanup
* fix tests
2026-07-28 16:39:34 -07:00
chenyu and GitHub
23e9e76e8c
DEFAULT_FLOAT/DEFAULT_INT ContextVar [pr] ( #17265 )
2026-07-28 19:08:18 -04:00
chenyu and GitHub
fde3a8faff
CAPTURE_PROCESS_REPLAY=0 default chaging test [PR] ( #17261 )
...
* CAPTURE_PROCESS_REPLAY=0 default chaging test [PR]
quick patch before making default dtype context vars, which is quite annoying
* few more
2026-07-28 17:32:35 -04:00
qazal and GitHub
e3b3eea1e2
test for extra copy in allreduce_cast ( #16740 )
...
* test for extra copy in allreduce_cast
* simpler
* cleanup
2026-07-28 19:02:54 +09:00
chenyu and GitHub
0bb36c9989
make Tensor(None) weakfloat ( #17241 )
...
match other float consts
2026-07-27 16:45:28 -04:00
chenyu and GitHub
818a892ebc
flip from_py to use weak dtypes [pr] ( #17229 )
2026-07-27 10:07:00 -04:00
chenyu and GitHub
4b6760539b
fix _prepare_jit_inputs for weak [pr] ( #17222 )
2026-07-26 14:03:27 -04:00
chenyu and GitHub
a8d51097dc
realize weak is no-op [pr] ( #17219 )
...
None device and weak dtype are both virtual
2026-07-26 11:52:56 -04:00
79c07a334c
fix ValueError in UOp.axis for shard reshape crossing boundary ( #16547 )
...
Co-authored-by: George Hotz <[email protected]
2026-07-26 08:38:10 -07:00
chenyu and GitHub
5d1aa84901
SHR/SHL are Broadcastable [pr] ( #17216 )
2026-07-26 02:11:03 -04:00
chenyu and GitHub
a96974e70c
slight weak behavior tweak and cleanups [pr] ( #17214 )
...
* slight weak behavior tweak and cleanups [pr]
* ruff
2026-07-25 22:51:24 -04:00
chenyu and GitHub
076b37e1ae
failing batch norm test ( #17206 )
...
* failing batch norm test
running stats does not schedule in training now since there's no reader
* not that
2026-07-25 18:46:49 -04:00
chenyu and GitHub
74c2121d99
promo (uint64, int) -> weakfloat like JAX [pr] ( #17204 )
2026-07-25 15:20:42 -04:00
chenyu and GitHub
2dd2e3d786
don't support Tensor(list(np.array)) [pr] ( #17175 )
2026-07-24 03:13:28 -04:00
chenyu and GitHub
3e031d6c4d
AND OR XOR SHL SHR cannot have float operands [PR] ( #17164 )
...
* AND OR XOR SHL SHR cannot have float operands [PR]
* dont
2026-07-23 18:51:56 -04:00
chenyu and GitHub
9267fca91a
use STACK in wino ( #17155 )
...
STACK is great
2026-07-23 13:02:42 -04:00
chenyu and GitHub
2983987321
clean up some tests ( #17154 )
...
duplicated or typo or slow
2026-07-23 11:22:18 -04:00
George Hotz and GitHub
39924387b1
LOOP is srcless RANGE (kimi) ( #17129 )
...
* LOOP is srcless RANGE (kimi)
* upd
* cleanups
* cleanups
* we don't float anymore
2026-07-21 18:41:31 -07:00
sirhcmandGitHub