geohot
ab3a217c0b
rewrite to loop before backends
2026-07-23 18:45:33 -07:00
chenyu and GitHub
f5d9c31d15
arange upcast to int64 with big N ( #17167 )
...
simplifies _one_hot_along_dim
2026-07-23 20:11:39 -04:00
George Hotz and GitHub
bf5989ea48
support loops in nir (kimi) ( #17166 )
...
* support loops in nir
* tpying
2026-07-23 17:05:15 -07:00
chenyu and GitHub
3e031d6c4d
AND OR XOR SHL SHR cannot have float operands [PR] ( #17164 )
...
* AND OR XOR SHL SHR cannot have float operands [PR]
* dont
2026-07-23 18:51:56 -04:00
chenyu and GitHub
1b616669d2
few more symbolic rules [pr] ( #17161 )
...
bitcast twice can skip middle one; bool != False is self; two more where combine
2026-07-23 18:05:32 -04:00
sirhcm and GitHub
6ee16eb1fa
split out LLVM compilers ( #17160 )
2026-07-23 17:45:23 -04:00
chenyu and GitHub
250de4b142
use stack for same shape cat [pr] ( #17156 )
...
same device multi cat benefits too
2026-07-23 13:50:28 -04:00
chenyu and GitHub
9267fca91a
use STACK in wino ( #17155 )
...
STACK is great
2026-07-23 13:02:42 -04:00
chenyu and GitHub
2983987321
clean up some tests ( #17154 )
...
duplicated or typo or slow
2026-07-23 11:22:18 -04:00
chenyu and GitHub
e9a86c99ed
more symmetrical x//d<c -> x<c*d [pr] ( #17146 )
...
* more symmetrical x//d<c -> x<c*d [pr]
* parse_valid too
2026-07-23 00:19:53 -04:00
chenyu and GitHub
6a9c23b1c1
more symmetrical div_and_mod_symbolic [pr] ( #17145 )
2026-07-22 23:34:03 -04:00
chenyu and GitHub
855175123b
fix z3 AND in validate ( #17139 )
2026-07-22 16:09:28 -04:00
chenyu and GitHub
a7c693d2fd
rework pm_lower_weakint [pr] ( #17136 )
...
deleted pm_no_index and many "remove hanging casts"
2026-07-22 15:53:11 -04:00
chenyu and GitHub
6b82c0cb95
minor test fixes ( #17138 )
...
TestCustomKernel square().max() masks NaN, and fixed test_tensor_cores_multi_reduce
2026-07-22 15:08:52 -04:00
sirhcm and GitHub
c7027db715
lvp: skip test_masked_select ( #17137 )
2026-07-22 14:53:09 -04:00
chenyu and GitHub
557e674861
delete pm_index_invalid [pr] ( #17130 )
2026-07-22 11:50:08 -04:00
chenyu and GitHub
17557d7fdf
bring back fold_where_closure [pr] ( #17134 )
...
* bring back fold_where_closure [pr]
generic enough to delete delete pm_index_invalid
* cannot cache self
2026-07-22 11:08:14 -04:00
nimlgen and GitHub
a6fda6b102
add volatile to paramarg ( #17127 )
...
* volatile
* x
* x
* fo
2026-07-22 15:47:37 +03:00
nimlgen and GitHub
6e979b879b
call inside c ( #17131 )
2026-07-22 13:49:06 +03:00
George Hotz and GitHub
39924387b1
LOOP is srcless RANGE (kimi) ( #17129 )
...
* LOOP is srcless RANGE (kimi)
* upd
* cleanups
* cleanups
* we don't float anymore
2026-07-21 18:41:31 -07:00
chenyu and GitHub
92f9c850b4
fix pow(int, float) ( #17126 )
...
* fix pow(int, float)
* onnx
2026-07-21 18:48:24 -04:00
chenyu and GitHub
b1060ca708
don't promote dtype in _pad_constant [pr] ( #17125 )
2026-07-21 18:13:50 -04:00
chenyu and GitHub
f19a2ad771
single where mixin [pr] ( #17118 )
...
* single where mixin [pr]
no shape broadcasting in ufix and _broadcasted anymore
* QCOM vectorized bool is broken
2026-07-21 17:38:36 -04:00
Armand du Parc Locmaria and GitHub
ef37830d13
allow freeing buffers when pickling/unpickling ( #16799 )
...
* allow pickling out of band buffers
* also need to release when loading
* test peak ram
* lint
* sync before yielding next buffer for backends with async copy in
* skip on mock devices
* reason
* or always bytearray, always free?
* Revert "or always bytearray, always free?"
This reverts commit a017bb68742985a5b7431e0b4e973c2997c92b6a.
* one less copy
2026-07-21 16:11:23 -04:00
b764599d87
add Ops.LOOP + conditional Ops.END (kimi) ( #17117 )
...
* add Ops.LOOP + conditional Ops.END (kimi)
* c
* x
---------
Co-authored-by: George Hotz <[email protected] >
2026-07-21 22:54:14 +03:00
chenyu and GitHub
46b82d4755
don't auto cast cond for WHERE ( #17115 )
...
no or_casted all WHEREs with single mixin, matched torch
2026-07-21 13:00:07 -04:00
chenyu and GitHub
76dade5a11
implicit broadcast gradient based on shape only [pr] ( #17114 )
...
fixed gradient for shape () UOp, enabled unify WHERE mixin
2026-07-21 12:51:54 -04:00
chenyu and GitHub
f64f96ec59
broadcast_axes [PR] ( #17112 )
...
prerequisite to simplify broadcasting logic and make it implicit
2026-07-21 11:53:12 -04:00
sirhcm and GitHub
f3a5337825
correct spelling of coalesce ( #17103 )
2026-07-20 21:44:04 -04:00
chenyu and GitHub
95f5c85bf3
some realize and corealize for slow tests ( #17106 )
2026-07-20 21:43:23 -04:00
chenyu and GitHub
13ca9bd8a6
remove dtypes.index again ( #17104 )
...
also reverted some dtype change, the split made things needlessly complicated
2026-07-20 20:30:04 -04:00
sirhcm and GitHub
980748ccfc
add multiple_of to ParamArg ( #17101 )
2026-07-20 20:11:54 -04:00
George Hotz and GitHub
f7ce7f330d
llm: minor fixes + tests ( #17099 )
...
* llm: minor fixes + tests
* error
2026-07-20 14:31:20 -07:00
chenyu and GitHub
4b8db13e01
rdna int8 wmma ( #17098 )
...
nice to fix _wmma_name, also more generic tests
2026-07-20 17:00:50 -04:00
Pol Puigdemont Plana and GitHub
ef77963cfd
derivative of logsumexp is independent of max ( #17088 )
...
same as #7009 but for logsumexp and logcumsumexp.
fwd+bwd kernel count 5 -> 3 for both. gradients unchanged
(ties, -inf masks, torch-compared at grad_atol=1e-7).
2026-07-20 06:52:16 -07:00
qazal and GitHub
1cf8f2f68c
llama: inplace amax update ( #17064 )
...
* llama: inplace amax update
* remove amax_out return
* work
* fit
* work
* work
* keep
* diff cleanup
2026-07-20 15:05:41 +09:00
chenyu and GitHub
ac3f56a1a2
more shift tests ( #17083 )
2026-07-19 16:05:13 -04:00
chenyu and GitHub
89117d8b9e
use real shift in l2i decomp [pr] ( #17080 )
...
works for variable shift distace too, also fixed signed arithmetic fill
2026-07-19 13:15:06 -04:00
chenyu and GitHub
9970a0aad0
fix Tensor << Tensor for x86 ( #17082 )
...
* fix Tensor << Tensor for x86
* torch
2026-07-19 12:31:05 -04:00
chenyu and GitHub
0146a30125
improve cast to unsign min_max [pr] ( #17078 )
2026-07-18 21:58:41 -04:00
George Hotz and GitHub
b53cd35cff
llm: make tokenizer fast (kimi) ( #17077 )
...
* llm: make tokenizer fast
* simpler
* re.escape + qcom mypy fix
2026-07-18 17:31:59 -07:00
nimlgen and GitHub
232529ce88
hcq2: simpler sync ( #17069 )
...
* x
* y
* n
2026-07-18 16:27:44 +03:00
chenyu and GitHub
47629f4bcf
more weak dtype materialization raise ( #17071 )
2026-07-17 23:15:14 -04:00
chenyu and GitHub
f315df29a0
no weak Tensor from and to real buffer ( #17067 )
...
* no weak Tensor from and to real buffer
creation, assign, safe_save
* is_numpy_ndarray to tensor
* one more
2026-07-17 16:09:10 -04:00
George Hotz and GitHub
86a6ad8ed2
llm: split cli.py into serve.py with the HTTP server ( #17065 )
...
* llm: split cli.py into serve.py with the HTTP server
* min edit
2026-07-17 10:45:37 -07:00
George Hotz and GitHub
3ee2baf71d
llm: add tool calling support (kimi) ( #17061 )
...
* llm: add tool calling support
* simpler
* cls
* gpt cleanup
* more gpt cleanups
* tests for tools calling
2026-07-17 10:20:01 -07:00
qazal and GitHub
7dd3422c63
llama: replace two stage amax with atomics ( #17063 )
...
* atomic amax in c kernels
* quantize fp8 UOp kernel
* diff
2026-07-17 19:27:10 +09:00
sirhcm and GitHub
6f1176ea90
benchmarks: test usbgpu copy speeds on comma ( #17060 )
2026-07-17 02:02:21 -04:00
George Hotz and GitHub
46172bb7c7
llm: add optional jinja template support (kimi) ( #17058 )
...
* add jinja template support (kimi)
* fix tests
* lil
* more crap to fallback
2026-07-16 19:02:58 -07:00
chenyu and GitHub
88826a6f35
no weak dtype for randn_like either ( #17055 )
2026-07-16 18:29:12 -04:00