geohot
10d207a6f4
work
2026-07-18 00:43:44 +00:00
Comma Device
f072c2bf97
qcom fast matmul crap from gpt 5.5
2026-07-12 22:44:05 +00:00
George Hotz and GitHub
03ecad9486
full removal of dtype.vec ( #16996 )
...
* full removal of dtype.vec
* fix typo
2026-07-12 09:25:50 -07:00
qazal and GitHub
cae6696d75
llama: split current and next amax state ( #16993 )
2026-07-12 18:52:33 +09:00
qazal and GitHub
9ea7de020b
llama: fuse grad scale in gemm epilogue ( #16992 )
2026-07-12 18:15:01 +09:00
qazal and GitHub
73b38854b4
llama: aT_b fp8 gemm ( #16991 )
2026-07-12 16:57:10 +09:00
chenyu and GitHub
047a467bf9
delete UOp._stack and UOp.vectorize [PR] ( #16988 )
2026-07-11 15:26:55 -04:00
nimlgen and GitHub
928af24b74
hcq2: mini speed ups ( #16984 )
2026-07-11 15:48:07 +03:00
qazal and GitHub
75a4bfddc9
fp8 gemm tests including fused scales ( #16980 )
...
* fp8 gemm tests matching fused scales
* work
* diff
2026-07-11 12:33:21 +09:00
nimlgen and GitHub
52e060fd7a
hcq2: link cache ( #16965 )
...
* x
* x
* mini
* cleaner
2026-07-10 23:47:16 +03:00
chenyu and GitHub
ba2c68b1ed
start dtypes.index [PR] ( #16949 )
2026-07-09 15:12:23 -04:00
nimlgen and GitHub
c9f6b2e42b
hcq2: prereq for linker ( #16945 )
2026-07-09 17:21:21 +03:00
qazal and GitHub
6dbc35b8e0
fix am_smi for non interactive shell ( #16942 )
2026-07-09 13:32:59 +09:00
wozeparrot and GitHub
2971343a60
fa: support D=64 and attn sink ( #16935 )
2026-07-08 20:03:47 -07:00
nimlgen and GitHub
52b84adc2a
hcq2: tiny changes ( #16934 )
2026-07-08 23:17:28 +03:00
George Hotz and GitHub
fdffc6c0c8
remove dtypes base ( #16931 )
...
* remove dtypes base
* find/replace bug
* vcount is junk too
2026-07-08 11:48:11 -07:00
George Hotz and GitHub
63cb1369cb
remove ImageDType (glm) ( #16918 )
...
* remove ImageDType (glm)
* gpt work
* better
* is_image_shape
* cleanups
* remove crap from index
* revert crap python change
* image index with float, this needs to be fixed
* simp
2026-07-08 11:27:52 -07:00
chenyu and GitHub
e0c70b6b82
mixin/op.py [PR] ( #16926 )
...
* mixin/op.py [PR]
* that
2026-07-07 21:45:52 -04:00
George Hotz and GitHub
2fc7e5341b
final removal of PtrDType (glm) ( #16913 )
...
* final removal of PtrDType (glm)
* junk
2026-07-07 13:37:33 -07:00
nimlgen and GitHub
91cefdb52a
hcq2: rewrite patch split ( #16907 )
...
* x
* new patch splitter
* style
* x
* x
2026-07-07 20:43:52 +03:00
George Hotz and GitHub
6f1a983493
Ops.GROUP has no shape, like sink ( #16906 )
...
* Ops.GROUP has no shape, like sink
* readme
2026-07-07 08:20:38 -07:00
George Hotz and GitHub
6e44176cfe
fix flash attention example ( #16900 )
...
* fix spec for amd_copy_matmul
* remove shaped wmma
* fix flash attention example?
* dead code
2026-07-06 20:51:32 -07:00
George Hotz and GitHub
d94ad4444e
fix spec for amd_copy_matmul + remove SHAPED_WMMA ( #16897 )
...
* fix spec for amd_copy_matmul
* remove shaped wmma
2026-07-06 19:00:10 -07:00
George Hotz and GitHub
40d112d4d6
remove ptr=True from index ( #16898 )
2026-07-06 18:34:18 -07:00
George Hotz and GitHub
9512dc30f4
remove vec from const ( #16889 )
...
* remove vec from const
* reject in spec
* remove all vector dtypes
* not needed
* remove that
* clean up invalid
2026-07-06 12:23:07 -07:00
nimlgen and GitHub
47f9677f67
hcq2: shuffle passes ( #16886 )
2026-07-06 21:56:55 +03:00
wozeparrot and GitHub
35522af0df
gptoss: use quantize_mxfp8 ( #16881 )
2026-07-05 17:48:24 -07:00
nimlgen and GitHub
62cde59cb5
hcq2: tiny changes ( #16880 )
2026-07-06 00:24:55 +03:00
nimlgen and GitHub
17e4f9b6f9
hcq2: simpler ( #16878 )
2026-07-05 18:26:19 +03:00
George Hotz and GitHub
a145fdce4b
remove the .gep method ( #16867 )
2026-07-04 14:07:09 -07:00
nimlgen and GitHub
fdf434062b
hcq2: simpler ( #16862 )
...
* x
* x
* x
2026-07-04 22:07:37 +03:00
qazal and GitHub
07f7383d29
llama: remove unused bf16 assembly gemm ( #16859 )
...
* only hk bf16 gemm
* rm asm gemm
* more cleanup
* half isn't supported in asm gemm anymore
* more test edits
* unused
* remove TestMagicGu
* uop gemm is still tested
* minimal diff
2026-07-04 18:41:54 +09:00
nimlgen and GitHub
d73bca617b
hcq2: fix deps tracking ( #16841 )
2026-07-03 15:51:25 +03:00
nimlgen and GitHub
c2c784e028
hcq2: rewrite ( #16775 )
...
* hcq2: rewrite
* rw
* mid
* jit
* tmp
* x
* x
* revert
* x
* x
2026-07-03 00:00:08 +03:00
chenyu and GitHub
2e62dd308d
move fs_load and fs_store to nn ( #16821 )
...
similar to safe_load and safe_save
2026-07-01 22:01:15 -04:00
chenyu and GitHub
fd7fd9cdca
move GETADDR device to its arg ( #16808 )
2026-07-01 09:14:07 +03:00
chenyu and GitHub
3a9b87e48f
remove Ops.DEVICE from Ops.PROGRAM [PR] ( #16797 )
2026-06-29 17:41:31 -04:00
nimlgen and GitHub
4c3789661d
hcq2: split hcq_schedule into hcq_compile/hcq_link for jit ( #16784 )
2026-06-28 10:19:48 +03:00
chenyu and GitHub
36c0e81979
deprecate Tensor.training [PR] ( #16774 )
2026-06-27 11:02:28 -04:00
nimlgen and GitHub
fe9cd76e8b
hcq2: cleanup ( #16767 )
2026-06-26 20:26:35 +03:00
qazal and GitHub
b8224e19a7
llama: remove unused fp8 transpose kernel ( #16763 )
2026-06-26 16:31:13 +09:00
sirhcm and GitHub
c759301865
ci: cleanup torch backend tests ( #16750 )
2026-06-25 14:39:36 -04:00
wozeparrot and GitHub
e0c69d7a12
llama: fused grad quantize ( #16731 )
2026-06-24 23:25:39 -04:00
George Hotz and GitHub
0a8e61d0c5
switch to the new memory coaleser [pr] ( #16716 )
...
* switch to the new memory coalese
* move that stuff
* copy in allowed length logic
* mulitple buffers
* new coalese is better
* fine
* earlier
* fixes
* work
* work
* valid
* stack on index const
2026-06-23 18:03:48 -07:00
wozeparrot and GitHub
dfea9e7994
llama: fused silu mul quantize mxfp8 ( #16704 )
2026-06-23 16:59:50 -07:00
nimlgen and GitHub
7c1d0b6d9a
hcq2: use shrink(bitcast) ( #16713 )
...
* hcq2: use shrink(bitcast)
* x
2026-06-23 18:11:39 +03:00
nimlgen and GitHub
f9c8c697d6
hcq2: drop args after inner deps ( #16708 )
2026-06-22 23:26:11 +03:00
chenyu and GitHub
33b635d23a
Tensor.train -> TRAINING [PR] ( #16705 )
...
* Tensor.train -> TRAINING [PR]
* doc
2026-06-22 15:13:22 -04:00
wozeparrot and GitHub
fe9b19b12d
llama: more mp mem fixes ( #16701 )
...
* llama: more mp mem fixes
* clean: unused
* fix: batch
2026-06-22 10:54:35 -04:00
chenyu and GitHub
267af9c601
full_like to CreationMixin [PR] ( #16702 )
2026-06-22 09:33:23 -04:00
geohot
Comma Device
sirhcmandGitHub