wozeparrot and GitHub
fe9b19b12d
llama: more mp mem fixes ( #16701 )
...
* llama: more mp mem fixes
* clean: unused
* fix: batch
2026-06-22 10:54:35 -04:00
chenyu and GitHub
267af9c601
full_like to CreationMixin [PR] ( #16702 )
2026-06-22 09:33:23 -04:00
wozeparrot and GitHub
5164c21b44
gemm: keep shape thru mxfp8 quantize ( #16692 )
2026-06-20 22:28:53 -07:00
wozeparrot and GitHub
bba611bb59
gemm: fix mxfp8 on more shapes ( #16677 )
2026-06-19 13:28:53 -07:00
George Hotz and GitHub
649971f02a
remove DEFINE_LOCAL and DEFINE_REG (gpt) ( #16673 )
...
* remove define_local and define_reg (gpt)
* fix precommit
* cleanups
* regalloc fix
* cleanups 2
2026-06-19 10:07:50 -07:00
wozeparrot and GitHub
05249466ed
llama: fused quantize mxfp8 ( #16667 )
2026-06-18 16:02:28 -07:00
George Hotz and GitHub
4a4b6956df
remove DEFINE_VAR from codebase (gpt) ( #16666 )
...
* remove DEFINE_VAR from codebase
* junk
* remove junk
2026-06-18 15:33:50 -07:00
nimlgen and GitHub
eda0a402d1
hcq2: fix multi ( #16661 )
2026-06-18 22:56:49 +03:00
wozeparrot and GitHub
d37248c3ec
gemm: fix mxfp8 on odd shapes ( #16664 )
2026-06-18 12:03:59 -07:00
wozeparrot and GitHub
bed0c343a3
faster mxfp8 gemm ( #16656 )
2026-06-17 22:35:36 -07:00
George Hotz and GitHub
aef85ddc4d
addrspace special/range ( #16647 )
...
* addrspace special/range
* just include indexing
* define var is alu
* bring old ignore indexing back
* mults to fix
* fixes
* ALU
* fixes
2026-06-17 15:57:37 -07:00
nimlgen and GitHub
0f0c622086
hcq2: multi folders ( #16642 )
2026-06-17 15:20:25 +03:00
wozeparrot and GitHub
36f6d1b064
gemm: fix bf16 atb for mp sharding ( #16637 )
2026-06-16 15:58:47 -07:00
nimlgen and GitHub
5644605d92
hcq2: pack bufs ( #16635 )
...
* hcq2: pack bufs
* x
2026-06-16 18:58:16 +03:00
nimlgen and GitHub
4a0488ae97
hcq2: optims ( #16624 )
...
* hcq2: optims
* x
2026-06-15 23:58:28 +03:00
qazal and GitHub
f998b9930a
fp8 gemm inv_scale in epilogue ( #16625 )
...
* fuse scale
* remove python inv_scale
* more inv_scale removal
* more cleanups
* cleaner
* diff polish
* work
* rename
* simpler
* simpler
* compute
* c
* Revert "c"
This reverts commit 8941fec7ca .
* Revert "compute"
This reverts commit 9db573a6d3 .
* Revert "simpler"
This reverts commit 910ad33f87 .
* Revert "simpler"
This reverts commit bf75d235a1 .
* s_g
* update types
* less diff noise
* remove
2026-06-15 18:44:41 +09:00
nimlgen and GitHub
4dc51aff6e
hcq2: jit ( #16621 )
...
* hcq2: jit
* x
* x
* minor
2026-06-15 06:35:35 +07:00
nimlgen and GitHub
5a9227b30a
hcq2: rebind var params ( #16610 )
2026-06-13 14:55:52 +03:00
qazal and GitHub
2e77bd01db
fp8 gemm cleanup ( #16607 )
2026-06-13 13:17:32 +09:00
sirhcm and GitHub
bcdb988df0
split comma benchmark, dsp on c4 [PR] ( #16598 )
2026-06-12 23:26:05 -04:00
wozeparrot and GitHub
67a4f129c2
llama: fix bf16 gemm oob ( #16603 )
2026-06-12 19:43:05 -07:00
nimlgen and GitHub
2bfdf85f87
hcq2: move pre bufferize ( #16589 )
...
* hcq2: move pre bufferize
* x
2026-06-12 16:11:59 +03:00
qazal and GitHub
4d34590b7d
llama: less E kernels ( #16517 )
2026-06-12 19:49:25 +09:00
qazal and GitHub
12f4cf0e49
rename amd/test_custom_kernel.py to test_asm_kernel ( #16586 )
...
* rename amd/test_custom_kernel.py to test_asm_kernel
* update
2026-06-12 16:11:01 +09:00
wozeparrot and GitHub
e770805d21
llama: mxfp8 ( #16574 )
2026-06-11 22:15:24 -07:00
nimlgen and GitHub
e5f498de3b
hcq2: debug=2 info ( #16569 )
...
* hcq2: debug=2 info
* t
* x
* hcq2: debug=2 info
* x
2026-06-11 19:52:01 +03:00
wozeparrot and GitHub
c38d6a7e3a
mxfp8 part 2 ( #16561 )
2026-06-10 23:36:11 -07:00
George Hotz and GitHub
7e6d617935
addrspace cleanups ( #16565 )
...
* addrspace cleanups
* bumps
* eh, relax a little
2026-06-10 15:57:18 -07:00
wozeparrot and GitHub
2bdc360606
gemm: mxfp8 hipkittens gemm ( #16541 )
...
* gemm: mxfp8 hipkittens gemm
* feat: update hipkittens
* feat: kernel signature
* clean: just kernel
* feat: from tinygrad
* feat: test
* fix: add back utils
* clean: no diff
* clean: no diff
2026-06-09 15:20:05 -07:00
nimlgen and GitHub
2ab2d51099
hcq2: fix repeated calls ( #16552 )
2026-06-09 19:11:42 +03:00
nimlgen and GitHub
fa31c744b9
hcq2: cleaner ( #16550 )
2026-06-09 16:33:05 +03:00
wozeparrot and GitHub
5ef30005fa
update hipkittens ( #16544 )
2026-06-08 18:53:25 -07:00
nimlgen and GitHub
95d63d6c07
hcq2: lower to ins ( #16535 )
...
* hcq2: lower to ins
* pm4
* f
2026-06-08 16:15:30 +03:00
nimlgen and GitHub
8baca185d5
hcq2: add kfd ( #16537 )
2026-06-08 13:48:27 +03:00
wozeparrot and GitHub
a1ec32cfd2
llama: current grad scaling ( #16518 )
2026-06-05 15:39:41 -07:00
nimlgen and GitHub
5ebd44aa12
hcq2: merge queues ( #16514 )
...
* hcq2: mergw queues
* cleaner
2026-06-05 21:20:25 +03:00
qazal and GitHub
79a13310b3
viz: kernel_graph.txt unique is per schedule ( #16511 )
2026-06-05 16:17:28 +09:00
nimlgen and GitHub
3838c8df1b
hcq2: move global sync ( #16504 )
2026-06-04 17:32:40 +03:00
chenyu and GitHub
0faaf6df26
remove kwargs from arange and linspace [PR] ( #16505 )
...
it used to have requires_grad and device, now both are removed
2026-06-04 10:32:37 -04:00
qazal and GitHub
3b1a5f9770
llama: a_bT and aT_b bf16 gemms ( #16487 )
...
* hk_bf16_gemm
* enable in 8b
* cleanups
* rename to USE_HK_BF16_GEMM
* work
* work
* work
* work
* change the gemms
* work
* work
* set as default
* work
* change
2026-06-04 23:30:21 +09:00
nimlgen and GitHub
11af81f96f
hcq2: cleaner ( #16502 )
2026-06-04 15:26:37 +03:00
chenyu and GitHub
2c915c61ed
no CONST(DEVICE) in torch_backend ( #16499 )
2026-06-04 00:26:47 -04:00
qazal and GitHub
f7f03bd7e5
viz: better name for src id in kernel_graph.txt ( #16495 )
...
* viz: better name for src id in kernel_graph.txt
* better order
* cleanup
2026-06-04 11:09:29 +09:00
nimlgen and GitHub
6f2a2857c8
hcq2: refactor deps ( #16490 )
2026-06-03 23:20:24 +03:00
chenyu and GitHub
8a4203638a
make full with buffer=False deviceless ( #16483 )
...
affects arange and eye
2026-06-03 12:35:59 -04:00
qazal and GitHub
405866f2b7
viz: improve kernel_graph.py usability ( #16486 )
...
* better default
* always format kernel output
* also show ref
* sched num
2026-06-03 21:12:44 +09:00
wozeparrot and GitHub
7dcfd144b6
llama: columnwise fp8 scaling ( #16480 )
2026-06-02 18:55:45 -07:00
George Hotz and GitHub
ffadd7a315
remove intel and amx support ( #16482 )
2026-06-02 18:53:05 -07:00
nimlgen and GitHub
99e37b1ee3
hcq2: deps ( #16459 )
...
* start
* sin
* f
2026-06-02 22:34:25 +03:00
qazal and GitHub
854eac09c6
llama: no E_ copy after bf16 GEMM ( #16458 )
2026-06-02 14:14:13 +09:00