Commit Graph
1909 Commits
Author SHA1 Message Date
wozeparrotandGitHub fe9b19b12d llama: more mp mem fixes (#16701)
* llama: more mp mem fixes

* clean: unused

* fix: batch
2026-06-22 10:54:35 -04:00
chenyuandGitHub 267af9c601 full_like to CreationMixin [PR] (#16702) 2026-06-22 09:33:23 -04:00
wozeparrotandGitHub 5164c21b44 gemm: keep shape thru mxfp8 quantize (#16692) 2026-06-20 22:28:53 -07:00
wozeparrotandGitHub bba611bb59 gemm: fix mxfp8 on more shapes (#16677) 2026-06-19 13:28:53 -07:00
George HotzandGitHub 649971f02a remove DEFINE_LOCAL and DEFINE_REG (gpt) (#16673)
* remove define_local and define_reg (gpt)

* fix precommit

* cleanups

* regalloc fix

* cleanups 2
2026-06-19 10:07:50 -07:00
wozeparrotandGitHub 05249466ed llama: fused quantize mxfp8 (#16667) 2026-06-18 16:02:28 -07:00
George HotzandGitHub 4a4b6956df remove DEFINE_VAR from codebase (gpt) (#16666)
* remove DEFINE_VAR from codebase

* junk

* remove junk
2026-06-18 15:33:50 -07:00
nimlgenandGitHub eda0a402d1 hcq2: fix multi (#16661) 2026-06-18 22:56:49 +03:00
wozeparrotandGitHub d37248c3ec gemm: fix mxfp8 on odd shapes (#16664) 2026-06-18 12:03:59 -07:00
wozeparrotandGitHub bed0c343a3 faster mxfp8 gemm (#16656) 2026-06-17 22:35:36 -07:00
George HotzandGitHub aef85ddc4d addrspace special/range (#16647)
* addrspace special/range

* just include indexing

* define var is alu

* bring old ignore indexing back

* mults to fix

* fixes

* ALU

* fixes
2026-06-17 15:57:37 -07:00
nimlgenandGitHub 0f0c622086 hcq2: multi folders (#16642) 2026-06-17 15:20:25 +03:00
wozeparrotandGitHub 36f6d1b064 gemm: fix bf16 atb for mp sharding (#16637) 2026-06-16 15:58:47 -07:00
nimlgenandGitHub 5644605d92 hcq2: pack bufs (#16635)
* hcq2: pack bufs

* x
2026-06-16 18:58:16 +03:00
nimlgenandGitHub 4a0488ae97 hcq2: optims (#16624)
* hcq2: optims

* x
2026-06-15 23:58:28 +03:00
qazalandGitHub f998b9930a fp8 gemm inv_scale in epilogue (#16625)
* fuse scale

* remove python inv_scale

* more inv_scale removal

* more cleanups

* cleaner

* diff polish

* work

* rename

* simpler

* simpler

* compute

* c

* Revert "c"

This reverts commit 8941fec7ca.

* Revert "compute"

This reverts commit 9db573a6d3.

* Revert "simpler"

This reverts commit 910ad33f87.

* Revert "simpler"

This reverts commit bf75d235a1.

* s_g

* update types

* less diff noise

* remove
2026-06-15 18:44:41 +09:00
nimlgenandGitHub 4dc51aff6e hcq2: jit (#16621)
* hcq2: jit

* x

* x

* minor
2026-06-15 06:35:35 +07:00
nimlgenandGitHub 5a9227b30a hcq2: rebind var params (#16610) 2026-06-13 14:55:52 +03:00
qazalandGitHub 2e77bd01db fp8 gemm cleanup (#16607) 2026-06-13 13:17:32 +09:00
sirhcmandGitHub bcdb988df0 split comma benchmark, dsp on c4 [PR] (#16598) 2026-06-12 23:26:05 -04:00
wozeparrotandGitHub 67a4f129c2 llama: fix bf16 gemm oob (#16603) 2026-06-12 19:43:05 -07:00
nimlgenandGitHub 2bfdf85f87 hcq2: move pre bufferize (#16589)
* hcq2: move pre bufferize

* x
2026-06-12 16:11:59 +03:00
qazalandGitHub 4d34590b7d llama: less E kernels (#16517) 2026-06-12 19:49:25 +09:00
qazalandGitHub 12f4cf0e49 rename amd/test_custom_kernel.py to test_asm_kernel (#16586)
* rename amd/test_custom_kernel.py to test_asm_kernel

* update
2026-06-12 16:11:01 +09:00
wozeparrotandGitHub e770805d21 llama: mxfp8 (#16574) 2026-06-11 22:15:24 -07:00
nimlgenandGitHub e5f498de3b hcq2: debug=2 info (#16569)
* hcq2: debug=2 info

* t

* x

* hcq2: debug=2 info

* x
2026-06-11 19:52:01 +03:00
wozeparrotandGitHub c38d6a7e3a mxfp8 part 2 (#16561) 2026-06-10 23:36:11 -07:00
George HotzandGitHub 7e6d617935 addrspace cleanups (#16565)
* addrspace cleanups

* bumps

* eh, relax a little
2026-06-10 15:57:18 -07:00
wozeparrotandGitHub 2bdc360606 gemm: mxfp8 hipkittens gemm (#16541)
* gemm: mxfp8 hipkittens gemm

* feat: update hipkittens

* feat: kernel signature

* clean: just kernel

* feat: from tinygrad

* feat: test

* fix: add back utils

* clean: no diff

* clean: no diff
2026-06-09 15:20:05 -07:00
nimlgenandGitHub 2ab2d51099 hcq2: fix repeated calls (#16552) 2026-06-09 19:11:42 +03:00
nimlgenandGitHub fa31c744b9 hcq2: cleaner (#16550) 2026-06-09 16:33:05 +03:00
wozeparrotandGitHub 5ef30005fa update hipkittens (#16544) 2026-06-08 18:53:25 -07:00
nimlgenandGitHub 95d63d6c07 hcq2: lower to ins (#16535)
* hcq2: lower to ins

* pm4

* f
2026-06-08 16:15:30 +03:00
nimlgenandGitHub 8baca185d5 hcq2: add kfd (#16537) 2026-06-08 13:48:27 +03:00
wozeparrotandGitHub a1ec32cfd2 llama: current grad scaling (#16518) 2026-06-05 15:39:41 -07:00
nimlgenandGitHub 5ebd44aa12 hcq2: merge queues (#16514)
* hcq2: mergw queues

* cleaner
2026-06-05 21:20:25 +03:00
qazalandGitHub 79a13310b3 viz: kernel_graph.txt unique is per schedule (#16511) 2026-06-05 16:17:28 +09:00
nimlgenandGitHub 3838c8df1b hcq2: move global sync (#16504) 2026-06-04 17:32:40 +03:00
chenyuandGitHub 0faaf6df26 remove kwargs from arange and linspace [PR] (#16505)
it used to have requires_grad and device, now both are removed
2026-06-04 10:32:37 -04:00
qazalandGitHub 3b1a5f9770 llama: a_bT and aT_b bf16 gemms (#16487)
* hk_bf16_gemm

* enable in 8b

* cleanups

* rename to USE_HK_BF16_GEMM

* work

* work

* work

* work

* change the gemms

* work

* work

* set as default

* work

* change
2026-06-04 23:30:21 +09:00
nimlgenandGitHub 11af81f96f hcq2: cleaner (#16502) 2026-06-04 15:26:37 +03:00
chenyuandGitHub 2c915c61ed no CONST(DEVICE) in torch_backend (#16499) 2026-06-04 00:26:47 -04:00
qazalandGitHub f7f03bd7e5 viz: better name for src id in kernel_graph.txt (#16495)
* viz: better name for src id in kernel_graph.txt

* better order

* cleanup
2026-06-04 11:09:29 +09:00
nimlgenandGitHub 6f2a2857c8 hcq2: refactor deps (#16490) 2026-06-03 23:20:24 +03:00
chenyuandGitHub 8a4203638a make full with buffer=False deviceless (#16483)
affects arange and eye
2026-06-03 12:35:59 -04:00
qazalandGitHub 405866f2b7 viz: improve kernel_graph.py usability (#16486)
* better default

* always format kernel output

* also show ref

* sched num
2026-06-03 21:12:44 +09:00
wozeparrotandGitHub 7dcfd144b6 llama: columnwise fp8 scaling (#16480) 2026-06-02 18:55:45 -07:00
George HotzandGitHub ffadd7a315 remove intel and amx support (#16482) 2026-06-02 18:53:05 -07:00
nimlgenandGitHub 99e37b1ee3 hcq2: deps (#16459)
* start

* sin

* f
2026-06-02 22:34:25 +03:00
qazalandGitHub 854eac09c6 llama: no E_ copy after bf16 GEMM (#16458) 2026-06-02 14:14:13 +09:00