 George HotzandGitHub
|
57ae1bc7a7
|
rename MULTI to UNSHARD (#17267)
* rename MULTI to UNSHARD
* comment updates (glm)
* rename method to unshard
|
2026-07-28 16:51:41 -07:00 |
|
|
qazalandGitHub
|
abba2aebda
|
llama: correct fused qkv shape assert (#17086)
|
2026-07-20 15:51:21 +09:00 |
|
|
qazalandGitHub
|
939f28d571
|
fused qkv rope custom kernel (#17021)
* work
* fused qkv_norm
* work
* speed
* not that yet
* test cleanup
* just clone
* remove .realize()
* cleanup tests
|
2026-07-15 01:08:42 +09:00 |
|
|
qazalandGitHub
|
62ad646d1c
|
llama: gemm/fa backward speedups (gpt 5.6) (#17007)
* fp8 atb gemm speedup
* work
* revert
* fa bw faster
|
2026-07-14 00:27:00 +09:00 |
|
|
wozeparrotandGitHub
|
2971343a60
|
fa: support D=64 and attn sink (#16935)
|
2026-07-08 20:03:47 -07:00 |
|
|
chenyuandGitHub
|
3a9b87e48f
|
remove Ops.DEVICE from Ops.PROGRAM [PR] (#16797)
|
2026-06-29 17:41:31 -04:00 |
|
|
qazalandGitHub
|
4d34590b7d
|
llama: less E kernels (#16517)
|
2026-06-12 19:49:25 +09:00 |
|
|
wozeparrotandGitHub
|
528d35e306
|
llama speed 4 (#15993)
|
2026-04-30 17:14:41 -07:00 |
|
|
chenyuandGitHub
|
9192c93b7e
|
Tensor.invalid -> Tesnor.invalids (#15849)
matches ones and zeros, and to not share name with UOp.invalid
|
2026-04-21 11:19:51 -04:00 |
|
|
wozeparrotandGitHub
|
457508d5a0
|
llama: save more 2 (#15681)
|
2026-04-11 01:03:36 -07:00 |
|
|
645d45d968
|
DEV has arch (#15577)
Co-authored-by: Comma Device <[email protected]>
|
2026-04-03 19:17:19 -04:00 |
|
|
George HotzandGitHub
|
6e196195d8
|
add test for flat llama (#15327)
* add test for flat llama
* simpler
* back to split w1/w3
* env
* still too much ram
* invalid
|
2026-03-18 15:16:33 +08:00 |
|
|
wozeparrotandGitHub
|
be23772d43
|
llama3 fixes part2 (#15150)
|
2026-03-04 23:43:50 -08:00 |
|
|
wozeparrotandGitHub
|
4e9b85ecfd
|
fa: pull inputs out of call (#15127)
|
2026-03-04 03:15:49 -08:00 |
|
|
wozeparrotandGitHub
|
df23057984
|
fa: change bwd grid dim + unshuffle using mops (#15068)
|
2026-03-04 01:23:40 -08:00 |
|
|
wozeparrotandGitHub
|
25565b2410
|
fa: test for mp (#14907)
|
2026-02-22 21:47:36 -08:00 |
|
|
wozeparrotandGitHub
|
9317e96881
|
fa: explicitly pass shapes (#14857)
|
2026-02-19 05:26:16 -08:00 |
|
|
wozeparrotandGitHub
|
45aebe1572
|
hipkittens fa backward (#14723)
|
2026-02-16 00:38:44 -08:00 |
|
|
wozeparrotandGitHub
|
0613c0ac0c
|
hipkittens fa forward (#14692)
|
2026-02-12 20:16:43 -08:00 |
|