nimlgen/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Activity
13,979 Commits 334 Branches 15 Tags
loop_end_op
Commit Graph
312 Commits
Author SHA1 Message Date
chenyuandGitHub 13ca9bd8a6 remove dtypes.index again (#17104) 
also reverted some dtype change, the split made things needlessly complicated
 2026-07-20 20:30:04 -04:00
qazalandGitHub 1cf8f2f68c llama: inplace amax update (#17064) 
* llama: inplace amax update

* remove amax_out return

* work

* fit

* work

* work

* keep

* diff cleanup
 2026-07-20 15:05:41 +09:00
chenyuandGitHub ac3f56a1a2 more shift tests (#17083) 2026-07-19 16:05:13 -04:00
chenyuandGitHub 89117d8b9e use real shift in l2i decomp [pr] (#17080) 
works for variable shift distace too, also fixed signed arithmetic fill
 2026-07-19 13:15:06 -04:00
chenyuandGitHub 9970a0aad0 fix Tensor << Tensor for x86 (#17082) 
* fix Tensor << Tensor for x86

* torch
 2026-07-19 12:31:05 -04:00
qazalandGitHub 7dd3422c63 llama: replace two stage amax with atomics (#17063) 
* atomic amax in c kernels

* quantize fp8 UOp kernel

* diff
 2026-07-17 19:27:10 +09:00
jk20342GitHubJacob Kitchen
 		810d8732f9 fix n^2 in limit_bufs by memoizing reachable loads [PR] (#17017) 
* fix n^2 in limit_bufs by memoizing reachable loads [pr]

* Update test_schedule.py

---------

Co-authored-by: Jacob Kitchen <[email protected]>
 2026-07-15 23:54:04 -07:00
nimlgenandGitHub 4257939e50 remove copyin/copyout from Buffer (#17020) 
* remove copyin/copyout from Buffer

* x

* x

* x

* x
 2026-07-14 19:47:22 +03:00
qazalandGitHub 939f28d571 fused qkv rope custom kernel (#17021) 
* work

* fused qkv_norm

* work

* speed

* not that yet

* test cleanup

* just clone

* remove .realize()

* cleanup tests
 2026-07-15 01:08:42 +09:00
chenyuandGitHub 82fbca43c5 fix Tensor(np) dtype and support fp8 safetensor (#17019) 2026-07-14 09:31:21 -04:00
chenyuandGitHub 872225e47d update dtype tests for small dtypes (#17016) 2026-07-14 08:07:00 -04:00
chenyuandGitHub 55bb251130 add pm_manual_bf16_cast to Metal [pr] (#17015) 
mitigate metal compiler bug for
`as_type<half>( (bfloat)(const) )`
 2026-07-13 21:53:47 -04:00
sirhcmandGitHub a9fbc7db7b expect _offset support, CL and WEBGPU are outliers (#17014) 2026-07-13 18:53:32 -04:00
chenyuandGitHub 9ce96c2628 fix subnormal in test_dtype (#17013) 
* fix subnormal in test_dtype

should fix flaky test/backend/test_dtype.py::TestFp8e4m3::test_casts_from

* better
 2026-07-13 18:53:13 -04:00
George HotzandGitHub 03ecad9486 full removal of dtype.vec (#16996) 
* full removal of dtype.vec

* fix typo
 2026-07-12 09:25:50 -07:00
qazalandGitHub cae6696d75 llama: split current and next amax state (#16993) 2026-07-12 18:52:33 +09:00
chenyuandGitHub 047a467bf9 delete UOp._stack and UOp.vectorize [PR] (#16988) 2026-07-11 15:26:55 -04:00
chenyuandGitHub 9d47014fd8 first class STACK [PR] (#16986) 2026-07-11 13:55:32 -04:00
George HotzandGitHub afeb5c708f x86 simplification (#16983) 
* simplify x86

* more extras

* simpler

* work

* fixes

* should pasS

* cmt-n

* delete more

* and more
 2026-07-11 08:11:05 -07:00
qazalandGitHub 75a4bfddc9 fp8 gemm tests including fused scales (#16980) 
* fp8 gemm tests matching fused scales

* work

* diff
 2026-07-11 12:33:21 +09:00
chenyuandGitHub df50e0814c explicit error for unbound Variable in program (#16971) 
also allow Tensor(UOp, dtype)
 2026-07-10 16:23:59 -04:00
chenyuandGitHub 2fda6b3888 fix shape broadcast for symbolic (#16970) 
* fix shape broadcast for symbolic

0 or smax was wrong for the unresolved case

* test with null
 2026-07-10 15:13:01 -04:00
chenyuandGitHub 3964eee64f failing tests for Tensor(Variable) (#16967) 2026-07-10 14:17:03 -04:00
qazalandGitHub bc3bf1988a asm gemm test cleanups try 2 (#16964) 
* fix hipcc requirement

* move hipcc

* fp8 in llama

* update some of those skips

* update dtype

* change
 2026-07-10 16:00:24 +09:00
chenyuandGitHub 78223d690a update SPECIAL spec (#16952) 
also updated tests with bad UOp
 2026-07-09 19:05:34 -04:00
George HotzandGitHub 95681f17ee remove extra dtypes from tests (#16954) 
* remove extra dtypes from tests

* a few more
 2026-07-09 14:59:56 -07:00
George HotzandGitHub 8d4c9d1058 make the upat compiler match the spec (glm) [PR] (#16948) 
* make the upat compiler match the spec

* cleanups

* CUSTOMI/CUSTOM

* fix that test

* pyliteral

* fix variable shadowing
 2026-07-09 12:30:39 -07:00
chenyuandGitHub ba2c68b1ed start dtypes.index [PR] (#16949) 2026-07-09 15:12:23 -04:00
chenyuandGitHub 8085bd57ec remove old stale metadata codes [pr] (#16936) 2026-07-08 17:11:15 -04:00
George HotzandGitHub fdffc6c0c8 remove dtypes base (#16931) 
* remove dtypes base

* find/replace bug

* vcount is junk too
 2026-07-08 11:48:11 -07:00
chenyuandGitHub c43a3fdebb bitcast to mixin [PR] (#16924) 2026-07-07 20:03:29 -04:00
George HotzandGitHub 0035bb6fa8 only front reduce (#16901) 
* only front reduce

* lint + spec

* that should fail

* meh
 2026-07-07 09:55:07 -07:00
Ben WaldronandGitHub 357b7544d6 Allow non-const alt values for wgsl gated load (#16885) 
* Allow non-const alt values for wgsl gated load

* Add regression test

* Make z3 happy

* Change to int to match nearby test + re-run CI

* Remove ptr
 2026-07-07 08:18:02 -07:00
George HotzandGitHub 40d112d4d6 remove ptr=True from index (#16898) 2026-07-06 18:34:18 -07:00
George HotzandGitHub 6b8b2f5aeb remove PtrDtype from tests (#16896) 
* remove PtrDtype from tests

* fixes

* not needed

* no -1
 2026-07-06 18:22:22 -07:00
George HotzandGitHub 4faed79216 remove placeholder from is_ptr (#16893) 
* remove placeholder from is_ptr

* simpler

* needed

* remove rewriter

* fix tests
 2026-07-06 16:55:56 -07:00
sirhcmandGitHub deb5232413 skip test_index_fused_out_of_bounds if CL (#16888) 2026-07-06 13:53:58 -04:00
chenyuandGitHub a398b678cd skip test_index_fused_out_of_bounds (#16877) 
reads OOB now
 2026-07-05 09:30:37 -04:00
George HotzandGitHub a145fdce4b remove the .gep method (#16867) 2026-07-04 14:07:09 -07:00
wozeparrotandGitHub 971800b46a support none block divisible embed size (#16865) 2026-07-04 13:46:47 -07:00
George HotzandGitHub c7e7687bd3 new codegen, try 3 (#16781) 
* new codegen, try 3 [pr]

* reduce

* diffs from cg2

* minor fixes

* mergable

* new local buffers

* fixes

* correct fix

* add barrier, and image is after that

* fix get

* wmma work

* devec wmma

* fixes for wmma

* slightly more flexible

* fix tensor cores

* fix linter

* tests

* remove invalid?

* remove extra

* wmma merge

* flip reshape/permute on wmma

* broadcast_binary None

* update symbolic for vecless

* x86 fix

* fix custom llama kernel

* is_ptr hack

* fix pre-commit

* fix wmma

* simpler

* fixes

* better hreduce

* move reduce axes

* all wmma tests pass

* allow stacked wmma

* permute cleanups

* late permute

* correct permute flip

* fix group for reduce

* fix wmma permuted

* all pass

* mop cleanup

* new test

* push permute/reshape

* revert that

* half
 2026-07-04 12:55:44 -07:00
qazalandGitHub 07f7383d29 llama: remove unused bf16 assembly gemm (#16859) 
* only hk bf16 gemm

* rm asm gemm

* more cleanup

* half isn't supported in asm gemm anymore

* more test edits

* unused

* remove TestMagicGu

* uop gemm is still tested

* minimal diff
 2026-07-04 18:41:54 +09:00
sirhcmandGitHub 353d8f1e13 use rusticl in ci (#16852) 2026-07-03 23:58:58 -04:00
George HotzandGitHub 41d6731bfd reduce removes ones (#16847) 
* reduce removes ones

* test changes

* lil clean
 2026-07-03 13:10:08 -07:00
chenyuandGitHub 5fb3cfb9bc remove early THREEFRY const folding [PR] (#16850) 
it folds automatically once decomposed
 2026-07-03 15:00:35 -04:00
chenyuandGitHub 59c7874724 fix isclose with scalar other (#16813) 2026-06-30 21:56:33 -04:00
George HotzandGitHub b683ff9836 test updates + addrspace work from new codegen (#16800) 2026-06-29 19:12:10 -07:00
chenyuandGitHub 3a9b87e48f remove Ops.DEVICE from Ops.PROGRAM [PR] (#16797) 2026-06-29 17:41:31 -04:00
qazalandGitHub 905b405820 fix contiguous_view_offset for scalar index (#16789) 
* simple failing test

* scalar passes
 2026-06-29 12:50:21 +09:00
chenyuandGitHub 5d1867a6c3 more Tensor.training -> TRAINING [PR] (#16770) 
code and test and doc
 2026-06-26 20:11:59 -04:00