sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 8 Activity
8,242 Commits 336 Branches 15 Tags
264dd91b8a110f6e6ff80d390178cdf8fbf291c5
Commit Graph
8242 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
geohot 264dd91b8a 70 GFLOPS 2025-03-21 20:31:14 +08:00
geohot bdf716b915 mul work 2025-03-21 20:05:29 +08:00
geohot cf41c803d0 fast 13 2025-03-21 18:10:59 +08:00
geohot 3cf9224df5 a scale and b scale 2025-03-21 18:07:53 +08:00
geohot af94addb3a ish 2025-03-21 17:46:45 +08:00
geohot dc1469a188 double reduce 2025-03-21 17:33:48 +08:00
geohot 0416b0998d revert those 2025-03-21 17:15:38 +08:00
George HotzandGitHub c715c25420 Merge branch 'master' into dsp_search 2025-03-21 17:13:10 +08:00
George HotzandGitHub 8e555c586c switch quantization to unsigned/unsigned + add Ops.REDUCE (#9527) 
* switch quantization to unsigned/unsigned + add Ops.REDUCE

* tests

* nhwc + replay pkl
 2025-03-21 17:02:37 +08:00
geohot f66b03f0a6 dsp ish 2025-03-21 16:28:08 +08:00
geohot 2729a46ca6 don't do that 2025-03-21 16:04:21 +08:00
nimlgenandGitHub a35b0a88bf am: just rename and reorder ip init funcs (#9504) 2025-03-21 15:57:32 +08:00
nimlgenandGitHub 8a131ab271 am: allow allocations as small as a page (#9523) 
* am: fix allocs

* bettermsg

* comment

* next time
 2025-03-21 15:53:32 +08:00
geohot dbb50e4a00 knum 4 2025-03-21 15:48:50 +08:00
geohot 71c7c455a6 quantize 2025-03-21 14:55:29 +08:00
geohot ff3438be4e fast 2025-03-21 13:04:18 +08:00
geohot bc5e23061b diasm 2025-03-21 11:22:40 +08:00
geohot 5ce951fb34 l2 2025-03-21 11:14:12 +08:00
George HotzandGitHub 4a49d05a3f Merge branch 'master' into dsp_search 2025-03-21 10:26:38 +08:00
geohot c3c85c64ee simpler 2025-03-21 09:24:33 +08:00
Sieds LyklesandGitHub 3ad3ac4d1e Change dtypes.int to dtypes.ints (#9517) 2025-03-20 17:24:26 -04:00
chenyuandGitHub b9fab9b914 pin ruff to 0.11.0 in CI (#9520) 
0.11.1 had a bug https://github.com/astral-sh/ruff/issues/16874 that breaks ci
 2025-03-20 13:12:50 -04:00
geohot 61c02ca634 cleanups 2025-03-20 23:27:06 +08:00
geohot 325044bcaf okay that should actually prefetch 2025-03-20 22:59:59 +08:00
geohot 91ac508878 prefetch 2025-03-20 22:56:38 +08:00
geohot 2ed30f5366 correct flops 2025-03-20 21:46:13 +08:00
geohot d0b9c7e7ca fast like nascar? 2025-03-20 21:27:26 +08:00
geohot f6ed8f4a27 8 folds 2025-03-20 21:20:46 +08:00
geohot 87718170d2 more generic 2025-03-20 21:14:33 +08:00
geohot b67af4049c knum 20 2025-03-20 20:59:06 +08:00
geohot 16e425a4c0 work 2025-03-20 20:24:21 +08:00
geohot c867a48ab4 custom 2025-03-20 20:02:35 +08:00
geohot 2dc82c0604 should be fast 2025-03-20 19:49:04 +08:00
geohot e7402e6643 KNUM=13 will be fast like roadrunner 2025-03-20 18:45:53 +08:00
geohot e5ccd9e846 work 2025-03-20 15:20:03 +08:00
geohot 624197f169 swizzle better 2025-03-20 12:41:24 +08:00
geohot d42350a401 simple test 2025-03-20 12:37:29 +08:00
George HotzGitHubqazal
 		3c5161b4cb add validation of the bounds of Ops.INDEX (#9503) 
* add validation of the bounds of Ops.INDEX

* do mask properly

* more validation

* correct

* fix gated

* add CAST support to vmin/vmax

* fix ptx and image

* ptx no diff

* upat.index also stays

---------

Co-authored-by: qazal <[email protected]>
 2025-03-20 12:15:55 +08:00
qazalandGitHub 0b20f91ce7 remove move_mask from the devectorizer (#9511) 
* remove move_mask from the devectorizer

* add (wrong) ptx

* reason

* enable index addition in PTX, we won't have the INDEX anyways

* space
 2025-03-20 11:53:12 +08:00
qazalandGitHub 9302738263 hotfix: more consistent wgsl.py spacing + cleanups [pr] (#9515) 
* hotfix: more consistent wgsl.py spacing + cleanups [pr]

* free things up
 2025-03-20 11:07:15 +08:00
George HotzandGitHub 223feb2118 Merge branch 'master' into dsp_search 2025-03-20 10:52:30 +08:00
George HotzGitHubComma Device
 		68053d0510 dsp stuff / sniff ioctls from snpe (#9490) 
* sniff ioctls from snpe

* dump input buffers

* snpe logs from dsp

* NHWC support

* knum 3

* this run?

* revert those

---------

Co-authored-by: Comma Device <[email protected]>
 2025-03-20 10:38:23 +08:00
qazalandGitHub 2223b93338 add UPat.or_casted [pr] (#9513) 2025-03-20 10:08:32 +08:00
qazalandGitHub 1839e8c9b3 place masks in INDEX for TestGatedStoreRewrite [pr] (#9512) 2025-03-20 09:46:53 +08:00
b1tgGitHubb1tg
 		bd731a8624 AMDCompiler refactor (no_comgr prereq) (#9497) 
* add amdgpu_disassemble to helpers

* refactor hip compiler

---------

Co-authored-by: b1tg <[email protected]>
 2025-03-20 09:44:07 +08:00
geohotstanandGitHub 8c0d0a122c Add return_indices to max_pool (#9506) 
* wow argmax is so good

* 1 less line

* clean up and better variable names

* is this torch thing right...?

* add more tests

* slap a TODO on it

* clean ups

* prettier looking code and fix ceil mode test

* add return types and some docs

* ok that was a bad example since indices == value, just no example
 2025-03-19 15:25:37 -04:00
chenyuandGitHub 189f62d44f add rounding to tqdm unit scale (#9507) 
fixed `AssertionError: ' 1.00/10.0  1000it/s]' != ' 1.00/10.0  1.00kit/s]'`
 2025-03-19 12:08:46 -04:00
nimlgenandGitHub a5c971ff3a am: prereqs for rdna4 1/n (#9495) 
* am: ip_ver rename for acc

* am: refactor this

* fix version

* ugh
 2025-03-19 17:14:57 +08:00
Francis LamandGitHub 1e5d9ad8f7 extra/gemm/max_matmul: start of custom kernels for GEMM (#6926) 
* extra/gemm/max_matmul: start of custom kernels for GEMM

* add an unoptimized FP16/FP16 MMA example

* add slow 3-stage fp16 acc example

* add correct 3-stage pipeline with unswizzled/flat smem input (slow)

* add acc fp16 example with 3 stages and swizzle (no bank conflicts)

* add max version of NV fp16_fp16_fp16

* fix up comments and removed unused code in max variations

* add start of no_xor example

* fix to account for UOps to Ops
 2025-03-19 15:04:57 +08:00
geohot 865f23dd7b olmoe memory usage cleanups 2025-03-19 12:28:18 +08:00