geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
8,372 Commits 4 Branches 15 Tags
6306dea6e20cd070d82200b2ba5d72e352cd7f21
Commit Graph
3553 Commits
Author SHA1 Message Date
qazalandGitHub 8ddb1357c0 fix UPat.location after pickle (#9763) 
* fix UPat.location after pickle [pr]

* named upat test
 2025-04-07 15:16:42 +08:00
chenyuandGitHub b190d85ad7 benchmark script bert softmax (#9759) 2025-04-07 00:31:18 -04:00
Ignacio SicaandGitHub 58785181a8 AMD bf16xf32 TC (#9717) 
* dont test bf16 for emulated amd tc

* skip bf16 tc test in ci

* skip bf16 for AMD in test_tensor_cores_codegen

* add simple bf16 gemm test to benchmark
 2025-04-07 11:41:04 +08:00
chenyuandGitHub 43e4565148 weighted linear in external_benchmark_bert_matmuls (#9757) 
include the linear to get qkv, and permute so that stride matches with the real run
 2025-04-06 23:35:42 -04:00
chenyuandGitHub 8a585dc5c1 benchmark script for matmuls in bert (#9752) 
2 main matmuls in the bert layers. getting these to be fast makes bert fast
 2025-04-06 19:34:25 +08:00
nimlgenandGitHub 5f7c79676f jit: prune independent copies (#9749) 
* jit: prune independent copies

* linter

* check kernel cnt
 2025-04-05 20:50:28 +03:00
nimlgenandGitHub c2573b247c jit: rename optimize_weights -> replan_buffers_memory_layout (#9751) 2025-04-05 20:35:15 +03:00
chenyuandGitHub 407ca54382 symbolic fold double where (#9436) 
* symbolic fold double where

a.where(b.where(c, d), d) -> (a & b).where(c, d). a pattern in optimizer

* test case
 2025-04-05 05:12:17 -04:00
Sieds LyklesGitHubchenyu
 		9c2fc695b5 cond.logical_not().where(a,b) -> cond.where(b,a) (#9741) 
* Add rule for negation in where, simplifies arange patterns

* 0 becomes 0.0 again

* Only if cond is bool

* ne is never None

* Add a test

---------

Co-authored-by: chenyu <[email protected]>
 2025-04-04 19:13:32 -04:00
chenyuandGitHub fe998798fb linearizer failure test for OUT OF BOUNDS ACCESS (#9738) 2025-04-04 03:48:43 -04:00
George HotzandGitHub 8b5a523743 fix minimum length in pattern matcher (#9736) 2025-04-04 14:57:01 +08:00
George HotzandGitHub 926b0bcc57 cache folded upcast [pr] (#9733) 2025-04-04 11:23:19 +08:00
George HotzandGitHub cac8bcf8b5 use Ops.REDUCE (#9721) 
* decrease bert python time [pr]

* order copies

* Revert "order copies"

This reverts commit 3f62c8693b.

* rewrite count

* Ops.REDUCE

* acc first in the add chain

* Fix tensor core acc

* arange patterns look good

* fix multireduce gate

* reduce rewrite rule

* bump that to 15 minutes

* multiwmma isn't fusing

* gep through wmma is gep pushing

* bump that timeout too, it's all env setup

* add failing test
 2025-04-04 10:14:34 +08:00
nimlgenandGitHub 949459fdd6 jit: fix deallocate on unallocated buffers in free_intermediates (#9699) 2025-04-03 18:32:51 +03:00
geohotstanandGitHub ac713e04db ONNX add output shape validation (#9720) 
* add output shape validation and remove support for sequence_type

* nit better err msg

* add sequence_type back

* improve err msg

* Revert "improve err msg"

This reverts commit dc9eaea4bb.

* Revert "add sequence_type back"

This reverts commit 288170b2d9.

* do explicit shape equality

* small nit
 2025-04-03 05:44:53 -04:00
chenyuandGitHub 79145e3d40 cleanup truncate_bf16 [pr] (#9725) 
use torch bfloat16 for groundtruth in test. also a TODO for discrepancy
 2025-04-03 05:43:49 -04:00
Ignacio SicaandGitHub bc2d86195e increase test tolerance (#9719) 2025-04-03 15:24:09 +08:00
George HotzandGitHub 49dafe6d43 add gc tests [pr] (#9718) 
* add gc tests [pr]

* del

* more gc tests

* add NullGraph
 2025-04-03 14:08:32 +08:00
Ignacio SicaandGitHub bc91fffc5d fix gated store with index in python backend (#9703) 
* add default gate in index

* assert store

* add TestRendererFailures

- move test_gated_store_with_alu to new TestRenderFailures class for
tests that fail on multiple renderers
- add test_renderer_failures.py run on python CI

* add test for gated index in 2d

* test TestRenderFailures
 2025-04-03 12:48:28 +08:00
geohotstanandGitHub e1d7e47cca fix ONNX IsInf unintended dtype promotion (#9711) 
* add IsInf

* add corresponding test

* that float16 is kinda silly
 2025-04-02 22:46:15 -04:00
George HotzandGitHub 1714fc3ba4 start work on speed [pr] (#9707) 
* fix get_location

* fix get_location try 2

* clean up split_load_store [pr]

* SHR fixup [pr]
 2025-04-03 10:39:01 +08:00
geohot 0f1ffc2050 hotfix: cat tests 2048 instead of 256 2025-04-03 10:37:56 +08:00
Ignacio SicaandGitHub 2d6d8b7355 add bf16 mfma support (#9695) 
* add bf16 mfma support

* skip tc if emulated_amd and dtypes is bf16

* hotfix
 2025-04-02 21:44:49 +08:00
chenyuandGitHub 3b8d923692 remove skip LLVM in test_div_int (#9686) 2025-04-02 04:15:00 -04:00
George HotzGitHubIgnacio Sica
 		e78e8722dc Revert "LDS noop and spec (#9669)" (#9691) 
This reverts commit 870b545ace.

Co-authored-by: Ignacio Sica <[email protected]>
 2025-04-02 15:31:32 +08:00
chenyuandGitHub c20f112e9f example test use z3 to verify valid simplification (#9684) 2025-04-02 01:05:52 -04:00
chenyuandGitHub bca0c85193 skip CI CPU test_data_parallel_resnet_train_step (#9685) 
flaky
 2025-04-02 01:04:54 -04:00
qazalandGitHub bb94f13e58 add RECORD_TRACEBACKS=1 option to process replay (#9679) 
* add RECORD_TRACEBACKS=1 option to process replay

* stack
 2025-04-02 11:58:27 +08:00
chenyuandGitHub c672716b38 improve vmin/vmax for IDIV (#9678) 2025-04-01 23:16:01 -04:00
chenyuandGitHub 8dd88ad476 don't div_and_mod_folding for negative numerator with remainder (#9674) 
can be wrong in C div since it truncates towards zero
 2025-04-01 16:26:23 -04:00
chenyuandGitHub 0e34f9082e helper functions for cstyle div mod [pr] (#9673) 2025-04-01 08:06:56 -04:00
Ignacio SicaandGitHub 870b545ace LDS noop and spec (#9669) 
* init lds noop and lds_0 spec

* refactor lds helper test

* fix typo

* test all lds at the same time

* change comment

* comment

* start test_lds_full

* test_lds_tc

* add tc spec
 2025-04-01 18:44:55 +08:00
b1tgGitHubb1tg
 		d9af4cfc1b AMD_LLVM: tensor cores support (#9613) 
* tensor cores support

* test tesor cores codegen

* use rewrite rules

---------

Co-authored-by: b1tg <[email protected]>
 2025-04-01 09:56:27 +08:00
Ignacio SicaandGitHub 1444069c09 Uppercase K for dimension and lowercase k for kernel in linearizer tc helper test (#9649) 2025-03-31 19:05:36 +08:00
Ignacio SicaandGitHub baa67fd124 Uppercase N and M (standalone syntax change) (#9647) 2025-03-31 18:45:30 +08:00
Yvon ManziGitHubchenyu
 		6652003839 Add cumprod to Tensor (#9629) 
* probably how cumprod should look like

* update _cumalu to work with MUL

* shorter

* cumprod testing

* clean

* more cleanup

* add cumprod to torch backend.

* make it look like cumsum

* mypy fix

---------

Co-authored-by: chenyu <[email protected]>
 2025-03-30 21:49:18 -04:00
geohotstanGitHubchenyu
 		d52e91db7b ONNX ops clean ups (#9622) 
* combine work from remove numpy and onnx ops tests

* clippy

---------

Co-authored-by: chenyu <[email protected]>
 2025-03-30 21:39:22 -04:00
geohotstanGitHubchenyu
 		a08b07b4da Bump onnx==1.17.0 (#9618) 
* bump

* remove resize tf_crop_and_resize

---------

Co-authored-by: chenyu <[email protected]>
 2025-03-30 03:21:51 -04:00
nimlgenandGitHub 54e1e59b44 am: rdna 4 support (#9621) 
* hm

* fix

* return this

* fine

* g

* ruff

* fix
 2025-03-29 23:16:27 +07:00
nimlgenandGitHub 118bd1cbed hotfix: amd imports (#9620) 2025-03-29 20:19:53 +07:00
uuuvnandGitHub dd9aae02c3 Refactor ops_amd.py (MI300X prereq) (#9428) 2025-03-29 00:17:20 +07:00
nimlgenandGitHub fa0ebbd237 jit: optimize before pickle (#9611) 
* jit: optimize before pickle

* optimize weights

* fix

* mypy

* mypy2
 2025-03-28 19:06:09 +07:00
Andrew FureyandGitHub 50dee4a7b3 add test for checking const gradients (#9598) 2025-03-27 15:17:37 -04:00
chenyuandGitHub 5358b0904b update uop_given_valid if a node becomes const (#9604) 
* update uop_given_valid if a node becomes const

* cleanup
 2025-03-27 14:57:46 -04:00
qazalandGitHub bf94924d5a fix viz with nested graph_rewrite (#9595) 2025-03-27 13:14:28 +08:00
qazalandGitHub e5ff7b23d7 refactor to @track_matches + add failing test_nested_rewrite (#9592) 
* test_nested_rewrite

* refactor to track_matches

* positional arg
 2025-03-27 11:11:56 +08:00
nimlgenandGitHub dc9da1d917 memplan into one buffer (#9526) 
* new memplanner

* new should works

* fix

* VALIDATE_MEMORY_PLANNER

* hm?

* ugh

* fix alignment

* fix2

* rm

* tiny fixes

* test

* comments and fixes

* fix2

* liiiinetr

* t

* fix
 2025-03-27 01:46:50 +07:00
nimlgenandGitHub e88a640ca5 fix _access_resources for offset buffers (#9580) 
* fix _access_resources for offset buffers

* test
 2025-03-26 18:42:43 +07:00
George HotzandGitHub 9115ce8860 linearizer fixups from DSP branch (#9581) 2025-03-26 18:28:15 +08:00
nimlgenandGitHub ccbcdca473 add memplanner tests (#9577) 2025-03-26 10:59:39 +07:00