sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 8 Activity
8,355 Commits 336 Branches 15 Tags
407ca543823f91ae720a940c4e96b502f2a1bdcd
Commit Graph
8355 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
chenyuandGitHub 407ca54382 symbolic fold double where (#9436) 
* symbolic fold double where

a.where(b.where(c, d), d) -> (a & b).where(c, d). a pattern in optimizer

* test case
 2025-04-05 05:12:17 -04:00
Sieds LyklesGitHubchenyu
 		9c2fc695b5 cond.logical_not().where(a,b) -> cond.where(b,a) (#9741) 
* Add rule for negation in where, simplifies arange patterns

* 0 becomes 0.0 again

* Only if cond is bool

* ne is never None

* Add a test

---------

Co-authored-by: chenyu <[email protected]>
 2025-04-04 19:13:32 -04:00
Sieds LyklesandGitHub e9a3ac02a5 Remove ne from arange pattern (#9743) 2025-04-04 18:31:13 -04:00
nimlgenandGitHub 86c55414d7 ops_amd: simplify gfx version (#9742) 
* ops_amd: simplify gfx version

* fix

* all vesrsion compact style

* mypy

* revert this

* rename back to target
 2025-04-04 22:18:11 +03:00
qazalandGitHub 16d6aa15f1 record unittest name in process replay (#9731) 
* record unittest name in process replay

* getitem

* filename + (optional) name

* del

* get_test_method

* not solved

* try with linecache

* test: print_loc

* format

* without linecache

* checkout master
 2025-04-05 01:39:48 +08:00
qazalandGitHub 354db961c6 viz refactor to prep for profiler [pr] (#9739) 2025-04-04 17:13:14 +08:00
chenyuandGitHub fe998798fb linearizer failure test for OUT OF BOUNDS ACCESS (#9738) 2025-04-04 03:48:43 -04:00
George HotzandGitHub 8b5a523743 fix minimum length in pattern matcher (#9736) 2025-04-04 14:57:01 +08:00
chenyuandGitHub 640ff681c3 rename bert script to 8xMI300X (#9734) 
and adds a script for single MI300X
 2025-04-03 23:36:24 -04:00
George HotzandGitHub b719aa1fb0 only check once for divisible fold lengths (#9732) 2025-04-04 11:27:34 +08:00
George HotzandGitHub 926b0bcc57 cache folded upcast [pr] (#9733) 2025-04-04 11:23:19 +08:00
George HotzandGitHub 8206c7281e move const multiply after REDUCE (#9730) 2025-04-04 11:07:46 +08:00
chenyuandGitHub 6b3480ec70 update mi300x bert haparams (#9716) 
* update mi300x bert haparams

borrowed from previous submission that also did BS=1024

* update
 2025-04-03 22:30:00 -04:00
George HotzandGitHub cac8bcf8b5 use Ops.REDUCE (#9721) 
* decrease bert python time [pr]

* order copies

* Revert "order copies"

This reverts commit 3f62c8693b.

* rewrite count

* Ops.REDUCE

* acc first in the add chain

* Fix tensor core acc

* arange patterns look good

* fix multireduce gate

* reduce rewrite rule

* bump that to 15 minutes

* multiwmma isn't fusing

* gep through wmma is gep pushing

* bump that timeout too, it's all env setup

* add failing test
 2025-04-04 10:14:34 +08:00
nimlgenandGitHub 949459fdd6 jit: fix deallocate on unallocated buffers in free_intermediates (#9699) 2025-04-03 18:32:51 +03:00
qazalandGitHub 52a8ecb15e record unittest location in process replay [pr] (#9727) 2025-04-03 20:50:09 +08:00
geohotstanandGitHub ac713e04db ONNX add output shape validation (#9720) 
* add output shape validation and remove support for sequence_type

* nit better err msg

* add sequence_type back

* improve err msg

* Revert "improve err msg"

This reverts commit dc9eaea4bb.

* Revert "add sequence_type back"

This reverts commit 288170b2d9.

* do explicit shape equality

* small nit
 2025-04-03 05:44:53 -04:00
chenyuandGitHub 7dadbf3697 insert float() in bert acc (#9726) 
sum of bool by default uses default_float for acc. So without float, it might overflow with a large BS and default_float=HALF.

fixed clsf_accuracy to not be inf in mi300x bert
 2025-04-03 05:44:09 -04:00
chenyuandGitHub 79145e3d40 cleanup truncate_bf16 [pr] (#9725) 
use torch bfloat16 for groundtruth in test. also a TODO for discrepancy
 2025-04-03 05:43:49 -04:00
Ignacio SicaandGitHub bc2d86195e increase test tolerance (#9719) 2025-04-03 15:24:09 +08:00
chenyuandGitHub 1d25844d44 Revert "disable CI red llama 3 4 gpu beam (#9690)" (#9709) 
This reverts commit 6a5eacba8b.
 2025-04-03 02:34:39 -04:00
George HotzandGitHub 49dafe6d43 add gc tests [pr] (#9718) 
* add gc tests [pr]

* del

* more gc tests

* add NullGraph
 2025-04-03 14:08:32 +08:00
Ignacio SicaandGitHub bc91fffc5d fix gated store with index in python backend (#9703) 
* add default gate in index

* assert store

* add TestRendererFailures

- move test_gated_store_with_alu to new TestRenderFailures class for
tests that fail on multiple renderers
- add test_renderer_failures.py run on python CI

* add test for gated index in 2d

* test TestRenderFailures
 2025-04-03 12:48:28 +08:00
qazalandGitHub f2bd65ccfc delete Ops.EMPTY and Tensor._metaop (#9715) 
* delete Ops.EMPTY and Tensor._metaop [pr]

* test_creation

* arg=

* abstractions2
 2025-04-03 12:29:02 +08:00
George HotzandGitHub 5c7b549eab use functools.cache instead of lru_cache(None) [pr] (#9714) 
* use functools.cache instead of lru_cache(None) [pr]

* more cache
 2025-04-03 11:47:13 +08:00
qazalandGitHub bbd13191f4 cleanup tensor BIND + remove outdated comments in tensor.py [pr] (#9712) 
* cleanup tensor BIND + remove outdated comments in tensor.py [pr]

* from_blob whitespace

* assert
 2025-04-03 11:21:53 +08:00
geohotstanandGitHub e1d7e47cca fix ONNX IsInf unintended dtype promotion (#9711) 
* add IsInf

* add corresponding test

* that float16 is kinda silly
 2025-04-02 22:46:15 -04:00
qazalandGitHub 11ae254dc5 construct BUFFER UOps directly when device in known [pr] (#9710) 
* construct BUFFER UOps directly when device in known [pr]

* diff
 2025-04-03 10:41:44 +08:00
George HotzandGitHub 1714fc3ba4 start work on speed [pr] (#9707) 
* fix get_location

* fix get_location try 2

* clean up split_load_store [pr]

* SHR fixup [pr]
 2025-04-03 10:39:01 +08:00
geohot 0f1ffc2050 hotfix: cat tests 2048 instead of 256 2025-04-03 10:37:56 +08:00
uuuvnandGitHub 5bd485c027 Fix double SDMA_OP_FENCE (#9705) 
Introduced in #9585, probably when i incorrectly resolved merge conflict
while rebasing an old, mi300x-only branch. Seems to be the source of
multi gpu beam llama hangs
 2025-04-03 09:43:37 +08:00
chenyuandGitHub a6fec2f5ae dev_run for bert on mi300x (#9706) 2025-04-02 21:12:55 -04:00
nimlgenandGitHub d96b4983ac amd: support rdna4 in runtime again (#9702) 2025-04-03 01:19:23 +07:00
Ignacio SicaandGitHub 2d6d8b7355 add bf16 mfma support (#9695) 
* add bf16 mfma support

* skip tc if emulated_amd and dtypes is bf16

* hotfix
 2025-04-02 21:44:49 +08:00
nimlgenandGitHub a6733f519f dsp: make relro sections contiguous (#9701) 2025-04-02 18:02:16 +07:00
George HotzandGitHub ea5caefef0 gep should look at count, not vcount (#9698) 
* gep should look at count, not vcount

* gep in order is a rule

* min change

* gep on void
 2025-04-02 18:10:57 +08:00
George HotzandGitHub f72a87fd0e add proper support for Ops.IGNORE to remove store masks (#9692) 
* add proper support for Ops.IGNORE to remove store masks

* remove useless NHWC

* revert that
 2025-04-02 16:38:01 +08:00
chenyuandGitHub 3b8d923692 remove skip LLVM in test_div_int (#9686) 2025-04-02 04:15:00 -04:00
chenyuandGitHub bc3bfcbad4 update install gpuocelot (#9693) 
`-DCMAKE_POLICY_VERSION_MINIMUM=3.5`
 2025-04-02 04:10:34 -04:00
George HotzGitHubIgnacio Sica
 		e78e8722dc Revert "LDS noop and spec (#9669)" (#9691) 
This reverts commit 870b545ace.

Co-authored-by: Ignacio Sica <[email protected]>
 2025-04-02 15:31:32 +08:00
George HotzandGitHub 4514fd91c1 more stuff from DSP (#9689) 
* more good stuff from dsp branch

* test pkl imagenet
 2025-04-02 15:27:48 +08:00
chenyuandGitHub 6a5eacba8b disable CI red llama 3 4 gpu beam (#9690) 
device hangs and ci would fail
 2025-04-02 03:19:09 -04:00
Ignacio SicaandGitHub 876a8be97a Debug env var breakdown (#9663) 
* add debug level breakdown

* hotfix

* Update env_vars.md
 2025-04-02 14:34:07 +08:00
George HotzandGitHub 6f812d3f2f fixes from the dsp branch + 12500 lines (#9683) 
* fixes from the dsp branch

* more changes

* those are gep pushing
 2025-04-02 13:07:17 +08:00
chenyuandGitHub c20f112e9f example test use z3 to verify valid simplification (#9684) 2025-04-02 01:05:52 -04:00
chenyuandGitHub bca0c85193 skip CI CPU test_data_parallel_resnet_train_step (#9685) 
flaky
 2025-04-02 01:04:54 -04:00
qazalandGitHub bb94f13e58 add RECORD_TRACEBACKS=1 option to process replay (#9679) 
* add RECORD_TRACEBACKS=1 option to process replay

* stack
 2025-04-02 11:58:27 +08:00
chenyuandGitHub 3acc1b928a minor div_and_mod_folding cleanup [pr] (#9681) 
it's not wrong because the dtype is never used, but `x.const_like` is more readable
 2025-04-01 23:51:36 -04:00
chenyuandGitHub c672716b38 improve vmin/vmax for IDIV (#9678) 2025-04-01 23:16:01 -04:00
chenyuandGitHub 8dd88ad476 don't div_and_mod_folding for negative numerator with remainder (#9674) 
can be wrong in C div since it truncates towards zero
 2025-04-01 16:26:23 -04:00