sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions Activity
11,106 Commits 336 Branches 15 Tags
python_speed
Commit Graph
256 Commits
Author SHA1 Message Date
George HotzandGitHub be8958e26b use CONTRACT before REDUCE (#5903) 
* use CONTRACT before REDUCE [run_process_replay]

* support half expand

* EXPAND GEP
 2024-08-04 16:17:33 -07:00
George HotzandGitHub 23e8c39288 get program fields in __post_init__ [run_process_replay] (#5878) 
* get program fields in __post_init__ [run_process_replay]

* remove print
 2024-08-02 09:57:12 -07:00
George HotzandGitHub 877e0b4ba0 define global only has the index [run_process_replay] (#5869) 
* define global only has the index [run_process_replay]

* fix that linearizer test

* fix ptx

* stupid ptx fix
 2024-08-01 19:01:15 -07:00
George HotzandGitHub d73bc85ba9 UOpGraph not in renderer or Program [run_process_replay] (#5867) 
* UOpGraph not in renderer or Program [run_process_replay]

* fix some tests

* fix ptx
 2024-08-01 16:20:30 -07:00
kormannandGitHub a5ede535ef NOp field name [run_process_replay] (#5742) 
* rm def name

* add field name
 2024-07-26 18:45:59 -04:00
chenyuandGitHub 671259417f reuse UOp __repr__ for NOp (#5738) 2024-07-26 16:59:55 -04:00
chenyuandGitHub 16c27ae400 update UOp.SPECIAL arg spec [run_process_replay] (#5661) 
* update UOp.SPECIAL arg spec [run_process_replay]

from `(0, "gid0", 4)` to just `("gid0", 4)`. closer to a Variable

* fix ptx
 2024-07-23 16:58:12 -04:00
qazalandGitHub 7cb67e6fb2 merge gated stores spec (#5652) 
* test_unmerged_ifs should merge ifs

* test_tiny_gate_store

* test_merge_ifs_alt

* assert assert asserts
 2024-07-23 18:53:27 +08:00
kormannandGitHub 2c4add6844 pretty print lazy op per default (#5505) 
* pretty lop

* min diff

* walrus

* fix

* min diff

* simplify

* pretty helper function

* ws

* pretty uop upat

* tests

* stricter tests

* test passes

* ws

* stronger upat test

* delete print_tree

* min diff

* stricter exp test

* fix merge

* stronger uops eval test

* +readable and deep upat test

* +readable and deep upat test

* sort inv fix

* fix

* revert allowed_len
 2024-07-18 09:34:08 -07:00
George HotzandGitHub d13654a820 move uopgraph to file [run_process_replay] (#5364) 
* move uopgraph to file [run_process_replay]

* fix print tree test
 2024-07-10 17:34:50 -07:00
George HotzandGitHub c13da83f12 tests from lowerer branch (#5339) 
* tests from lowerer branch

* Update test_image_dtype.py

* Update test_image_dtype.py

* Update test_image_dtype.py
 2024-07-08 21:23:19 -07:00
chenyuandGitHub a80f2df1bd fix some PTX tests (#5337) 
fix broken PTX tests in test_linearizer and test_uops. there are tests that were skipped and broken because it runs only with CUDA=1 and we run PTX with NV=1 now
 2024-07-08 21:33:05 -04:00
chenyuandGitHub 3929a9dc94 fix UOp.cmp_tuple for ALU (#5280) 
* fix UOp.cmp_tuple for ALU

for ALU, use self.arg instead of self.op to compare

* skip that?
 2024-07-03 14:59:05 -04:00
hiketteiandGitHub ad1ca7da64 [Feature] Added BinaryOps.AND/BinaryOps.OR (#5223) 
* [Feature] Added BinaryOps.AND/BinaryOps.OR

* Add: __rand__, __ror__
 2024-06-29 17:20:25 -07:00
Roelof van DijkGitHubchenyu
 		975b811ad9 names shadowing builtins (#5179) 
Co-authored-by: chenyu <[email protected]>
 2024-06-27 08:15:01 -04:00
George HotzandGitHub 6f6b3b10c9 import from uops, not linearizer (#5064) 2024-06-20 08:08:44 -07:00
kormannandGitHub fe332464d2 src->vin [run_process_replay] (#5036) 2024-06-18 22:23:49 +03:00
kormannandGitHub 7c3b877216 rename uop [run_process_replay] (#5031) 
* rename

* fix unittests

* rename vin

* fix test

* fix type [run_process_replay]

* rm pre commit hook change
 2024-06-18 21:34:05 +03:00
Junjun DongGitHubchenyu
 		c8cd6e725c Remove BinaryOps.SUB. Replace SUB by ADD and NEG in all tests. Regenerate dataset (#4977) 
* feat: remove BinaryOps.SUB

* remove SUB in test_early_end_local

* regenerate dataset. remove SUB in test_linearizer_*

* reenable overflow tests

* simplify tensor.sub function by returning a+(-b)

* remove whitespaces

---------

Co-authored-by: chenyu <[email protected]>
 2024-06-18 09:06:13 -04:00
uuuvnGitHubqazal
 		033fb53f9e Incomplete/buggy rule breaks process replay on #4976 (#4978) 
* Incomplete/buggy rule breaks process replay on #4976

* test passes

---------

Co-authored-by: qazal <[email protected]>
 2024-06-15 15:18:35 +03:00
qazalandGitHub d91f0ee85b add regression test for the neg folding pattern (#4979) 2024-06-15 15:08:28 +03:00
chenyuandGitHub 67e8df4969 remove numpy from dtype (#4969) 
replaced all dtype.np with _to_np_dtype defined in tensor.py.

after this, the only numpy usages are (1) Tensor(np.ndarray), (2) construct .numpy() output, (3) numpy random buffer
 2024-06-14 15:38:45 -04:00
George HotzandGitHub 63a8add2c2 move uops add logic to linearize (#4952) 
* move logic to linearize

* idk how this should work

* empty
 2024-06-14 03:52:37 -07:00
George HotzandGitHub 9823752397 make uops.add private (#4950) 
* make uops.add private

* modernize all tests
 2024-06-14 03:23:25 -07:00
Jhenner TigrerosGitHubGeorge Hotz
 		dc9e9e4363 Convert BinaryOps.DIV to UnaryOps.RECIP and BinaryOps.IDIV (#4887) 
* Create UnaryOps.RECIP and BinaryOps.IDIV and changing uses of BinaryOps.DIV

* Delete unused import

* Add cstyle renderer

* Fix formatting text

* Fix test error due to bad implementation of renderer

* Add PTX support

* Add RECIP to LLVMIR

* Remove BinaryOps.DIV from symbolic test

* Change some test and fix C floor division

* Change references to DIV for the RECIP or IDIV

* Add mimic idiv for symbolic test

* Restore floor

* Mimic idiv

* cast to int

* Fix some test and renderer

* Remove DIV for render nodes

* Resolve issue with div

* Add TestRenderer

* Fix test

* fix error

* Fix PAD test

* Fix div implementation

* Remove DIV

* Add upcast to rshift, due to use of MUL and RECIP on DIV

* Fix linter

* Remove complete BinaryOps.DIV

* Fix lint

* Fix some test

* Revert mul modification

* Fix tests

* Fix CLANG for uops

* Revert IDIV function

* Minor fix

* modify pattern matching rule to support nan

* Fix UNSAFE_PADS_OPS to add UnaryOps.RECIP

* Remove const folding for IDIV and fix PTX

* Complete remove IDIV from extra

* Remove test_div from TestFloatUOps due to test on recip

* Fix linearizer

* fix

* Fix test_22

* Fix llvm

* Apply trunc function for llvmlit

* use floor instead of trunc

* Use correct type

* Generate new fuzz db

* Fix rshift, do not cast to float to support idiv

* Return upcast=false to rshift

* Add to unsafepad BinaryOps.IDIV

* Remove RECIP override for CUDA

* add atol / rtol for the test

* Remove cast to int on IDIV

* Regenerate sops

* delete sops.gz

* regenerate

* regenerate

* regenerate

* Reduce margins

* pass atol and rtol as parametersg for _test_metrics

* regenerated dataset

* Regenerate

* Remove duplicated

* Revert changes on extra

* Remove changes extra and NOQA for test

* Remove E501

* Remove and change line

* Remove E501

* Fix atan2

* Revert import and E501

* Remove E501

* Add hrcp to halp ops

* Remove 1 of hrcp

* Remove last DIV and add type check on uops for IDIV

* Fix new tests

* Fix tests and custom function

* Regenerate dataset

* Regenerate dataset

* Revert dataset

* Change generate dataset script

* Remove line

* Change IDIV, type checker validate if x,y and z are int

---------

Co-authored-by: George Hotz <[email protected]>
 2024-06-14 02:43:46 -07:00
qazalandGitHub 1dde829e34 UOps.IF* to graph spec (#4894) 2024-06-09 07:00:12 -04:00
Szymon OżógandGitHub 273945df67 Regression tests for bitshift (#4829) 
* Regression tests for bitshift

* Add test for bitshift not triggered

* Enable tests
 2024-06-05 11:42:34 +02:00
chenyuandGitHub 3afc914617 CMPEQ -> CMPNE and make it safe to pad (#4818) 
* CMPNE

* new dataset
 2024-06-03 18:02:15 -04:00
Szymon OżógandGitHub bb7b031c5c Bitshift (#4728) 
* WIP

* Cleanup

* Cleanup

* Fix variable, refactor to use set

* right shift should be signed/unsigned

* Test for bitshifts

* Allow a neg
 2024-06-03 21:16:01 +02:00
qazalandGitHub 0e69b22629 multireduce OptOps tests (start) (#4733) 
* start

* full tests

* add skips

* unrelated

* notes
 2024-05-27 12:21:33 +03:00
qazalandGitHub c7b1d802f1 delete duplicate tests in test_linearizer (#4723) 
* delete duplicate test

test_simplify_uop isnt needed

max works

* ci

* remove skip

* add skip back
 2024-05-26 08:11:42 +03:00
George HotzandGitHub 07b350a8f4 new uops is an actual graph (#4560) 
* new uops is an actual graph

* it's way slower

* simpler

* fix define acc

* render_loop unique

* ops test pass

* add pattern matcher back, there's bugs

* rewrite

* use priority queue

* recursive children

* fix tests

* fix tests with SINK

* fix abstractions

* fix assembly

* simpler

* link define_acc

* fix DEFINE_ACC placement

* type verify

* full cmp

* fix cmp

* ACCESS_ACC

* insert DEFINE_ACC

* fix PHI

* recursive rewrite

* fix many tests

* sum collapse

* more patterns

* correct change

* fold arange

* fix that lin test

* space

* big folding rule works

* close

* has more maxes, meh

* cached node replace

* set changed

* simplest folding yet

* works

* works

* DIV

* all tests pass

* del

* fuzz linearizer fails

* sum_collapse

* test depth 2 cf

* fix lin test 14

* fix clang depth

* disable that

* failure 14 is fixed

* fix ptx

* failure 27 is fixed

* fix llama

* run_cnt

* Revert "Optimize PTX gated loads index calculation (#4304)"

This reverts commit d97d5a7689.

* fix uops loop

* fix ptx bugs

* add barrier

* print

* mem_type in ptx direct

* bypass tests that fail in CI but pass locally

* ptx remove ptr_ar

* more ptx passing

* fix ptx tests

* assert compile support

* remove  model inference benchmark from red
 2024-05-17 18:00:18 -07:00
Szymon OżógGitHubozchenyu
 		d97d5a7689 Optimize PTX gated loads index calculation (#4304) 
* WIP but working

* Cleanup

* Remove float4 pred and alt

* Cleanup

* this is somehow slowin it down

* Simplify

* add define var to ignore when optimizing gates

* Update assembly.py

* Test for optimizing gated loads

* Cleanup

* Fix NEG needed before if

* Remove unused parameters

* Update assembly.py

* Fix for cachable gone

---------

Co-authored-by: oz <[email protected]>
Co-authored-by: chenyu <[email protected]>
 2024-05-13 10:14:01 -07:00
George HotzandGitHub 02327b8adf simple stuff from new_uops branch (#4563) 2024-05-12 22:18:05 -07:00
George HotzandGitHub 2f970a4fc2 all realize 2 (#4527) 
* all realize 2

* tests fixup

* fix more tests

* fix openpilot

* fix tests

* unneeded
 2024-05-10 22:43:09 -07:00
George HotzandGitHub 347a3acb37 add renderer class (#4524) 
* add renderer class

* tests pass

* fix pylint

* fix tensor cores
 2024-05-10 21:40:02 -07:00
George HotzandGitHub 4eef1ee9bf move renderer into options (#4514) 
* move renderer into options

* fix tests

* renders are functions
 2024-05-10 10:01:51 -07:00
George HotzandGitHub c9e84ed0da refactor to Program class (#4476) 
* refactor to Program class

* switch to Program

* fix tests

* smaller diff

* self.p

* more tests

* fix metal test

* tests

* fix openpilot

* move that to linearizer

* p.launchdims
 2024-05-09 17:29:07 -07:00
George HotzandGitHub f635c4d273 fix define global (#4383) 
* fix define global

* remove name from DEFINE_GLOBAL

* fix fuzzing

* fix ptx

* fix python
 2024-05-01 22:32:56 -04:00
Szymon OżógandGitHub f1ebcffb87 Ptx beam fix (#4296) 
* Fix beam search for PTX

* fix ptr arm test
 2024-04-25 15:39:39 -04:00
George HotzandGitHub bbda20c0db CompiledASTRunner -> CompiledRunner (#4148) 2024-04-11 08:49:52 -07:00
Szymon OżógandGitHub ba118abfec improved caching for pointer arithmetics in ptx (#3922) 
* improved caching for pointer arithmetics

* Add test for pointer arithmetics caching

* Refactor test
 2024-04-04 07:33:48 -07:00
chenyuandGitHub fe03725b21 const fold cast unrealized_unpadded_const (#4047) 
* const fold unrealized_unpadded_const

changed the underlying arg directly

* CAST_BEFORE_VIEW folds some

* fix const index in getitem
 2024-04-03 12:31:24 -04:00
chenyuandGitHub 793ab0512e use ctypes to truncate float64 and float32 in uops (#3986) 
this fixed the softmax.argmax bug for ops_python as the float is truncated to float32
 2024-03-28 23:56:50 -04:00
chenyuandGitHub c4c243f79d update test_uops _equal to use assert_allclose (#3981) 
it handles nan
 2024-03-28 22:14:45 -04:00
chenyuandGitHub b47f6cebb2 LinearizerOptions -> CompilerOptions (#3978) 2024-03-28 17:50:23 -04:00
George HotzandGitHub 42b9d999ea Buffer isn't always allocated (#3974) 
* buffer alloc

* allocate

* missing allocates

* last one
 2024-03-28 13:33:47 -07:00
chenyuandGitHub 6c7df1445b enforce UOps.CONST arg has python type based on dtype (#3952) 
added an assert in uops, remove the cast in renderer
 2024-03-27 01:41:38 -04:00
George HotzandGitHub 68ca4d4276 split to schedule.py (#3949) 
* split to schedule.py

* split
 2024-03-26 21:02:46 -07:00
George HotzandGitHub 150ea2eb76 create engine folder and move code (#3948) 
* retry

* older tf

* that
 2024-03-26 20:38:03 -07:00