sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions Activity
6,422 Commits 336 Branches 15 Tags
5551cf668975beb0b6f1484c19fa4e104ba82299
Commit Graph
6422 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
ignaciosicaandGitHub 5551cf6689 add rlshift and rrshift special methods (#7185) 2024-10-21 08:37:02 -04:00
qazalandGitHub 8f375b71c5 post-schedule lazybuf from Buffer [pr] (#7170) 2024-10-21 15:11:32 +03:00
qazalandGitHub 7a9f3dea54 assert a schedule double realize (#7178) 
* assert this

* maybe use lazycache

* Revert "maybe use lazycache"

This reverts commit 7368102906.

* set enable_cache=True

* assert 1 schedule
 2024-10-21 14:16:21 +03:00
geohot 31fcccc779 hotfix: flip if order 2024-10-21 17:34:23 +08:00
qazalandGitHub 6c0c3aff14 keep srcs in all ops (#7175) 2024-10-21 12:34:02 +03:00
George HotzandGitHub be1806df47 fast sym infer [pr] (#7177) 
* fast sym infer [pr]

* fix pylint
 2024-10-21 17:31:32 +08:00
geohot 4af228e9fc hotfix: pin mypy 2024-10-21 16:22:24 +08:00
leopfGitHubGeorge Hotz
 		b6d9b276bb GGUF support (#7046) 
* basic loader, untested

* testing

* remove utils import in test

* q8_0

* q4_1

* end to end testing

* minor cleanup

* fix casting

* moved to state

* move tests

* move dequant to fn

* fix lint elif

* remove gguf from extra

* fix dict union

* q6_k simpler

* naming and spacing

* gpt2-gguf example

* cleanup

* move gguf example

* minor cleanup

---------

Co-authored-by: George Hotz <[email protected]>
 2024-10-21 16:15:34 +08:00
geohot 17e7d8f10e hotfix: fix sz on windows 2024-10-21 16:02:23 +08:00
ignaciosicaGitHubGeorge Hotz
 		87a1e76745 Refactor hip_bfloat16 cast into uop (#7143) 
* refactor hip_bfloat16 cast into uops

* hotfix: linter issue

* hotfix: comment decorator in test

---------

Co-authored-by: George Hotz <[email protected]>
 2024-10-21 15:17:14 +08:00
qazalandGitHub 8074c0ec8f skip test_bfloat16_unary on AMD (#7169) 2024-10-21 01:00:47 +03:00
qazalandGitHub 713461129b scheduler ast rewrite reorders from big graph [pr] (#7168) 
* scheduler ast rewrite reorders from big graph [pr]

* update test_uops.py
 2024-10-21 00:47:58 +03:00
nimlgenandGitHub 81349213c0 nv min regs count is 16 (#7166) 2024-10-20 20:03:55 +03:00
qazalandGitHub 1383df95af track_rewrites by function call [pr] (#7165) 
* named track_rewrites [pr]

* group all of create_schedule_with_vars
 2024-10-20 17:45:25 +03:00
chenyuandGitHub a9ab7db054 don't raise ValueError in uop_given_valid [pr] (#7163) 2024-10-19 20:05:04 -04:00
chenyuandGitHub 98de58260b simplify valid itself (#7112) 2024-10-19 19:39:25 -04:00
chenyuandGitHub f511ad9103 No pyint again (#7156) 
* Revert "bring back pyint (#7150)"

This reverts commit 37e83ca6fc.

* remove truncate in const folding

* truncate_output=False
 2024-10-19 13:48:59 -04:00
qazalandGitHub 30989fb459 changes from the big graph branch [pr] (#7160) 
* metaops srcs

* delete multioutput ctx var

* always has metadata

* shorter path for realized

* this still needs inputs

This reverts commit a59cbb2886.
 2024-10-19 16:22:37 +03:00
chenyuandGitHub 11beb67400 fix import of truncate (#7157) 
truncate was moved to dtype
 2024-10-18 18:41:41 -04:00
nimlgenandGitHub 54c6a317f8 test_failure_54 (#7155) 
* test_failure_54

* metal
 2024-10-18 23:31:18 +03:00
nimlgenandGitHub 99fb115791 cuda correct pointer type (#7153) 2024-10-18 22:39:59 +03:00
chenyuandGitHub 37e83ca6fc bring back pyint (#7150) 
fixed test_failure_52 and resnet. need to understand this better
 2024-10-18 14:54:37 -04:00
Jacky LeeandGitHub c8b59416d0 fix: find_library can be None (#7145) 2024-10-18 20:50:52 +03:00
George HotzGitHubchenyu
 		b0a13896d7 PtrDType is dataclass [pr] (#7125) 
* PtrDType is dataclass [pr]

* new dataset

---------

Co-authored-by: chenyu <[email protected]>
 2024-10-18 09:40:33 -04:00
chenyuandGitHub ea016b55d1 don't throw in fuzz_linearizer (#7148) 
already broken on master and needs fix. don't throw to not block other pr
 2024-10-18 09:28:30 -04:00
chenyuandGitHub ea2efbf508 Add Opt(op=OptOps.LOCAL, axis=6, amt=2) to actions (#7147) 
* Add Opt(op=OptOps.LOCAL, axis=6, amt=2) to actions

it's missing if we rebuild all kernels, not just the first 2k.

```
PYTHONPATH="." GPU=1 python3 extra/optimization/get_action_space.py
 29%|█████████████████████████████████████▋                                                                                            | 3682/12701 [01:42<04:11, 35.83it/s]Traceback (most recent call last):
  File "/Users/chenyu/code/tinygrad/extra/optimization/get_action_space.py", line 27, in <module>
    test_rebuild(lin)
  File "/Users/chenyu/code/tinygrad/extra/optimization/get_action_space.py", line 11, in test_rebuild
    assert o in actions, f"{o} is not in actions"
           ^^^^^^^^^^^^
AssertionError: Opt(op=OptOps.LOCAL, axis=6, amt=2) is not in actions
```

* break
 2024-10-18 09:03:24 -04:00
qazalandGitHub 4cf7cca91a delete fuzz_schedule [pr] (#7144) 2024-10-18 15:09:39 +03:00
Bhavya GadaandGitHub b7b2017cb9 only ignore warnings not errors (#7146) 2024-10-18 07:41:11 -04:00
ignaciosicaandGitHub 8bcdd7c97d Refactor AMD pm rules to remove handwritten bf16 bool alus (#7136) 
* refactor pm rules

- remove unused handwritten methods
- refactor amd pm rules to fix bug with bool alu

* add bf16 bool alu tests

* add bf16 tests

* hotfix: make atol consistent
 2024-10-18 09:00:46 +08:00
Bhavya GadaandGitHub 534597e753 fix all test warnings (#7024) 
* fix pytorch warning in nn.conv2d for same padding

* fix future warning in torch load

* fix overflow warning in tensor list test: https://github.com/numpy/numpy/issues/23606#issuecomment-1512752172

* fix floating point warnings in dtype tests using docs https://numpy.org/doc/stable/reference/generated/numpy.errstate.html and a neat solution https://stackoverflow.com/questions/53634965/change-np-seterr-behavior-inside-a-function-only

* put err state in one place; comment taken care of by function hover

* enter np errstate context manager on test setup

* put decorator on class
 2024-10-18 08:56:40 +08:00
chenyuandGitHub 0cd4b93441 remove CStyleLanguage from test_uop_symbolic (#7142) 2024-10-17 19:39:34 -04:00
chenyuandGitHub 72ed66205d enable test_resnet_half (#7141) 
already worked so just fixed the test
 2024-10-17 19:02:20 -04:00
nimlgenandGitHub 211d9753f8 nv more lc checks (#7139) 
* nv more lc checks

* revert

* linter
 2024-10-18 00:21:53 +03:00
chenyuandGitHub 12ff52b88b test_failure_52 fails on real METAL (#7138) 2024-10-17 15:37:28 -04:00
chenyuandGitHub 84e98900e8 test linearizer failure 53 (#7137) 
variable scope issue caused compile error
 2024-10-17 15:23:43 -04:00
qazalandGitHub a64e5d0430 graph rewrite all metaops (#7134) 2024-10-17 18:49:20 +03:00
nimlgenandGitHub 45db7d9045 fuzz qcom vs opencl (#7130) 
* fuzz qcom vs opencl

* fix nv

* bettre?

* typo

* open both devs
 2024-10-17 18:49:08 +03:00
qazalandGitHub 188eef959d early rewrite UOps.CONTIGUOUS (#7132) 
* early rewrite UOps.CONTIGUOUS

* add metaops too

* just the contig diff
 2024-10-17 18:35:19 +03:00
chenyuandGitHub 287a198c4f increase test_strongly_connected_DAG threshold (#7131) 
flaky
 2024-10-17 11:08:50 -04:00
George HotzandGitHub c23ef7e2f8 real_remove_const (#7128) 2024-10-17 21:58:41 +08:00
qazalandGitHub 2087abc999 get membufs with dedup [pr] (#7127) 2024-10-17 16:06:06 +03:00
George HotzandGitHub be9a433a60 fix a bug in flops counting + touchups [pr] (#7126) 2024-10-17 21:02:11 +08:00
qazalandGitHub a2eefa6f97 move assign st override to upat (#7122) 
* move assign st override to upat

* merge view
 2024-10-17 13:33:37 +03:00
George HotzandGitHub ded1b38b84 minor dtype cleanup [pr] (#7124) 
* minor dtype cleanup [pr]

* use ptr() function
 2024-10-17 17:41:23 +08:00
George HotzandGitHub 0b2621f63f improve render_dtype [pr] (#7117) 
* improve render_dtype [pr]

* don't deref in index
 2024-10-17 14:50:40 +08:00
George HotzandGitHub ca0dca35f7 move ptx renderer [pr] (#7118) 2024-10-17 14:50:32 +08:00
George HotzandGitHub d990a16326 fix tests to use render (#7116) 2024-10-17 14:35:22 +08:00
geohot 9f4ca88218 hotfix: relax target pct for beautiful_mnist 2024-10-17 12:36:07 +08:00
chenyuandGitHub 51cd0e7c0d idx_given_valid -> uop_given_valid [pr] (#7110) 
will reuse this to simplify valid independent of idx
 2024-10-16 18:16:36 -04:00
chenyuandGitHub 842fe444df test case for valid only simplification (#7108) 2024-10-16 16:40:46 -04:00