sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions Activity
5,326 Commits 336 Branches 15 Tags
ed1d784077cf46bbc981ce32e96b2cffb4cb4da5
Commit Graph
5326 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
nimlgenandGitHub ed1d784077 test profiler timer sync across devs (#5751) 
* test profiler timer sync across devs

* more correct

* typo
 2024-07-27 16:47:37 +03:00
qazalandGitHub e5fb08acbc simpler expand UOps acc [run_process_replay] (#5754) 2024-07-27 15:20:56 +03:00
gswanggGitHubqazal
 		de66d93859 PTX render vec CONST (#5729) 
* dedupe PTX vec CONST render

* fix linter errors

---------

Co-authored-by: qazal <[email protected]>
 2024-07-27 13:40:19 +03:00
qazalandGitHub 890e11ce11 fix UOps.STORE folding returning NOp [run_process_replay] (#5753) 2024-07-27 13:32:54 +03:00
qazalandGitHub 3e49d86c01 process replay diffs 3 things now (#5731) 
* github api infra

* process replay is 3 parts now

* parse benchmarks

* add gh_token

* complete diff

* move process replay tests

* last successful run

* add tempdir

* skip master
 2024-07-27 12:52:20 +03:00
qazalandGitHub 57b4a8e98d assert process replay asserts (#5737) 
* assert process replay asserts

* one ci job is fine

* test: Revert "separate process replay main loop (#5734)"

This reverts commit 94d578396f.

* mac sed needs that

* Revert "test: Revert "separate process replay main loop (#5734)""

This reverts commit e4ad7684d5.

* disable process replay capture

* save time

* amd is tiny

* send to /dev/null
 2024-07-27 12:07:50 +03:00
George HotzandGitHub f8972ace38 test flops (and allow wide ALU in UOps) [run_process_replay] (#5749) 
* flops test in external_test_speed_theoretical.py

* test speed theo

* min SZMAX

* allow wide ALU for things that support it

* needed for mypy
 2024-07-26 21:07:28 -07:00
geohot 2fde2d2914 hotfix: external_test_speed_theoretical works on 24GB 2024-07-26 18:41:52 -07:00
chenyuandGitHub b75d1e8793 UOp._min_max for IDIV (#5748) 2024-07-26 21:40:16 -04:00
geohot 829262a5ee add external_test_speed_theoretical 2024-07-26 17:45:22 -07:00
chenyuandGitHub 5f168e7499 remove the optimization in AndNode.substitute (#5747) 
was used in the old linearizer but longer needed. still need substitute because some fuzz tests calls sym_infer on AndNode
 2024-07-26 20:08:07 -04:00
kormannandGitHub c50e354936 NOp clean up any_len passing [run_process_replay] (#5743) 
* clean allow_any_len

* min
 2024-07-26 17:00:31 -07:00
George HotzandGitHub db1d093b29 reenable LLaMA-3 8B BEAM on NV (#5746) 2024-07-26 16:56:41 -07:00
chenyuandGitHub c6b2d96474 minor uop uopgraph cleanups (#5745) 2024-07-26 19:23:48 -04:00
chenyuandGitHub 3686b6726a move GraphException to jit.py (#5744) 
same place where GraphRunner is defined
 2024-07-26 19:01:12 -04:00
kormannandGitHub a5ede535ef NOp field name [run_process_replay] (#5742) 
* rm def name

* add field name
 2024-07-26 18:45:59 -04:00
chenyuandGitHub 0d7d4dd731 UOp._min_max for MUL and MOD (#5741) 2024-07-26 18:38:10 -04:00
George HotzandGitHub c50e374bb6 multiple locals + get_kernel_modifier + fix valid (#5739) 
* multiple locals + get_kernel_modifier + fix valid

* fix test pattern matcher
 2024-07-26 15:10:10 -07:00
nimlgenandGitHub f6c0e17a2c optimize symbolic-related updates in graphs (#5727) 
* try

* faster

* cleaner

* better?

* better?

* cleaner

* fixes

* unused

* mypy

* fix clang

* remove comment

* better var names

* rename

* fix cuda

* rename
 2024-07-27 00:57:59 +03:00
chenyuandGitHub dc7483ee6f UOp simple div folding (#5740) 
made UOp.divides return the Optional[quotient] and used it for simple div folding
 2024-07-26 17:14:32 -04:00
chenyuandGitHub 671259417f reuse UOp __repr__ for NOp (#5738) 2024-07-26 16:59:55 -04:00
kormannGitHubGeorge Hotz
 		b0c1dba299 named UOp class "NOP" [run_process_replay] (#5728) 
* NOP

* fix const + simplify compile

* rm VAR for NOOP

---------

Co-authored-by: George Hotz <[email protected]>
 2024-07-26 13:25:53 -07:00
George HotzandGitHub 4df46eac67 clean up tensor cores [run_process_replay] (#5736) 
* clean up tensor cores [run_process_replay]

* remove tuple(wmma_sz), self.opts.device

* remove tls, leave DEVICE
 2024-07-26 13:21:23 -07:00
qazalandGitHub 94d578396f separate process replay main loop (#5734) 
* separate process replay main loop

* [run_process_replay]

* add kernel_changed

* test with [run_process_replay]

* revert temp [run_process_replay]
 2024-07-26 21:43:08 +03:00
chenyuandGitHub 9838c1a6ff update import style in runtime (#5735) 2024-07-26 14:00:23 -04:00
chenyuandGitHub a4e9ebc68a update test_uop_symbolic (#5733) 
enabled more passed tests
 2024-07-26 13:46:09 -04:00
George HotzandGitHub 5c688560bc move CUDA/HIP compilers to their own files [run_process_replay] (#5732) 2024-07-26 10:00:15 -07:00
chenyuandGitHub 2cc55a3095 UOp simple mul add div fold (#5726) 2024-07-25 22:00:30 -04:00
chenyuandGitHub 78f75aa80d remove redundant symbolic mod rule [run_process_replay] (#5725) 2024-07-25 21:21:02 -04:00
chenyuandGitHub 5521b6d437 UOp simple mul-add-lt fold (#5721) 2024-07-25 20:49:38 -04:00
qazalandGitHub 1b53207b4f revert isolated dags scheduling (#5724) 2024-07-25 19:45:12 -04:00
chenyuandGitHub 845b0d1c9d UOp more generic div folding (#5722) 
old: `x // c` can fold if `0 <= x.vmin <= x.vmax < c`
new: `x // c` can fold if `0 < c and x.vmin // c == x.vmax // c`
 2024-07-25 17:49:14 -04:00
nimlgenandGitHub fb8148077e hcq do not update the same signal (#5719) 
* hcq do not update the same signal

* import them
 2024-07-26 00:24:45 +03:00
nimlgenandGitHub 6ec9ea9ddd hcq update_exec with optional params (#5708) 2024-07-26 00:04:57 +03:00
George HotzandGitHub 8b34ee2f52 remove global_size and local_size from Kernel class [run_process_replay] (#5720) 
* remove global_size and local_size from Kernel class [run_process_replay]

* sizes from the prg
 2024-07-25 13:55:08 -07:00
George HotzandGitHub 142b7fb22f faster beam [run_process_replay] (#5718) 2024-07-25 11:58:41 -07:00
chenyuandGitHub eff7c5fd2c halve kernel counts in metal Fuzz Test linearizer (#5716) 
the test time has increased to 3 minutes
 2024-07-25 14:35:11 -04:00
George HotzandGitHub e877ed9688 cleaner uop expand [run_process_replay] (#5715) 
* cleaner uop expand [run_process_replay]

* comments
 2024-07-25 11:29:53 -07:00
chenyuandGitHub a82815262c more test_pattern_matcher fixups (#5714) 2024-07-25 14:12:21 -04:00
geohot b8b5411845 move Function to Developer section of docs 2024-07-25 11:05:23 -07:00
qazalandGitHub f02124ffa0 rename to realize_reduceop (#5713) 
* rename to realize_reduceop

* shorter comment
 2024-07-25 20:57:33 +03:00
chenyuandGitHub 05e02ddfb3 fixup test_pattern_matcher (#5712) 2024-07-25 13:48:52 -04:00
qazalandGitHub 9ceb3a3d1f beautiful_mnist -4.3% kernels (#5709) 
* add is_complete

* partially delete forced_realized

* p2

* start

* refactor to can_group

* remove steps

* _get_inputs is nicer

* fix the cache

* cache is dict now

* rename to group
 2024-07-25 20:30:49 +03:00
kormannGitHubchenyu
 		92eefab4b0 method alu (#5711) 
Co-authored-by: chenyu <[email protected]>
 2024-07-25 13:25:38 -04:00
qazalandGitHub 76877df518 map groupable children (#5710) 
* map groupable children

* remove setitem
 2024-07-25 19:27:48 +03:00
kormannandGitHub 1e2eac755d Fix repr upat (#5705) 
* test

* fix

* x fix

* simpler

* rm extra space
 2024-07-25 12:05:48 -04:00
qazalandGitHub 1c992de257 hotfix: compare_schedule defaults to false (#5707) 2024-07-25 17:08:28 +03:00
qazalandGitHub 489cda827a more scheduler process replay tooling (#5706) 
* more scheduler process replay tooling

* refactor to compare_schedule
 2024-07-25 15:47:18 +03:00
qazalandGitHub 4e070a2c89 start work on indexing fusion (#5590) 
* start base

* the views add up

base reduceop st:
ShapeTracker(views=(View(shape=(60000, 1), strides=(1, 0), offset=0, mask=None, contiguous=True),))

top st:

ShapeTracker(views=(View(shape=(512, 6000, 1, 28, 28, 10), strides=(0, 1, 0, 0, 0, 6000), offset=0, mask=None, contiguous=False), View(shape=(512, 6000, 1, 28, 28, 10), strides=(47040000, 784, 0, 28, 1, 4704000), offset=0, mask=None, contiguous=False)))

merged buf.st+st:
ShapeTracker(views=(View(shape=(512, 6000, 1, 28, 28, 10), strides=(0, 1, 0, 0, 0, 6000), offset=0, mask=None, contiguous=False), View(shape=(512, 6000, 1, 28, 28, 10), strides=(47040000, 784, 0, 28, 1, 4704000), offset=0, mask=None, contiguous=False)))

* p1

* some cleanups

* more cleanups

* one kernel

* more

* late fuse arange

* less lines

* more work

* fix st strides 1

* update test_schedule, start argmax

* test_tiny_argmax

* add FUSE_ARANGE

* more cleanup

* add utils

* reduce merging

* fix axis and fold if needed

* more fusion

* need to figure this out

* now fixing all of these

* todos+save a line

* ready for p1
 2024-07-25 13:23:38 +03:00
nimlgenandGitHub 08f47d7dc3 more info on failure 41 (#5704) 2024-07-25 12:14:28 +03:00