geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
5,326 Commits 4 Branches 15 Tags
ed1d784077cf46bbc981ce32e96b2cffb4cb4da5
Commit Graph
5326 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
nimlgenandGitHub ed1d784077 test profiler timer sync across devs (#5751) 
* test profiler timer sync across devs

* more correct

* typo
 2024-07-27 16:47:37 +03:00
qazalandGitHub e5fb08acbc simpler expand UOps acc [run_process_replay] (#5754) 2024-07-27 15:20:56 +03:00
gswanggGitHubqazal
 		de66d93859 PTX render vec CONST (#5729) 
* dedupe PTX vec CONST render

* fix linter errors

---------

Co-authored-by: qazal <[email protected]>
 2024-07-27 13:40:19 +03:00
qazalandGitHub 890e11ce11 fix UOps.STORE folding returning NOp [run_process_replay] (#5753) 2024-07-27 13:32:54 +03:00
qazalandGitHub 3e49d86c01 process replay diffs 3 things now (#5731) 
* github api infra

* process replay is 3 parts now

* parse benchmarks

* add gh_token

* complete diff

* move process replay tests

* last successful run

* add tempdir

* skip master
 2024-07-27 12:52:20 +03:00
qazalandGitHub 57b4a8e98d assert process replay asserts (#5737) 
* assert process replay asserts

* one ci job is fine

* test: Revert "separate process replay main loop (#5734)"

This reverts commit 94d578396f.

* mac sed needs that

* Revert "test: Revert "separate process replay main loop (#5734)""

This reverts commit e4ad7684d5.

* disable process replay capture

* save time

* amd is tiny

* send to /dev/null
 2024-07-27 12:07:50 +03:00
George HotzandGitHub f8972ace38 test flops (and allow wide ALU in UOps) [run_process_replay] (#5749) 
* flops test in external_test_speed_theoretical.py

* test speed theo

* min SZMAX

* allow wide ALU for things that support it

* needed for mypy
 2024-07-26 21:07:28 -07:00
geohot 2fde2d2914 hotfix: external_test_speed_theoretical works on 24GB 2024-07-26 18:41:52 -07:00
chenyuandGitHub b75d1e8793 UOp._min_max for IDIV (#5748) 2024-07-26 21:40:16 -04:00
geohot 829262a5ee add external_test_speed_theoretical 2024-07-26 17:45:22 -07:00
chenyuandGitHub 5f168e7499 remove the optimization in AndNode.substitute (#5747) 
was used in the old linearizer but longer needed. still need substitute because some fuzz tests calls sym_infer on AndNode
 2024-07-26 20:08:07 -04:00
kormannandGitHub c50e354936 NOp clean up any_len passing [run_process_replay] (#5743) 
* clean allow_any_len

* min
 2024-07-26 17:00:31 -07:00
George HotzandGitHub db1d093b29 reenable LLaMA-3 8B BEAM on NV (#5746) 2024-07-26 16:56:41 -07:00
chenyuandGitHub c6b2d96474 minor uop uopgraph cleanups (#5745) 2024-07-26 19:23:48 -04:00
chenyuandGitHub 3686b6726a move GraphException to jit.py (#5744) 
same place where GraphRunner is defined
 2024-07-26 19:01:12 -04:00
kormannandGitHub a5ede535ef NOp field name [run_process_replay] (#5742) 
* rm def name

* add field name
 2024-07-26 18:45:59 -04:00
chenyuandGitHub 0d7d4dd731 UOp._min_max for MUL and MOD (#5741) 2024-07-26 18:38:10 -04:00
George HotzandGitHub c50e374bb6 multiple locals + get_kernel_modifier + fix valid (#5739) 
* multiple locals + get_kernel_modifier + fix valid

* fix test pattern matcher
 2024-07-26 15:10:10 -07:00
nimlgenandGitHub f6c0e17a2c optimize symbolic-related updates in graphs (#5727) 
* try

* faster

* cleaner

* better?

* better?

* cleaner

* fixes

* unused

* mypy

* fix clang

* remove comment

* better var names

* rename

* fix cuda

* rename
 2024-07-27 00:57:59 +03:00
chenyuandGitHub dc7483ee6f UOp simple div folding (#5740) 
made UOp.divides return the Optional[quotient] and used it for simple div folding
 2024-07-26 17:14:32 -04:00
chenyuandGitHub 671259417f reuse UOp __repr__ for NOp (#5738) 2024-07-26 16:59:55 -04:00
kormannGitHubGeorge Hotz
 		b0c1dba299 named UOp class "NOP" [run_process_replay] (#5728) 
* NOP

* fix const + simplify compile

* rm VAR for NOOP

---------

Co-authored-by: George Hotz <[email protected]>
 2024-07-26 13:25:53 -07:00
George HotzandGitHub 4df46eac67 clean up tensor cores [run_process_replay] (#5736) 
* clean up tensor cores [run_process_replay]

* remove tuple(wmma_sz), self.opts.device

* remove tls, leave DEVICE
 2024-07-26 13:21:23 -07:00
qazalandGitHub 94d578396f separate process replay main loop (#5734) 
* separate process replay main loop

* [run_process_replay]

* add kernel_changed

* test with [run_process_replay]

* revert temp [run_process_replay]
 2024-07-26 21:43:08 +03:00
chenyuandGitHub 9838c1a6ff update import style in runtime (#5735) 2024-07-26 14:00:23 -04:00
chenyuandGitHub a4e9ebc68a update test_uop_symbolic (#5733) 
enabled more passed tests
 2024-07-26 13:46:09 -04:00
George HotzandGitHub 5c688560bc move CUDA/HIP compilers to their own files [run_process_replay] (#5732) 2024-07-26 10:00:15 -07:00
chenyuandGitHub 2cc55a3095 UOp simple mul add div fold (#5726) 2024-07-25 22:00:30 -04:00
chenyuandGitHub 78f75aa80d remove redundant symbolic mod rule [run_process_replay] (#5725) 2024-07-25 21:21:02 -04:00
chenyuandGitHub 5521b6d437 UOp simple mul-add-lt fold (#5721) 2024-07-25 20:49:38 -04:00
qazalandGitHub 1b53207b4f revert isolated dags scheduling (#5724) 2024-07-25 19:45:12 -04:00
chenyuandGitHub 845b0d1c9d UOp more generic div folding (#5722) 
old: `x // c` can fold if `0 <= x.vmin <= x.vmax < c`
new: `x // c` can fold if `0 < c and x.vmin // c == x.vmax // c`
 2024-07-25 17:49:14 -04:00
nimlgenandGitHub fb8148077e hcq do not update the same signal (#5719) 
* hcq do not update the same signal

* import them
 2024-07-26 00:24:45 +03:00
nimlgenandGitHub 6ec9ea9ddd hcq update_exec with optional params (#5708) 2024-07-26 00:04:57 +03:00
George HotzandGitHub 8b34ee2f52 remove global_size and local_size from Kernel class [run_process_replay] (#5720) 
* remove global_size and local_size from Kernel class [run_process_replay]

* sizes from the prg
 2024-07-25 13:55:08 -07:00
George HotzandGitHub 142b7fb22f faster beam [run_process_replay] (#5718) 2024-07-25 11:58:41 -07:00
chenyuandGitHub eff7c5fd2c halve kernel counts in metal Fuzz Test linearizer (#5716) 
the test time has increased to 3 minutes
 2024-07-25 14:35:11 -04:00
George HotzandGitHub e877ed9688 cleaner uop expand [run_process_replay] (#5715) 
* cleaner uop expand [run_process_replay]

* comments
 2024-07-25 11:29:53 -07:00
chenyuandGitHub a82815262c more test_pattern_matcher fixups (#5714) 2024-07-25 14:12:21 -04:00
geohot b8b5411845 move Function to Developer section of docs 2024-07-25 11:05:23 -07:00
qazalandGitHub f02124ffa0 rename to realize_reduceop (#5713) 
* rename to realize_reduceop

* shorter comment
 2024-07-25 20:57:33 +03:00
chenyuandGitHub 05e02ddfb3 fixup test_pattern_matcher (#5712) 2024-07-25 13:48:52 -04:00
qazalandGitHub 9ceb3a3d1f beautiful_mnist -4.3% kernels (#5709) 
* add is_complete

* partially delete forced_realized

* p2

* start

* refactor to can_group

* remove steps

* _get_inputs is nicer

* fix the cache

* cache is dict now

* rename to group
 2024-07-25 20:30:49 +03:00
kormannGitHubchenyu
 		92eefab4b0 method alu (#5711) 
Co-authored-by: chenyu <[email protected]>
 2024-07-25 13:25:38 -04:00
qazalandGitHub 76877df518 map groupable children (#5710) 
* map groupable children

* remove setitem
 2024-07-25 19:27:48 +03:00
kormannandGitHub 1e2eac755d Fix repr upat (#5705) 
* test

* fix

* x fix

* simpler

* rm extra space
 2024-07-25 12:05:48 -04:00
qazalandGitHub 1c992de257 hotfix: compare_schedule defaults to false (#5707) 2024-07-25 17:08:28 +03:00
qazalandGitHub 489cda827a more scheduler process replay tooling (#5706) 
* more scheduler process replay tooling

* refactor to compare_schedule
 2024-07-25 15:47:18 +03:00
qazalandGitHub 4e070a2c89 start work on indexing fusion (#5590) 
* start base

* the views add up

base reduceop st:
ShapeTracker(views=(View(shape=(60000, 1), strides=(1, 0), offset=0, mask=None, contiguous=True),))

top st:

ShapeTracker(views=(View(shape=(512, 6000, 1, 28, 28, 10), strides=(0, 1, 0, 0, 0, 6000), offset=0, mask=None, contiguous=False), View(shape=(512, 6000, 1, 28, 28, 10), strides=(47040000, 784, 0, 28, 1, 4704000), offset=0, mask=None, contiguous=False)))

merged buf.st+st:
ShapeTracker(views=(View(shape=(512, 6000, 1, 28, 28, 10), strides=(0, 1, 0, 0, 0, 6000), offset=0, mask=None, contiguous=False), View(shape=(512, 6000, 1, 28, 28, 10), strides=(47040000, 784, 0, 28, 1, 4704000), offset=0, mask=None, contiguous=False)))

* p1

* some cleanups

* more cleanups

* one kernel

* more

* late fuse arange

* less lines

* more work

* fix st strides 1

* update test_schedule, start argmax

* test_tiny_argmax

* add FUSE_ARANGE

* more cleanup

* add utils

* reduce merging

* fix axis and fold if needed

* more fusion

* need to figure this out

* now fixing all of these

* todos+save a line

* ready for p1
 2024-07-25 13:23:38 +03:00
nimlgenandGitHub 08f47d7dc3 more info on failure 41 (#5704) 2024-07-25 12:14:28 +03:00