geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
6,851 Commits 4 Branches 15 Tags
v0.10.0
Commit Graph
6851 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
geohot 65f188aafb bump version to 0.10.0 v0.10.0 2024-11-19 08:27:28 +08:00
chenyuandGitHub 26200574dc load_state_dict test cases when model and data shard differently (#7774) 
current behavior is weird... when model is sharded and state_dict is not, load shards the state_dict and model shard axis does not change.
but if model and state_dict are sharded differently, model shard axis becomes the state_dict axis after load.

it should either always use model shard axis or always use state_dict shard
 2024-11-18 16:08:24 -05:00
Francis LataandGitHub a1c1b9547f Context manager support for tqdm (#7770) 
* add context manager support

* add test case for context manager usage
 2024-11-18 14:12:03 -05:00
geohotstanGitHubchenyu
 		8100109c9d Add replicate mode to Tensor.pad (#7608) 
* base implementation

* add tests

* actually remove the assertionerror test

* actually only have reflect for this pr

* change the 4 if-else one liner

* maybe use a lambda

* fix

* maybe a lil cleaner

* fix tests

* complete

* small change

---------

Co-authored-by: chenyu <[email protected]>
 2024-11-18 10:55:38 -05:00
qazalandGitHub 62db6398a5 delete buffer tracking from ScheduleContext [pr] (#7766) 2024-11-18 22:47:32 +08:00
ShuniandGitHub ed76d3ceac Fix AMD queue CWSR memory size (#7765) 
* Fix AMD queue CWSR memory size

* fix linter error

* add debug_memory_size field

* align CWSR save area allocation to page size
 2024-11-18 17:22:03 +03:00
ignaciosicaGitHubqazal
 		f02462c5cb swizzle tc [pr] (#7633) 
* swizzle tc draft

* further cleanup

* hotfix: remove typing from fix_st and cleanup

* hotfix: revert cache property (moved into separate pr)

* hotfix

* hotfix: rename

* take patterns from schedule

* hotfix: rename vars

* hotfix

* no more view of store

* hotfix: linter

* as view is only used for tc fix up and tc is only enabled for LOAD, remove valid an preload from pm rule

- also remove inner simplify in fix_st

* add typing to fix_st

---------

Co-authored-by: qazal <[email protected]>
 2024-11-18 21:08:21 +08:00
qazalandGitHub 6ea4a173e7 make is_realized a property [pr] (#7763) 
* make is_realized a property [pr]

* fix assign

* multi
 2024-11-18 19:15:37 +08:00
chenyuandGitHub 5de0ea40f3 reorder Tensor.__init__ to match type (#7758) 
and reordered check lazy devices part
 2024-11-17 21:32:48 -05:00
chenyuandGitHub 66d7d5af50 fix Tensor(MultiLazyBuffer) with different dtype should fail (#7757) 
similar to Tensor(LazyBuffer) as we don't cast implicitly
 2024-11-17 21:05:45 -05:00
chenyuandGitHub b1d734a02c remove the -1 then -(-1) in Tensor.argmax (#7753) 2024-11-17 16:54:09 -05:00
chenyuandGitHub e3081355fe minor Tensor.einsum cleanup (#7752) 
removed some dead conditions and add types. still reads more complicated than needed
 2024-11-17 16:11:30 -05:00
chenyuandGitHub 8b08a72657 consmetic change to Tensor._pool (#7751) 
aligned the shink lines
 2024-11-17 15:38:11 -05:00
chenyuandGitHub df817297b6 fix passing acc_dtype="" to Tensor.prod should fail (#7750) 
similar to sum
 2024-11-17 11:38:13 -05:00
chenyuandGitHub 55707fd00d fix passing sum_acc_dtype="" to Tensor.sum should fail (#7748) 2024-11-17 10:58:41 -05:00
chenyuandGitHub f18296e23c simpler Tensor._reduce (#7747) 2024-11-17 09:20:00 -05:00
qazalandGitHub 0cc8de2f15 reverse map buf_uops [pr] (#7743) 2024-11-17 21:29:56 +08:00
chenyuandGitHub 0292ae7508 Tensor.meshgrid cleanup (#7741) 2024-11-17 08:26:53 -05:00
qazalandGitHub 40642cb9ea to_uop split paths part 2 [pr] (#7746) 2024-11-17 21:07:28 +08:00
qazalandGitHub 99024b922b to_uop one path for all ops part 1 (#7745) 
* flat meta ops

* one path for everything

* add tests

* view is always base

* just run
 2024-11-17 20:12:44 +08:00
qazalandGitHub eeb222f98b add UOp.new_buffer [pr] (#7742) 2024-11-17 16:44:52 +08:00
chenyuandGitHub a15a900415 fix Tensor.meshgrid for 1D input and check indexing (#7740) 2024-11-16 23:39:30 -05:00
geohotstanGitHubchenyu
 		72a41095bc add Tensor.meshgrid (#7714) 
* initial implementation and test

* some other places that can use meshgrid

* revert the onnx_ops change

* add to docs

* revert interpolate too

* update

* improve edge case test

* might as well test grad

* add to test can improve docs

---------

Co-authored-by: chenyu <[email protected]>
 2024-11-16 23:06:47 -05:00
mesozoic-eggGitHubjudy
 		1a5e896bd4 [pr] Have PTX share code with LLVM (#7635) 
* integrate into ops_cuda

* remove debugging stuff

* lint fix

* mypy fixes

* swap ptx.py

* edit

* simplify wmma

* wip

* space

* refactor

* sync the ops removal changes

* refactor

* rename variables

---------

Co-authored-by: judy <[email protected]>
 2024-11-17 10:53:56 +08:00
chenyuandGitHub f2f7384b67 _resolve_dim cleanup (#7736) 
no duplicated self.ndim+outer
 2024-11-16 11:05:39 -05:00
chenyuandGitHub e777211a00 Tensor.repeat cleanup (#7735) 
flatten instead of double for loop comprehension
 2024-11-16 10:43:45 -05:00
chenyuandGitHub f1efd84c92 fix repeat_interleave with negative dim (#7734) 2024-11-16 10:15:29 -05:00
chenyuandGitHub e3105675fb cond.where(True, False) is cond (#7733) 2024-11-16 09:44:17 -05:00
qazalandGitHub 40ae0e9115 smaller big graph (#7695) 
* start

* work

* rewrite to PRELOAD

* st is always from base

* fix aesthetics

* work

* more work

* refactor to is_forced_realize

* uh

* green?

* metaop can be image

* dont count realized

* this is the new src

* test_tiny_add passes

* work
 2024-11-16 22:04:57 +08:00
qazalandGitHub f3f95ab9d9 flatten fusion upats [pr] (#7732) 2024-11-16 21:26:19 +08:00
qazalandGitHub ec8c5598f6 refactor to generic UPat for sourcing unrealized bufs [pr] (#7731) 
* base check

* use is_scheduled

* fixup lazy

* update metadata

* match is too slow
 2024-11-16 21:01:22 +08:00
ignaciosicaGitHubqazal
 		597a239e28 Remove UnaryOps, BinaryOps, TernaryOps, MetaOps [pr] (#7725) 
* remove unaryops

* remove ternaryops

* remove metaops

* hotfix

* remove binaryops

* hotfix: test_pattern_matcher

---------

Co-authored-by: qazal <[email protected]>
 2024-11-16 20:56:56 +08:00
chenyuandGitHub 22da31b223 clean up Tensor.dot (#7728) 
more docs (similar to numpy) and removed many confusing  `-min(n2, 2)`
 2024-11-15 18:21:15 -05:00
chenyuandGitHub 4338c450ac fix max_pool2d for int tensor with padding (#7726) 
padding inf messed output dtype
 2024-11-15 16:22:11 -05:00
chenyuandGitHub d736ae7153 example script to show BasicTransformerBlock speed regression (#7724) 2024-11-15 15:48:25 -05:00
chenyuandGitHub aeb1301bab enable a few tests that work now (#7721) 
should mark the ones that are expected to work with expectedFailure, and delete and ones that are not expected to work
 2024-11-15 14:30:52 -05:00
ignaciosicaandGitHub fc1e123138 minor cleanup in lazy.py (#7719) 2024-11-15 13:48:24 -05:00
qazalandGitHub ef4f402946 add property to flag contig buffer uop [pr] (#7716) 2024-11-15 22:27:47 +08:00
qazalandGitHub 313af6d23c assert buffer VIEW is void [pr] (#7715) 2024-11-15 22:02:59 +08:00
ignaciosicaandGitHub c37d142cf8 Refactor metal tc wmma kernel rendering (#7416) 
* refactor metal tc wmma kernel rendering

* hotfix: bug

* hotfix: hack to avoid backlash in f-string expression

* hotfix

* hotfix: rename vars

* hotfix: moew new_line

* hotfix: cleaner wmma rendering
 2024-11-15 21:23:08 +08:00
qazalandGitHub bddee26114 Ops.VALID cleanup, move recursive tests [pr] (#7713) 2024-11-15 20:22:46 +08:00
qazalandGitHub 703a255301 use the method_cache in test_schedule [pr] (#7712) 
* use the method_cache in test_schedule [pr]

* need half
 2024-11-15 19:20:47 +08:00
qazalandGitHub 88f760cc32 test_two_sum doesn't need del (#7711) 2024-11-15 18:50:08 +08:00
George HotzandGitHub 9f98f0c93a use disassemble method for objdump [pr] (#7708) 2024-11-15 12:55:37 +08:00
George HotzandGitHub 9b1605eef9 Revert "objdump intel syntax (#7605)" (#7707) 
This reverts commit 8f8e375f27.
 2024-11-15 12:13:04 +08:00
ttomsaandGitHub 8f8e375f27 objdump intel syntax (#7605) 
* objdump intel syntax

* test for objdump intel syntax

* add disassemble to ClangCompiler and LLVMCompiler. Use just llvm-objdump

* linter
 2024-11-15 11:32:23 +08:00
chenyuandGitHub 9cfc4f68c8 clean up Tensor.cat (#7701) 2024-11-14 13:46:02 -05:00
chenyuandGitHub 888fcb3643 Tensor.shrink arg cleanup (#7700) 
removed duplicated logic
 2024-11-14 13:01:22 -05:00
chenyuandGitHub 9fb396f660 test_ops maxpool2d -> max_pool2d (#7696) 
and avgpool2d -> avg_pool2d for better grepping the tests
 2024-11-14 10:39:12 -05:00
ignaciosicaGitHubqazal
 		1419d8e58a assert op is not store in view (#7679) 
* assert op is not store in view

* update view spec

* hotfix: nit

---------

Co-authored-by: qazal <[email protected]>
 2024-11-14 22:17:18 +08:00