Commit Graph
7218 Commits
Author SHA1 Message Date
Ahmed Harmouche d4bce5be8c can't allocate this at once, need parts back 2024-12-13 13:51:45 +01:00
Ahmed Harmouche 4396ac96b5 No NamedTuple in compile.py 2024-12-13 12:38:59 +01:00
Ahmed Harmouche 04041b1342 More WIP 2024-12-13 12:23:02 +01:00
Ahmed Harmouche 3d4bbc3a35 WIP 2024-12-13 11:54:14 +01:00
Ahmed Harmouche 52f4547303 WIP 2024-12-13 11:54:14 +01:00
qazalandGitHub 4a617c84e1 cleanup ctx usage in scheduler upats [pr] (#8205) 2024-12-13 18:01:13 +08:00
qazalandGitHub 55b8c4e8bf apply_swizzle can apply to any views [pr] (#8204) 2024-12-13 17:58:35 +08:00
Ahmed HarmoucheandGitHub 651f72442c encapsulate the exported webgpu model (#8203) 2024-12-13 10:55:37 +01:00
qazalandGitHub 5864627abe process replay filter warnings [pr] (#8199) 2024-12-13 17:43:43 +08:00
qazalandGitHub c5c0d0277d flatten buffer args, delete dtype [pr] (#8202) 2024-12-13 16:43:47 +08:00
Ahmed HarmoucheandGitHub 5198415bfb No unpack_map in wgsl (#8200) 2024-12-13 08:10:31 +01:00
leopfandGitHub fe68dbdb23 GroupOp.Idempotent (#8198) 2024-12-12 20:44:04 -05:00
chenyuandGitHub ce41e6572d unit test merge_dim [pr] (#8195)
looking for better ways to write this. first adding some tests
2024-12-12 17:55:52 -05:00
chenyuandGitHub d47530c0d4 fix device canonicalize for :0 in middle [pr] (#8193)
replace is wrong because it does not check if `:0` is at the end. use re.sub instead
2024-12-12 16:32:36 -05:00
chenyuandGitHub 40a4c603b9 remove more test skip for webgpu [pr] (#8192) 2024-12-12 14:06:35 -05:00
chenyuandGitHub d586c7e108 remove had_counter from rand (#8191) 2024-12-12 13:35:39 -05:00
chenyuandGitHub 2fe98e44cd unneeded isinstance(size, int) in alloc [pr] (#8189) 2024-12-12 13:05:02 -05:00
chenyuandGitHub 72ff631f8d remove unreachable tensor dtype assert (#8190)
it would have failed in `to_dtype`. added some tests for it too
2024-12-12 13:04:49 -05:00
chenyuandGitHub 2e4c7d4cfb add "tinygrad" to be part of cache_dir [pr] (#8188)
instead of having sqlite / http download / metal compile to add "tinygrad" separately. also make it non-private since it's used in metal
2024-12-12 12:09:44 -05:00
Ahmed HarmoucheandGitHub db76586780 Cast pattern touchup in AMDRenderer [pr] (#8185) 2024-12-12 15:12:14 +01:00
nimlgenandGitHub bf7d1fcd2c tiny import fixes in hcq graph (#8184) 2024-12-12 16:30:06 +03:00
Ahmed HarmoucheandGitHub 2f2b1e792c wgsl and ops_webgpu simplifications [pr] (#8182)
Simplify wgsl and ops_webgpu
2024-12-12 14:21:58 +01:00
George HotzandGitHub d9a0880d33 delete fuzz uops (not tested) [pr] (#8181) 2024-12-12 01:41:27 -08:00
George HotzandGitHub c77cb57454 remove untested BEAM_COMPARE=1 [pr] (#8180) 2024-12-12 01:35:27 -08:00
Ahmed HarmoucheandGitHub 1b94cc095a Bump back wgpu to latest (#8179) 2024-12-12 09:40:52 +01:00
chenyuandGitHub 97aaa50f3a remove duplicated UOp in Tensor init types [pr] (#8177)
and a small comment
2024-12-11 22:59:35 -05:00
chenyuandGitHub d240bdd172 remove upcast_in_mid_reduce_axes [pr] (#8176) 2024-12-11 22:14:28 -05:00
chenyuandGitHub 64a917b7eb remove LAZYCACHE ContextVar [pr] (#8175)
also removed from resnet latest script
2024-12-11 22:02:52 -05:00
chenyuandGitHub 7047ffd27d tiny gguf_load cleanup [pr] (#8174)
round_up helper
2024-12-11 21:32:52 -05:00
George HotzandGitHub 151ac5f5a2 remove UPCASTMID [pr] (#8173) 2024-12-11 17:29:01 -08:00
George HotzandGitHub f86e0014b7 delete CAPTURE_BEAM, this should use PR or VIZ infrastructure instead [pr] (#8172) 2024-12-11 16:29:03 -08:00
George HotzandGitHub 8a04a3a77a rename LazyBuffer -> UOp [pr] (#8169)
* rename LazyBuffer -> UOp [pr]

* fix docs
2024-12-11 16:15:52 -08:00
George HotzandGitHub e0fe867c74 delete beam compare 2 [pr] (#8168) 2024-12-11 16:10:01 -08:00
chenyuandGitHub aaa3cc235d unused from __future__ import annotations (#8171) 2024-12-11 19:05:04 -05:00
George HotzandGitHub aae2f4da8d fix process replay [pr] (#8170)
* empty change [pr]

* store the context in PROCESS_REPLAY_CAPTURE
2024-12-11 15:58:42 -08:00
9044b0746a delete lazy [pr] (#7801)
* LazyBuffer = UOp

* try 4 at this diff

* skip optimization tests p1

* raise kernel count expectations

* BIND isn't the _only_ uop that can become a tensor

* fix test_ones_sum on symbolic

* bump openpilot, correctness first

* offset on assign is fine

* uop is immutable

* what if this was higher

* more optimization skips

* instant fold const copy

* test_multitensor shouldn't expect buffer for unrealized

* move copy folder to upats

* start BUFFER_VIEW

* kinda BUFFER_VIEW

* Revert "kinda BUFFER_VIEW"

This reverts commit 94b4fe3040.

* BUFFER_VIEW try 2

* linter and missed _device

* pylint

* keep Ops.CONTIGUOUS

* always BUFFER_VIEW disk

* test

* cpu isn't a real device

* buffer references afte del

* add that back

* start bringing some of these back

* more test updates

* simpler simplify copy

* subbufer everything

* this is fine with buffer view

* cleanup the diff in test/ 1

* copy is one thing

* diff pruning

* diff pruning 2

* oh bind unbinds way too early

* extra

* more diff pruning

* more const folding

* experiment with symbolic here

* Revert "experiment with symbolic here"

This reverts commit cb87d61f7a.

* Revert "more const folding"

This reverts commit 2a7d258a2b.

* Revert VALID early folding

This reverts commit 4074f52317.

* storing const is fine

* fix test_prefer_half_buffer

* iterate on test_real_world

* this fixes test_train_mnist memory, breaks everything else

* Revert "this fixes test_train_mnist memory, breaks everything else"

This reverts commit dccfcbe068.

* always expect buffer to exist here

* temp debug: something is mutating lazydata in compile3

* Revert "temp debug: something is mutating lazydata in compile3"

This reverts commit 71400f0d55.

* everything back to normal

* compile3

* compile3 test

* start captured jit work, that test passes

* finalized memory skip set

* linter err

* back to base here

* tiny metaop cleanup

* print tensor

* 4th type this unbind got me

* green pickle

* tensor_variable sanity

* cast sanity

* link from the reds

* COPY sanity + minor repr change

* you can exist

* enable test_winograd

* bye bye nbytes

* danger, uop is mutating

* real become

* delete those from uop init

* put it in buffer init

* buffer inits with so much stuff

* buffer pickle try 2

* toposort can't be a cached property

* fix test_schedule_gc_with_inputs

* remove all @unittest.skip(gc)

* Revert "remove all @unittest.skip(gc)"

This reverts commit 9d8d92dd85.

* reenable real world + test_schedule_gc

* test: RUN_PROCESS_REPLAY=0

* fix pickle jit

* test changes

* reenable test_lru_alloc and TestTrain

* fix imagedtype

* bring pr back

* reenable 3 gc tests

* test_schedule better diff

* disable SPLIT_REDUCEOP

* test_save_all_dtypes looks fixed

* fix metadata

* skip that one

* fix viz by not pickling buffers

* simple test for const folding

* bring split reduceop back

* add simplify_alu

* simplify_binop fixes a test

* fix cast folding

* disable that test

* that test looks fine

* changes from delete_lazy pruning p1

* cast folding and children base

* test: cast folding from pruning branch

* green test_sgd_4convs_fuse_conv_bw

* enable some indexing folding

* test_complex_backward is fixed

* prune more, 295 -> 233

* fix test_multi_const_folding_literal

* fix double copy

* early become test

* ooooops

* clean up ctx in all big_graph

* fix openpilot 208 kernels

* train_cifar is fine now

* fix CAST_BEFORE_VIEW

* ever faker const

* back to 13

* mark expectedFailure

* fine don't create them

* test_multi_const_folding_tensor

---------

Co-authored-by: George Hotz <[email protected]>
Co-authored-by: George Hotz <[email protected]>
2024-12-12 05:05:19 +08:00
chenyuandGitHub 26e049ab40 add ALLOWED_READ_IMAGE=2131 to openpilot (#8166)
added as exact number check now as it's not clear if more/less than allowed is any better
2024-12-11 12:14:17 -08:00
chenyuandGitHub 0e57152dbb clean up test_uop_symbolic [pr] (#8165)
removed old `Node` references
2024-12-11 14:13:19 -05:00
chenyuandGitHub 5eadae204b test multi device rand with manual_seed (#8164) 2024-12-11 13:11:31 -05:00
Maxim ZakharovandGitHub e53a5bf0c3 StableDdiffusion UI - convenient send via Enter (#8160) 2024-12-11 19:05:24 +01:00
qazalandGitHub 047a6dabc3 prereq for scheduler contiguous_child [pr] (#8163)
* the whole context is fine here [pr]

* fix that
2024-12-12 02:02:22 +08:00
ignaciosicaandGitHub 3a8e8ac6c2 remove dead code (#8161) 2024-12-11 12:07:19 -05:00
geohot 8f4299fcc8 hotfix: suppress shutdown errors in CLProgram 2024-12-11 08:08:32 -08:00
Ahmed HarmoucheandGitHub a73e3677d0 Test linearizer on webgpu (#8159)
* Test linearizer on wgpu

* Skip tests due to exceeded dims
2024-12-11 17:03:26 +01:00
qazalandGitHub b894657aa7 assert the same things without mutating or accessing internal ops state [pr] (#8157)
* don't mutate internal state in test_lazybuffer

* fix test_schedule internals

* save time

* third si

* fine sometimes buffer_view isn't there
2024-12-11 22:01:27 +08:00
qazalandGitHub 63de8f2208 late scheduler context builder [pr] (#8155) 2024-12-11 19:59:39 +08:00
chenyuandGitHub d462f8ace0 use HALF in cifar wino benchmarks (#8153)
more representative as it hits tensor cores on tinyboxes
2024-12-10 20:21:00 -05:00
geohot c8e7707a7e hotfix: disable flaky move tensor test 2024-12-10 17:11:21 -08:00
chenyuandGitHub 155f7df599 lower test_gemm_4096 expectation on green (#8152)
getting 119 sometimes, so lowered to 115
2024-12-10 18:05:12 -05:00
chenyuandGitHub c4be1529cf update test for Tensor.softplus (#8150)
test beta and extreme inputs.
to pass big input, it needs to support `threshold`, which needs fix on backward that we punt until new gradient api
2024-12-10 17:48:02 -05:00