sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions Activity
11,453 Commits 336 Branches 15 Tags
remove_programspec
Commit Graph
4777 Commits
Author SHA1 Message Date
Sieds LyklesandGitHub 73b25bf47d z3 fix loaded mask (#12353) 
* z3 fix loaded mask

* indentation
 2025-09-30 06:55:50 +02:00
wozeparrotandGitHub 2a0caa09c2 push copy to disk (#12348) 2025-09-29 21:55:05 -07:00
hoovedandGitHub 39aae679e4 Support bfloat16 on NULL backend (#12340) 
* add failing test

* move test

* only run test with NULL default

* add skip reason

* add fix
 2025-09-30 00:02:30 -04:00
George HotzandGitHub f522e83a02 fix rangeify elu fusion for openpilot (#12341) 
* fix rangeify elu fusion for openpilot

* flip the metadata

* copy over permuted contiguous support

* this is correct

* update that
 2025-09-30 11:41:52 +08:00
Sieds LyklesandGitHub d55d829635 Lower index dtype spec fix (#12337) 
* new pm_lower_index_dtype

* load_store_indexing after index lowering

* shorten line

* seperate rule for long removal

* fix test

* fix index_to_concrete_int

* minor fixes

* add sink there

* update types in linearizer test
 2025-09-30 04:26:50 +02:00
hoovedandGitHub c2689c505e Clip model updates for Stable Diffusion mlperf training (#12313) 
* stable diffusion mlperf clip changes

* add clip tests

* set gelu as attribute

* add more tests

* factor out GPUS

* rerun CI

* add imports to if blocks

* remove unneeded axis

* add clip tests to CI

* move clip tests

* add deps, disable max buf size
 2025-09-29 21:50:14 -04:00
George HotzandGitHub cdfa0f29fd add rendering to index (#12338) 2025-09-30 09:18:05 +08:00
qazalandGitHub 9513f025c5 apply multi before rangeify (#12298) 
* it doesn't realize it when i reshape

* cleaner graph

* map out

* REDUCE_AXIS also gives the wrong answer

* maybe

* work

* back here

* try

* more

* refactor tests

* check MultiBuffer

* or copy

* fine with this

* don't need graph_rewrite_map in rangeify
 2025-09-29 14:16:31 +03:00
George HotzandGitHub 3291e00df7 fix efficientnet slowness on rangeify (#12332) 2025-09-29 18:01:01 +08:00
chenyuandGitHub 9d2f2b8e34 skip test_mean_half_precision_overflow (#12331) 
it only works with SPLIT_REDUCEOP=1
 2025-09-29 05:15:04 -04:00
chenyuandGitHub 76c87d81b3 delete test_backward_sum_acc_dtype (#12330) 
this test tests the wrong thing, it was only working because expand realize rule
 2025-09-29 04:46:17 -04:00
George HotzandGitHub fd2e4f2353 failing rng test (#12328) 
* tighten spec: fixup devectorizer types / rangeify

* tighten assign

* failing rangeify test

* simpler

* otherwise contig

* more tolerance cause rng seed changed
 2025-09-29 16:06:45 +08:00
qazalandGitHub 250cb10e8f rangeify permuted assign (#12299) 
* enable RANGEIFY=1 test_assign

* work

* rangeify=0 asserts this ast

* remove that

* beta test, it's correct though

* skip multi

* matches torch/np output

* memcopy without memcopy

* can remove this

* rangeify isn't silently wrong anymore

* diff cleanup

* use UOp toposort instead of global tags

* actual assert TestRangeifyAssign

* step

* work

* this isn't optimizing away now

* some todos

* test fusion schedule

* typo

* dedup idxs

* cleaner

* pre

* work

* diff
 2025-09-29 07:27:57 +03:00
Sieds LyklesandGitHub ed90de6583 Revert "Bufferize early, fix "children not making progress" on big graphs (#1…" (#12318) 
This reverts commit 6f1cf717de.
 2025-09-28 19:10:21 +02:00
Sieds LyklesandGitHub 29f0886395 skip test_softmax_fusion tests if RANGEIFY==1 (#12310) 2025-09-27 05:57:40 +02:00
Sieds LyklesandGitHub b98f1881ef dsp opt test has different axis number on rangeify (#12309) 2025-09-27 05:06:11 +02:00
Sieds LyklesandGitHub 6f1cf717de Bufferize early, fix "children not making progress" on big graphs (#12308) 
* bufferize children early

* cleaner

* fix types

* lower number of reduceops

* test openpilot
 2025-09-27 04:17:15 +02:00
nimlgenandGitHub f5eb46a3d9 fix limit buf metal on non rangeify (#12303) 
* add failure test for limit buf on non rangeify

* correct metal

* correct

* hm
 2025-09-26 11:06:28 +03:00
Sieds LyklesandGitHub 74411984fc Rangeify IMAGE (#12304) 
* add imagedtype to rangeify

* enable some image tests

* move the tests

* image upcast before locals

* add if statement

* rangeify image_dtype test

* decrease read_image count
 2025-09-26 07:21:02 +02:00
chenyuandGitHub 17cec8d645 RANGEIFY winograd test (#12297) 
speed seems fine
 2025-09-24 23:42:32 -04:00
nimlgenandGitHub 476a2a0a96 test_qcom: update (#12293) 2025-09-24 21:45:58 +03:00
qazalandGitHub 0e778296be rangeify: refactor const folding (#12291) 
* rangeify: refactor const folding [pr]

* it got better
 2025-09-24 17:58:39 +03:00
qazalandGitHub 6c9d8c7e41 rangeify: simplify noop copy (#12289) 2025-09-24 17:01:23 +03:00
Sieds LyklesandGitHub 45c7252aed Better div nesting 2 (#11812) 
* remove check

* use fold_divmod_congruence instead of simplify

* adjust tests

* shorten line

* new algo

* add test

* cleanup

* update tests

* ALLOWED_GATED_READ_IMAGE from 16 -> 12

* only remove the call to simplify

* add option to simplify with factor_remainder

* Allowed readimage gates back to 16
 2025-09-24 04:50:26 +02:00
Sieds LyklesandGitHub 6146c64d81 lower the invalid gate last (#12164) 
* lowering invalid gate is part of lower_index_dtype

* update test

* remove import

* put that back

* reduce_collapse uses invalid

* fix that pattern to use invalid_pat

* valid creates the right dtype count

* seperate rule for lowering invalid gate

* dont unvectorize Invalid gate

* image_fixup uses Invalid

* update tests

* cleanup

* update split_load_store

* add .scalar() there
 2025-09-24 04:27:35 +02:00
nimlgenandGitHub 02a7b7fe48 rangeify: fix test_setitem (#12269) 
* rangeify: fix test_setitem

* um?

* better?

* simple where folding

* f

* revert

* x
 2025-09-23 20:42:36 +03:00
chenyuandGitHub b54cb272d0 move test_qcom to test/device (#12272) 2025-09-22 21:07:10 -04:00
Sieds LyklesandGitHub d21e34e617 enable test_sum_twice (#12270) 
* remove skip

* remove import
 2025-09-23 00:57:29 +02:00
Sieds LyklesandGitHub 5a4b244e6b Check for group inside another reduce (#12268) 
* add check

* get the ranges correctly

* add test

* comment and better check
 2025-09-23 00:32:41 +02:00
chenyuandGitHub b03ceb806e move test_sample to test_randomness (#12266) 2025-09-21 21:11:32 -04:00
nimlgenandGitHub b53a266254 rangeify: fix test_optim (#12262) 
* rangeify: fix test_optim

* add to cl?

* these are good now
 2025-09-21 18:08:35 +03:00
nimlgenandGitHub 4762a24022 test_free_intermediates force buffers (#12255) 
* test_free_intermediates force buffers

* f

* fix for rangiefy

* xx
 2025-09-20 18:14:39 +03:00
qazalandGitHub 57c7e0a8f8 RANGEIFY=1 test_jit (#12254) 
* RANGEIFY=1 test_jit

* don't do any of that

* disk

* simple disk tensor

* more work

* run more tests

* it also doesn't copy everytime

* skip tests that hang everything
 2025-09-20 17:34:32 +03:00
chenyuandGitHub 393c6b236c test case to sum twice in different order (#12253) 
* test case to sum twice in different order

fixed by #12251

* try metal
 2025-09-20 10:11:57 -04:00
qazalandGitHub 4756971c88 skip test_bf16_disk_write_read on CL=1 (#12256) 2025-09-20 17:11:06 +03:00
Sieds LyklesandGitHub 73c8dae60d add missing remove_blockend case (#12251) 
* add missing remove_blockend case

* remove expectedFailure

* better comment
 2025-09-20 06:29:19 +02:00
qazalandGitHub bb59eed82f rangeify: don't tag consts, they are global (#12247) 
* rangeify: don't tag consts, they are global

* don't map movement ops

* sym failing test

* remove that

* update comment

* simpler test

* work
 2025-09-19 15:25:03 +03:00
Sieds LyklesandGitHub cc038b31b6 Shrink instead of reshape to unregister symbolic (#12241) 
* Slice to unbind symbolic

* use vmax for now

* assert shape in reshape is valid

* update test_symbolic_ops to use shrink instead of reshape

* remove infer_with_bound_values for npw

* symbolic output doesnt have symbolic strides

* symbolic jit tests use shrink to unregister symbolic

* update test

* update more tests

* wrap vmax in int()

* only create a new st if the store is not an assigne

* unwrap st

* comments
 2025-09-19 06:04:35 +02:00
Sieds LyklesandGitHub 8d703a6369 z3 xor doesnt use bitcast (#12243) 2025-09-19 00:31:44 +02:00
chenyuandGitHub 0dad6cc518 good RANGEIFY kernel counts in external_test_opt (#12242) 
no push permute stuff. the model ones are less clear if it's good, some got slower
 2025-09-18 17:58:54 -04:00
qazalandGitHub 825f148469 rangeify: fix copy size mismatch errs (#12232) 
* rangeify: fix copy size mismatch errs

* const folding can happen in sym

assert it

* shippable

* rangeify copy is completely wrong

* pre_bufferize

* tag bufferize

* pre back
 2025-09-18 18:23:32 +03:00
chenyuandGitHub f82b16a0e9 RANGEIFY test_tensor (#12235) 2025-09-18 10:35:43 -04:00
chenyuandGitHub 7487c13b61 truncate_fp16 -> float_to_fp16 (#12234) 
match float_to_bf16 and float_to_fp8
 2025-09-18 09:48:27 -04:00
b1tgGitHubb1tg
 		54c15d74a4 python float8 support (#11960) 
* basic support

* alu

* nan in exec_alu

* rand_for_dtype

* inf + 0.0

* finfo

* revert rand_for_dtype

* clean

* truncate fp8s inf

* spec ok

* float_to_fp8 nan/inf

* least_upper_dtype

* clean up

---------

Co-authored-by: b1tg <[email protected]>
 2025-09-18 09:17:09 -04:00
qazalandGitHub dbbc261075 rangeify: fix COPY simplifier (#12233) 2025-09-18 14:35:33 +03:00
qazalandGitHub 525f80e0d2 rangeify: enable putting consts back in the tensor graph (#12225) 
* rangeify: enable putting consts back in the tensor graph

* work

* sym in ci
 2025-09-17 19:45:04 +03:00
chenyuandGitHub edffc246ed MUL in reduce_unparented (#12223) 
* MUL in reduce_unparented

* some test
 2025-09-17 11:56:39 -04:00
qazalandGitHub 7733c217c5 remove spam comments in test_schedule (#12224) 2025-09-17 18:24:55 +03:00
qazalandGitHub d917895569 map out rangeify errors in test_schedule (#12211) 
* map out rangeify errors in test_schedule

* skip that

* add to ci
 2025-09-17 09:10:28 +03:00
Sieds LyklesandGitHub 158506b91e Upgrade some divmod folding for symbolic divs (#12216) 
* use const_factor() instead of arg

* add test

* change div min_max

* add tests

* add divide_by_symbolic_gcd

* add tests

* one more test

* Slice to unbind symbolic

* deal with const factor properly

* minor cleanup

* divide_by_symbolic_gcd becomes UOp.gcd and UOp.divide_exact

* add tests

* add gcd_without_const

* fix divide_exact bug

* add factor_remainder

* add tests

* fix imports

* elif -> if

* remove expectedFailure

* add more tests

* add more unwrap

* fix signature of pop_const

* remove that

* remove that
 2025-09-17 03:00:50 +02:00