nimlgen/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Activity
14,335 Commits 334 Branches 15 Tags
rewrite_rangeify2
Commit Graph
1336 Commits
Author SHA1 Message Date
chenyuandGitHub 5ca87f1bac fix cast to weak twice [pr] (#17548) 
also no gradient for weak target
 2026-08-15 12:39:54 -04:00
chenyuandGitHub 539a03343a no casted const from sub and div [pr] (#17543) 2026-08-15 07:47:40 -04:00
qazalandGitHub a57569349c renumber invalids before callify (#17542) 
* renumber invalids before callify

* change

* Revert "change"

This reverts commit 6f4df1541e.

* renumber in tensor

* scope renumber_invalid_outputs

* cleanup
 2026-08-15 18:00:54 +09:00
qazalandGitHub 5c43a89fb1 precompile_backward tests for sched_cache (#17544) 
* work

* back

* work

* keep +
 2026-08-15 15:25:31 +09:00
qazalandGitHub e6f5bb9c09 simple test for Invalid clone cache miss regression (#17541) 
* simple test for Invalid clone cache miss regression

* xfail

* _
 2026-08-15 11:00:21 +09:00
chenyuandGitHub 89ab344c42 fix assign into bitcast with no explicit realize (#17531) 2026-08-14 09:23:01 -04:00
nimlgenandGitHub 6b35220622 cpu hcq2 (#17503) 
* cpu hcq2

* temp

* slop

* test with backpressure

* x

* x

* x

* x

* x

* x

* Dx

* save reverts

* um?

* x

* x

* call from py

* x?

* x

* submitters gone

* x

* x

* z

* Dx

* Dx

* x

* x

* fixes

* repl

* x

* f

* for now keep hcqbuffer
 2026-08-14 15:06:03 +03:00
George HotzandGitHub e103fb2a10 more lil llm improvements (#17514) 
* more lil llm improvements

* default float
 2026-08-12 20:13:20 -07:00
George HotzandGitHub 2297118541 lil llm improvements (#17513) 2026-08-12 19:29:32 -07:00
sirhcmandGitHub 479ffb0cda remove Ops.SLICE (#17492) 2026-08-11 18:50:04 -04:00
b1tgandGitHub abe2256299 fix symbolic sharded reshape (#17463) 2026-08-08 09:18:02 -07:00
b1tgandGitHub 8c49a7a34b support symbolic shapes in copy (#17461) 
* pad_to is no-op when same shape

* support symbolic shapes in copy
 2026-08-08 09:16:59 -07:00
chenyuandGitHub baa6148066 fix var of large half input (#17444) 
* fix var of large half input

similar to mean, we use sum_acc_dtype for denominator

* mypy
 2026-08-06 23:14:32 -04:00
chenyuandGitHub 7a9cd8e329 move weak function and pm to uop/weak [PR] (#17429) 2026-08-05 22:27:40 -04:00
sirhcmandGitHub be25207a7a scope variable names inside CALLs (#17424) 2026-08-05 20:59:09 -04:00
chenyuandGitHub c2f1e5ae2a fix weak cast to strong dtype [pr] (#17418) 
weak can mean higher than that strong dtype, so always use that strong dtype is wrong
 2026-08-05 15:32:23 -04:00
chenyuandGitHub 6cb419b9b7 regression test for bert nan with weak (#17412) 2026-08-05 12:14:26 -04:00
chenyuandGitHub 3bf9e70b19 Revert "don't cast weak in _broadcasted [pr] (#17408)" (#17409) 
This reverts commit b45058b5ec.
 2026-08-05 02:40:33 -04:00
chenyuandGitHub b45058b5ec don't cast weak in _broadcasted [pr] (#17408) 
* don't cast weak in _broadcasted [pr]

* fine now?
 2026-08-05 02:19:31 -04:00
George HotzandGitHub 46f0003776 more KernelCountException (#17407) 2026-08-04 22:55:38 -07:00
George HotzandGitHub e1f42681fa add new schedule tests + format better (#17402) 
* add new schedule tests + format better

* assert_kernel_count
 2026-08-04 18:46:38 -07:00
chenyuandGitHub 3eab809e06 update minimum to not create strong type const [PR] (#17401) 2026-08-04 21:29:24 -04:00
b1tgandGitHub 0796853845 support symbolic shapes in allreduce (#17364) 2026-08-04 07:53:12 -07:00
George HotzandGitHub c21a552f3d llm: bugfixes + warmup (#17384) 2026-08-03 18:23:14 -07:00
George HotzandGitHub 3cb786f447 llm: update test_llm_server tests (#17382) 2026-08-03 16:06:17 -07:00
George HotzandGitHub 05bc7c6994 fix llm reasoning and Linear import (#17372) 2026-08-02 12:31:52 -07:00
chenyuandGitHub 6c0ec39279 UOp.is_invalid [PR] (#17351) 
helper to prep ConstArg
 2026-08-01 02:36:32 -04:00
chenyuandGitHub b502fc1367 more const arg -> val (#17350) 2026-08-01 02:18:10 -04:00
George HotzandGitHub a88f832f0c remove UOp.val (#17345) 2026-07-31 18:58:38 -07:00
chenyuandGitHub ad24750487 const(value, dtype) -> const(value).cast(dtype) in tests (#17335) 2026-07-31 13:24:31 -04:00
chenyuandGitHub 7f4dbb8090 remove shape= from UOp.const [PR] (#17331) 
inlined to const_like
 2026-07-31 11:18:59 -04:00
chenyuandGitHub 8e2f175542 const(dtype, b) -> const(b, dtype) [PR] (#17328) 
prep for dtype removal
 2026-07-31 09:46:37 -04:00
chenyuandGitHub fe8ece7efa fix weak for image gate fusion [pr] (#17310) 2026-07-30 19:47:47 -04:00
chenyuandGitHub ce500c1946 broadcast doesn't cast CONST [pr] (#17308) 
* broadcast doesn't cast CONST [pr]

it might change arg from python int to python float, but not cast the CONST, so we don't need or_casted in symbolic. we lower the weak dtype right before decomp

* fix
 2026-07-30 18:51:59 -04:00
chenyuandGitHub b488cc7df2 update dtype_from_uop for SHR/SHL (#17307) 
certain backend cast the distance, and we should not re-broadcast it
 2026-07-30 13:57:58 -04:00
b1tgandGitHub e25bf77ce9 kimi delta attention (#17281) 
* kimi delta attention

* config

* test
 2026-07-30 08:23:56 -07:00
George HotzandGitHub b30c7e00d4 support 2d on UNSHARD (kimi) (#17285) 
* support 2d on UNSHARD

* fixes

* Fix test and spec

* single barrier

* 2d sharding works for devices too

* cleanups

* no _rewrap
 2026-07-29 12:01:59 -07:00
chenyuandGitHub dd86a30798 test case for weakfloat cast to weakint INDEX (#17287) 2026-07-29 14:15:52 -04:00
George HotzandGitHub 57ae1bc7a7 rename MULTI to UNSHARD (#17267) 
* rename MULTI to UNSHARD

* comment updates (glm)

* rename method to unshard
 2026-07-28 16:51:41 -07:00
George HotzandGitHub 1757067fa6 add device range as src[1] to multi (kimi) (#17264) 
* add device range as src[1] to multi (kimi)

* cleanup

* fix tests
 2026-07-28 16:39:34 -07:00
chenyuandGitHub 23e9e76e8c DEFAULT_FLOAT/DEFAULT_INT ContextVar [pr] (#17265) 2026-07-28 19:08:18 -04:00
chenyuandGitHub fde3a8faff CAPTURE_PROCESS_REPLAY=0 default chaging test [PR] (#17261) 
* CAPTURE_PROCESS_REPLAY=0 default chaging test [PR]

quick patch before making default dtype context vars, which is quite annoying

* few more
 2026-07-28 17:32:35 -04:00
qazalandGitHub e3b3eea1e2 test for extra copy in allreduce_cast (#16740) 
* test for extra copy in allreduce_cast

* simpler

* cleanup
 2026-07-28 19:02:54 +09:00
chenyuandGitHub 0bb36c9989 make Tensor(None) weakfloat (#17241) 
match other float consts
 2026-07-27 16:45:28 -04:00
chenyuandGitHub 818a892ebc flip from_py to use weak dtypes [pr] (#17229) 2026-07-27 10:07:00 -04:00
chenyuandGitHub 4b6760539b fix _prepare_jit_inputs for weak [pr] (#17222) 2026-07-26 14:03:27 -04:00
chenyuandGitHub a8d51097dc realize weak is no-op [pr] (#17219) 
None device and weak dtype are both virtual
 2026-07-26 11:52:56 -04:00
Manan GuptaGitHubGeorge Hotz
 		79c07a334c fix ValueError in UOp.axis for shard reshape crossing boundary (#16547) 
Co-authored-by: George Hotz <[email protected]>
 2026-07-26 08:38:10 -07:00
chenyuandGitHub 5d1aa84901 SHR/SHL are Broadcastable [pr] (#17216) 2026-07-26 02:11:03 -04:00
chenyuandGitHub a96974e70c slight weak behavior tweak and cleanups [pr] (#17214) 
* slight weak behavior tweak and cleanups [pr]

* ruff
 2026-07-25 22:51:24 -04:00