nimlgen/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Activity
9,497 Commits 334 Branches 15 Tags
59b52d49d7f7065cd1318faeec00ee4e115c0354
Commit Graph
9497 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
chenyuandGitHub 59b52d49d7 remove .global_dims that are for locating GLOBAL [pr] (#11264) 2025-07-16 11:19:31 -04:00
chenyuandGitHub e6c016ddd0 move check axis < shape_len to real_axis [pr] (#11263) 
ensure output of real_axis is always valid
 2025-07-16 10:15:44 -04:00
quortusandGitHub 924bc7c9ae Fix test_uop_spec (#11259) 2025-07-16 11:02:31 +03:00
chenyuandGitHub c8e5c4d7c3 insert_before -> insert_at [pr] (#11257) 
more precise
 2025-07-15 17:44:34 -04:00
wozeparrotandGitHub b32d9321fb feat: more keccak cleanup + more explicit shape (#11256) 2025-07-15 13:57:47 -07:00
chenyuandGitHub 9f79079cbe update KernelInfo dims to return list of dims [pr] (#11255) 
local dims are not contiguous once upcast sits between local and groupreduce
 2025-07-15 15:01:39 -04:00
chenyuandGitHub 629fa21b6b remove final range in heuristic [pr] (#11251) 
all dims are based on AxisType now
 2025-07-15 11:39:15 -04:00
chenyuandGitHub d7adc24083 remove Kernel.first_upcast [pr] (#11248) 
first_reduce does not need a default now
 2025-07-15 10:21:34 -04:00
nimlgenandGitHub 197d345804 nv: print rpc msg with DEBUG>=3 (#11247) 2025-07-15 16:39:58 +03:00
chenyuandGitHub 034e51bd36 remove first_reduce used for locate real_axis [pr] (#11245) 
LOCAL goes to the last of (GLOBAL+LOCAL)+1
GROUP goes to right before first REDUCE
 2025-07-15 09:19:38 -04:00
chenyuandGitHub 0e2422d216 Kernel.axes_of helper [pr] (#11243) 
look up dim based on AxisType
 2025-07-14 22:17:43 -04:00
chenyuandGitHub 968f6b2a2e remove hasattr(self, 'axis_types') checks in dims property [pr] (#11242) 
no needed anymore
 2025-07-14 20:59:51 -04:00
leopfandGitHub 557ca7d757 testing SimpleTokenizer against OASST1 (#11214) 2025-07-14 17:09:31 -07:00
wozeparrotandGitHub 5878b189b8 don't const fold shape changing bitcast (#11236) 2025-07-14 16:42:16 -07:00
chenyuandGitHub b6662096cb remove more first_reduce [pr] (#11239) 2025-07-14 19:13:44 -04:00
chenyuandGitHub eb8e17ef59 remove most of the first_upcast [pr] (#11238) 2025-07-14 16:54:24 -04:00
qazalandGitHub c78b1cbae7 viz profiler cleanups (#11234) 
* move all render calls to zoom callback

* cleanup the naming

* require transform arg
 2025-07-14 19:06:33 +03:00
chenyuandGitHub 36ce883c7d update heuristic to use k.upcastable_dims and k.unrollable_dims [pr] (#11233) 
idea is to make it behave the same regardless of axis order and with empty 1s in shape.

not quite fully remove all first_upcast yet because some conditions used already upcasted size which need a separate benchmark to remove.
 2025-07-14 11:10:30 -04:00
qazalandGitHub c0c695dd89 viz: remove extra transform (#11232) 2025-07-14 16:51:47 +03:00
chenyuandGitHub da219199f5 minor hcopt cleanup [pr] (#11231) 2025-07-14 09:36:25 -04:00
nimlgenandGitHub 756ba1a5f9 nv: support ampere in nvpci (#11230) 2025-07-14 15:35:44 +03:00
uuuvnandGitHub b2cc6cfa1b JIT_BATCH_SIZE is a ContextVar (#11228) 2025-07-14 14:03:45 +03:00
nimlgenandGitHub c4a920d95c nv: use last signature (#11227) 2025-07-14 13:00:39 +03:00
nimlgenandGitHub a830d37881 nv: check wpr2 is inited (#11226) 2025-07-14 11:46:14 +03:00
chenyuandGitHub 0387bb9630 clean up image upcast in hcopt [pr] (#11220) 
GLOBAL+LOCAL for upcast
GROUP_REDUCE+REDUCE for unroll
 2025-07-13 18:06:43 -04:00
chenyuandGitHub 85ddd72038 simpler grouptop in hcopt (#11219) 
* simpler grouptop in hcopt

keep the only perf relevant conditions and the rest is handled by try except

* update openpilot read image count
 2025-07-13 16:06:09 -04:00
qazalandGitHub 40847ca29c viz: prune out of screen rects (#11217) 2025-07-13 21:49:59 +03:00
chenyuandGitHub 674dc28505 remove Kernel.full_unupcasted_shape [pr] (#11215) 
decomp to shape_len and first_upcast to get the last upcast-able dim
 2025-07-13 13:56:23 -04:00
chenyuandGitHub 9575cf6c6e shave more hcopt [pr] (#11213) 
start to use AxisType for conditions
 2025-07-13 12:43:58 -04:00
Alisher ZhubanyshevandGitHub 4ef6b46b34 hcq: reduce launch overhead (#11193) 
* nv: improve mmio creation speed

* add memoryview test

* fix indents

* move mv bench to `test_helpers`, remove comparison
 2025-07-13 19:25:50 +03:00
nimlgenandGitHub 1cc2b3f845 nv: use wait_cond (#11212) 2025-07-13 19:25:20 +03:00
nimlgenandGitHub 6cce3a5d58 generic wait_cond (#11210) 
* generic wait_cond

* fix linter

* fix linter
 2025-07-13 16:59:21 +03:00
chenyuandGitHub e11ccf2342 update float4 condition in hcopt (#11211) 
don't need all upcast candidates to be upcast-able, only check the actual one
 2025-07-13 09:51:45 -04:00
nimlgenandGitHub 55c54d9745 nv: sync after gpfifo setup (#11209) 2025-07-13 14:40:11 +03:00
chenyuandGitHub d90d837013 clean up hcopt [pr] (#11205) 
removed one condition that's always true
 2025-07-12 23:10:27 -04:00
chenyuandGitHub 2b48b961be fix a few broken AMX tests (#11204) 2025-07-12 21:42:38 -04:00
wozeparrotandGitHub 667c7a9fa6 clean: keccak cleanups + explicit shapes (#11202) 2025-07-12 18:17:14 -07:00
chenyuandGitHub a0438012af remove Kernel.get_program [pr] (#11203) 2025-07-12 20:50:29 -04:00
George HotzandGitHub d67c8e7b42 local metal on metal in uop syntax (#11185) 
* local metal on metal in uop syntax

* TODO: just put the axis_info in the kernelinfo

* local

* amd_matmul works @ 28 TFLOPS

* clean up matmul

* kernel8 works

* remove that

* locals

* axistype innovation

* work

* cleanup

* kernel3 regs

* cleanup kernel3

* work

* why is it broken

* no beam

* reenable

* permutes
 2025-07-12 16:31:19 -07:00
uuuvnandGitHub 40da5f0c81 fix silent mypy failure in ci (#11201) 
Example: https://github.com/tinygrad/tinygrad/actions/runs/16215577171/job/45784110543?pr=11177#step:7:20

Caused by footguny exception in how `set -e` works:

```bash
python -m mypy --strict-equality --lineprecision-report . && cat lineprecision.txt
```

Will fail (and have non-zero exit code if run in interactive mode) but
because there is `&&` it won't count as script-terminating failure in a
script with `set -e` and instead as a test (similar to how fail of a
command in if condition won't count as a script-terminating failure
despite having non-zero exit code)
 2025-07-12 15:12:25 -04:00
chenyuandGitHub 73caa5dd1b remove Kernel.membufs [pr] (#11200) 2025-07-12 14:48:47 -04:00
geohotstanGitHubchenyu
 		5ce278b245 OnnxRunner file as input (#10789) 
* file path as input and have parse be in OnnxRunner.__init__

* modelproto_to_onnxrunner -> modelproto_to_runner

* whoops, fix import

* oh flakiness again, is it because it's getting gc-ed?

* small changes

* CI flaky so just move compile4 fix in

* copy typing of onnx_load

* actually can just import onnx_load instead of onnx.load

* fix external_benchmark_openpilot

* fix onnx_runner test to use onnx_helper

* rerun CI

* try run_modelproto

* spam CI a few times

* revert run_modelproto since that's flaky also

* no external onnx_load usage except onnx.py

* cursor tab complete is evil. Snuck a darn sorted in. But does order change result? Why?

* model_benchmark 193s -> 80s, add OnnxRunner.to()...

* minimize diff and clean up

* device can be None, weird but eh

---------

Co-authored-by: chenyu <[email protected]>
 2025-07-12 14:27:46 -04:00
nimlgenandGitHub 110cff3f2e fix device arg to Tensor.randn (#11194) 
* fix device arg to Tensor.randn

* simpler test

* self.assertEqual
 2025-07-12 13:51:59 -04:00
chenyuandGitHub 6283d50224 DEPRECATED_linearize -> to_program [pr] (#11198) 2025-07-12 13:46:20 -04:00
George HotzandGitHub 770a558585 lil cleanups from uop branch [pr] (#11197) 2025-07-12 09:46:28 -07:00
George HotzandGitHub 5625e1904b axis types in KernelInfo (#11196) 
* axis types in KernelInfo [pr]

* simpler lowerer

* fix tests
 2025-07-12 09:36:20 -07:00
nimlgenandGitHub ea7f2f779c hcq: p2p nv-amd (#11195) 
* hcq: p2p between diff devices

* fix
 2025-07-12 18:53:34 +03:00
qazalandGitHub 6a9f059b21 viz: early convert to cpu time (#11192) 2025-07-12 17:19:41 +03:00
chenyuandGitHub 12b04efd69 remove a TODO prod(k.full_shape[k.first_upcast:]) (#11191) 
IMAGE=2 test/test_ops.py works now
 2025-07-12 10:16:56 -04:00
nimlgenandGitHub 6f5250d158 nv: fix typing in rpc_rm_control (#11189) 2025-07-12 16:09:42 +03:00