geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
9,457 Commits 4 Branches 15 Tags
73caa5dd1bb5dd31267613fa4447e1df7f736ae8
Commit Graph
9457 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
chenyuandGitHub 73caa5dd1b remove Kernel.membufs [pr] (#11200) 2025-07-12 14:48:47 -04:00
geohotstanGitHubchenyu
 		5ce278b245 OnnxRunner file as input (#10789) 
* file path as input and have parse be in OnnxRunner.__init__

* modelproto_to_onnxrunner -> modelproto_to_runner

* whoops, fix import

* oh flakiness again, is it because it's getting gc-ed?

* small changes

* CI flaky so just move compile4 fix in

* copy typing of onnx_load

* actually can just import onnx_load instead of onnx.load

* fix external_benchmark_openpilot

* fix onnx_runner test to use onnx_helper

* rerun CI

* try run_modelproto

* spam CI a few times

* revert run_modelproto since that's flaky also

* no external onnx_load usage except onnx.py

* cursor tab complete is evil. Snuck a darn sorted in. But does order change result? Why?

* model_benchmark 193s -> 80s, add OnnxRunner.to()...

* minimize diff and clean up

* device can be None, weird but eh

---------

Co-authored-by: chenyu <[email protected]>
 2025-07-12 14:27:46 -04:00
nimlgenandGitHub 110cff3f2e fix device arg to Tensor.randn (#11194) 
* fix device arg to Tensor.randn

* simpler test

* self.assertEqual
 2025-07-12 13:51:59 -04:00
chenyuandGitHub 6283d50224 DEPRECATED_linearize -> to_program [pr] (#11198) 2025-07-12 13:46:20 -04:00
George HotzandGitHub 770a558585 lil cleanups from uop branch [pr] (#11197) 2025-07-12 09:46:28 -07:00
George HotzandGitHub 5625e1904b axis types in KernelInfo (#11196) 
* axis types in KernelInfo [pr]

* simpler lowerer

* fix tests
 2025-07-12 09:36:20 -07:00
nimlgenandGitHub ea7f2f779c hcq: p2p nv-amd (#11195) 
* hcq: p2p between diff devices

* fix
 2025-07-12 18:53:34 +03:00
qazalandGitHub 6a9f059b21 viz: early convert to cpu time (#11192) 2025-07-12 17:19:41 +03:00
chenyuandGitHub 12b04efd69 remove a TODO prod(k.full_shape[k.first_upcast:]) (#11191) 
IMAGE=2 test/test_ops.py works now
 2025-07-12 10:16:56 -04:00
nimlgenandGitHub 6f5250d158 nv: fix typing in rpc_rm_control (#11189) 2025-07-12 16:09:42 +03:00
qazalandGitHub c0a5490c72 viz: minor profiler cleanup (#11190) 2025-07-12 14:18:24 +03:00
chenyuandGitHub fdcc25e392 some noop hand_coded_optimizations cleanup [pr] (#11188) 2025-07-12 00:09:23 -04:00
chenyuandGitHub 1ad852a892 break up Kernel.reshape_and_permute [pr] (#11187) 2025-07-11 18:08:08 -04:00
uuuvnGitHubwozeparrot
 		d11b20129d DMARef infra (#10753) 
Co-authored-by: wozeparrot <[email protected]>
 2025-07-11 14:09:47 -07:00
chenyuandGitHub b072be0e2d hotfix whisper main script (#11184) 2025-07-11 12:34:00 -04:00
qazalandGitHub 0b7e9b5db7 viz: bugfix for multiple rewrites with the same name (#11182) 2025-07-11 18:26:12 +03:00
nimlgenandGitHub f9e4c4e57a nv: nvpci blackwell support (#11127) 
* nv: start 5090

* gsp init 5090

* mmu

* works

* after merge

* clenaer

* rwk

* x

* fx

* finish?

* fix

* unrelated

* fix

* commenbt
 2025-07-11 17:02:09 +03:00
qazalandGitHub 1d85323572 viz: absolute scaling of memory graph (#11181) 2025-07-11 16:39:11 +03:00
nimlgenandGitHub c7f6b617b4 nv: do not hardcode lv0 pd size (#11180) 2025-07-11 16:26:18 +03:00
nimlgenandGitHub 27922c986a nv: generic mmu impl (#11179) 2025-07-11 16:26:09 +03:00
qazalandGitHub d3ec63a5c3 viz: add base class for unittests (#11178) 2025-07-11 13:58:03 +03:00
qazalandGitHub b791ea117d viz: enable scrolling in profiler (#11169) 
* viz: add scrollbar to profiler

* using margin fixes the layout bug

* s/profiler.clientHeight/profiler.scrollHeight, it's important

* closer

* scrolling on the device list also works
 2025-07-11 11:30:13 +03:00
chenyuandGitHub b219e47bef remove Kernel.upcasted_axis [pr] (#11175) 2025-07-10 23:19:21 -04:00
George HotzandGitHub ccd382bc6f use axis_types more [pr] (#11172) 
* use axis_types more

* fix local shape

* simpler clause

* fix local shape
 2025-07-10 15:05:13 -07:00
nimlgenandGitHub fb278c6a02 do not recreate Compiled.profile_events in helper_collect_profile (#11171) 2025-07-10 23:55:12 +03:00
George HotzandGitHub 5c5eb92ed4 tc unroll after upcast [pr] (#11170) 2025-07-10 13:43:50 -07:00
George HotzandGitHub 05613c8cac use shape str for tensor cores upcast/reduce [pr] (#11168) 
* use shape str for tensor cores upcast/reduce [pr]

* reduce axis count isn't fixed
 2025-07-10 13:10:58 -07:00
nimlgenandGitHub cc6ed30f4f nv: relative lv addressing in NVPageTableEntry (#11164) 2025-07-10 22:35:50 +03:00
chenyuandGitHub 439d033af9 update the README matmul example (#11167) 
don't call rand and numpy to show that it's indeed one kernel
 2025-07-10 14:47:29 -04:00
qazalandGitHub bde80c0cdf record GraphEvents in metal graph (#11145) 
* record GraphEvents in metal graph

* add TestProfiler.test_graph, revert old stuff

* move profile capture to MetalGraph

* comment

* don't double record graph command buffers

* wait_check

* explicit delete
 2025-07-10 21:32:06 +03:00
George HotzandGitHub 8ce3d5906b use shape_str for tensor cores (#11165) 2025-07-10 09:10:36 -07:00
nimlgenandGitHub 581397110f nv: use classes in GSP_IP (#11163) 2025-07-10 17:47:12 +03:00
nimlgenandGitHub 705de6b8a6 nv: parse sizes of ctx buffers (#11161) 2025-07-10 17:46:48 +03:00
qazalandGitHub dcc9704b6b viz: profile RewriteSteps in TINY device (#11125) 
* viz: profile RewriteSteps in TINY device

* use TracingKey with category

* split by whitespace

* add tracing.py

* work

* tracing_key

* TRACK_MATCH_STATS=3, can this be in defaults?

* fallback name

* work

* javascript

* measure text is slow

* checkout

* profile graph_rewrite/graph_rewrite_map

* change that

* no as

* finally

* work

* linking works
 2025-07-10 17:45:57 +03:00
Pyry KovanenandGitHub 32117402dd metal: fix incorrect _free on interpreter exit (#11158) 2025-07-10 14:01:30 +03:00
qazalandGitHub 3d610f6d2b viz: small ui cleanup (#11157) 
* viz: small ui cleanup

* 2
 2025-07-10 11:43:36 +03:00
chenyuandGitHub 7db07e5f2c don't narrow range of CAST on bool/unsigned (#11156) 2025-07-09 22:20:09 -04:00
George HotzandGitHub e154a66f43 unroll axis 0 in tensor core (#11155) 
* unroll is 0 in tc [pr]

* flip order of upcast/reduce in tensor core

* Revert "flip order of upcast/reduce in tensor core"

This reverts commit e564e38bcd.
 2025-07-09 17:28:23 -07:00
George HotzandGitHub b7742ad9e4 migrate to string swizzle [pr] (#11154) 2025-07-09 16:57:53 -07:00
George HotzandGitHub 4156baee93 break swizzle into three chunks [pr] (#11153) 
* break swizzle into three chunks [pr]

* test failed
 2025-07-09 15:30:34 -07:00
George HotzandGitHub ca2dc95433 swizzle in tc can't be none [pr] (#11152) 2025-07-09 14:44:23 -07:00
George HotzandGitHub 53ae153404 tc should be in opt (#11148) 
* tc should be in opt [pr]

* fix import
 2025-07-09 14:12:21 -07:00
wozeparrotandGitHub 6697d0089d initial gfx950 kfd support (#11151) 
* feat: initial gfx950 support

* fix: lint
 2025-07-09 13:45:16 -07:00
George HotzandGitHub 262054be52 gfx950 tc support (#11150) 2025-07-09 13:30:42 -07:00
nimlgenandGitHub b6981404ed memory: use page shifts in memory manager (#11149) 
* memory: use page shifts in memory manager

* fix
 2025-07-09 22:05:00 +03:00
qazalandGitHub 5c1d215b41 viz: add Graph stream (#11144) 
* viz: stack an event for the entire batch

* multi

* whitespace

* work

* multi graph, Graph gets its own row
 2025-07-09 20:56:46 +03:00
George HotzandGitHub 22305260e0 move tc to tc.py [pr] (#11147) 2025-07-09 10:55:56 -07:00
George HotzandGitHub 2893feb9f6 cleanups for kernel.py (#11143) 
* cleanups for kernel.py

* fixups
 2025-07-08 18:10:25 -07:00
George HotzandGitHub b11ca104e9 axis cleanups [pr] (#11142) 2025-07-08 17:07:26 -07:00
chenyuandGitHub 7ce9e45474 mypy onnx_parser (#11141) 2025-07-08 19:50:28 -04:00