nimlgen/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Activity
13,471 Commits 334 Branches 15 Tags
python_prg
Commit Graph
13471 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
qazalandGitHub bfb2d1f89a Revert "fp8 gemm speedup (#16236)" (#16245) 
This reverts commit d95bf394e1.
 2026-05-19 02:01:44 +09:00
chenyuandGitHub 5ae4dbd599 make slow tests faster (#16244) 2026-05-18 11:42:02 -04:00
chenyuandGitHub 981c12182f remove requires_grad= in tinygrad/ (#16241) 2026-05-17 16:55:37 -04:00
chenyuandGitHub fcdd1af880 remove Tensor.detach override [pr] (#16239) 2026-05-16 23:58:12 -04:00
chenyuandGitHub dcee90aa3f remove requires_grad use in extra/examples (#16238) 
except the ones fed into optimizer
 2026-05-16 18:40:26 -04:00
chenyuandGitHub 8631b6f17d remove use of requires_grad in test/ (#16237) 2026-05-16 17:21:07 -04:00
qazalandGitHub d95bf394e1 fp8 gemm speedup (#16236) 
* add asm_gemm option

* milestone

* work

* edit

* only the fast kernel

* diff
 2026-05-17 04:58:28 +09:00
chenyuandGitHub 0ddc50d050 do not gate backward on requires_grad (#16230) 
DETACH is filtered in _deepwalk. instead of None, it gets 0 grad now
 2026-05-16 12:29:49 -04:00
nimlgenandGitHub bef5f717bc fix nolocals and beam (#16232) 2026-05-16 18:09:19 +03:00
qazalandGitHub ebcb7b7cc0 fp8 gemm tests with scale args (#16231) 
* update atol

* update fp8 path

* more work

* update profile.sh
 2026-05-16 20:47:58 +09:00
nimlgenandGitHub e575f778f9 move debug prints (#16218) 
* move debug prints

* x
 2026-05-16 13:57:34 +03:00
wozeparrotandGitHub 2d48d7ab09 remove more invalid (#16227) 2026-05-16 02:52:27 -07:00
wozeparrotandGitHub 159694347e llama: fix running flat_llama (#16224) 2026-05-15 20:16:48 -07:00
sirhcmandGitHub 79c0ae5b89 metal: arch is GPU family (#16223) 2026-05-15 21:22:48 -04:00
sirhcmandGitHub 2c61f65211 cl: device extensions in arch (#16220) 2026-05-15 18:59:20 -04:00
George HotzandGitHub 2549b14ec2 fix caformer onnx run (#16222) 2026-05-15 15:08:36 -07:00
George HotzandGitHub 2570bded8b update spec for LOAD (#16221) 
* add load to the spec

* can
 2026-05-15 14:46:00 -07:00
chenyuandGitHub d62c1d83c0 remove Tensor.eye override (#16219) 
* remove Tensor.eye override

was only needed for requires_grad arg

* README
 2026-05-15 15:40:34 -04:00
chenyuandGitHub 07a172dbbb remove noop requires_grad_ calls (#16213) 2026-05-15 13:31:10 -04:00
chenyuandGitHub c6cf9e8f0c remove test_svd_nonfull_5_5 (#16217) 
flaky, kinda overlap with test_svd_general
 2026-05-15 13:10:02 -04:00
qazalandGitHub d54fa86b71 viz/cli: select all calls in graph by default (#16214) 2026-05-15 21:01:44 +09:00
nimlgenandGitHub 28b98e529d nv: move structs to vram (#16184) 
* nv: vram

* x

* 4090

* x

* move and sysmem on macos

* x

* remove hp
 2026-05-15 13:41:42 +03:00
chenyuandGitHub 409bb0c9ad requires_grad cannot be None (#16212) 
final goal is to remove requires_grad, first change the default to True, and don't allow None
 2026-05-15 02:01:04 -04:00
sirhcmandGitHub c7870f11ff mesa: suggest curl install tip (#16211) 2026-05-15 00:29:06 -04:00
chenyuandGitHub a612b88abb better assert when setitem a refed tensor (#16210) 
also decouple from requires_grad
 2026-05-14 23:40:29 -04:00
chenyuandGitHub a75c14f010 some setitem tests (#16209) 2026-05-14 22:36:25 -04:00
sirhcmandGitHub 891a1ae7c2 onnx: remove dtype_fallback (#15717) 2026-05-14 22:06:57 -04:00
wozeparrotandGitHub b4d267dfd4 llama: only save when small (#16208) 2026-05-14 17:46:29 -07:00
chenyuandGitHub ffa1aac7b1 gradient for STORE/AFTER ala clone (#16205) 2026-05-14 20:17:27 -04:00
chenyuandGitHub 09096ea565 test_gradient_through_clone (#16203) 
backward through clone crashes now
 2026-05-14 19:26:47 -04:00
George HotzandGitHub d4dcd8487b aggressive shape check to prepare for broadcasting (#16202) 
* add implicit broadcasting to shape

* NOOP/ALLREDUCE fixes
 2026-05-14 16:15:44 -07:00
George HotzandGitHub 83ec66da34 fix a fastdiv edge case (#16199) 2026-05-14 13:12:18 -07:00
nimlgenandGitHub 62ea73719d hcq2: share more with graph (#16196) 
* share more with graph

* comment
 2026-05-14 22:28:11 +03:00
George HotzandGitHub 3b8cc31759 disable fast idiv by default, it's broken (#16197) 
* disable fast idiv by default, it's broken

* fix fast idiv tests
 2026-05-14 11:48:27 -07:00
sirhcmandGitHub 8f811649ff better compiler_cpu invalid arch errors (#16194) 2026-05-14 14:36:14 -04:00
qazalandGitHub f03a7fd6d1 viz/cli: readable uop json (#16195) 
* viz/cli: readable uop json repr

* work

* better
 2026-05-14 21:33:10 +09:00
C TandGitHub 1b779a9058 add gelu approximate="none" (match pytorch) (#16162) 
* add gelu approximate="none" (match pytorch)

* lint

* pass through onnx Gelu approximate

* type annotate

* explicit math.sqrt

* keep tinygrad's gelu approximate="tanh" default
 2026-05-13 18:53:24 -07:00
chenyuandGitHub dd9187d9ee minor hash cleanups (#16190) 
same kernels
 2026-05-13 20:59:24 -04:00
wozeparrotandGitHub 88ac2ac1fd llama: cleanups (#16189) 2026-05-13 17:08:06 -07:00
sirhcmandGitHub 9a365d9978 ci: fix null image tests (#16188) 2026-05-13 18:00:05 -04:00
nimlgenandGitHub ad1fb7c981 hcq2: graph (#16186) 
* keep this for now

* early graph
 2026-05-13 22:49:43 +03:00
chenyuandGitHub 3f9f6a51b2 minor image_conv2d cleanup (#16187) 
remove some no-op slices
 2026-05-13 15:47:40 -04:00
b1tgandGitHub 59c34b9fe0 llm: precise device (#16159) 
* llm: precise device

* llm: pass device to precompute_freqs_cis
 2026-05-12 21:16:42 -07:00
b1tgandGitHub 3c806ff406 clean up gguf (#16160) 2026-05-12 21:16:10 -07:00
wozeparrotandGitHub e97f2c1114 llama: only gemm + fa custom kernel (#16180) 
* llama: tie store to grad directly

* llama: set mp flags

* llama: non fused grad fp8 quantize path
 2026-05-12 21:03:49 -07:00
chenyuandGitHub 38d407fd58 simplify svd more (#16181) 
all the slowness is scheduling
 2026-05-12 23:48:22 -04:00
sirhcmandGitHub f1fdd2ccec ci: add IMAGE=1 compile-only tests (#16182) 
* ci: add IMAGE=1 compile-only tests

* fix
 2026-05-12 23:40:32 -04:00
George HotzandGitHub faf7fb7513 update nir renderer for new image style (#16179) 
* update nir renderer for new image style

* don't cast image indexes
 2026-05-12 20:25:01 -07:00
sirhcmandGitHub 7d0c5ab689 ci: ocelot needs nvcc on linux (#16178) 
* ci: ocelot needs nvcc on linux

* cudart
 2026-05-12 23:13:48 -04:00
chenyuandGitHub 32138c2418 svd to mixin (#16175) 2026-05-12 22:29:01 -04:00