geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
14,474 Commits 4 Branches 15 Tags
master
Commit Graph
143 Commits
Author SHA1 Message Date
chenyuandGitHub a7df1a1ace const are weak 3 [pr] (#17695) 2026-08-24 20:32:57 -04:00
chenyuandGitHub 8b164aefea test update from weak const (#17689) 2026-08-23 17:30:16 -04:00
George HotzandGitHub 5b60a09ab0 some fixes for the AMD emulator (#17684) 
* some fixes for the AMD emulator

* simpler

* revert

* min
 2026-08-22 22:48:07 -07:00
chenyuandGitHub 356f665377 test update for weak const (#17675) 2026-08-21 21:50:29 -04:00
George HotzandGitHub af242819d8 refactor the AMD emulator slop (kimi) (#17673) 
* refactor the AMD emulator slop (kimi)

* mypy
 2026-08-21 18:00:58 -07:00
George HotzandGitHub 3082956a17 usb copyin: async arm and drain, 323 MB/s on comma (#17663) 
* usb copyin: can safely arm before drain

* perf counter

* 294 MB/s for comma

* free speed with async transfers
 2026-08-21 13:12:03 -07:00
George HotzGitHubtiny
 		756e82e055 usb amd: pipelined copyin over the 0xF2 engine (2.6x faster) (#17628) 
Stream 240KB chunks into two alternating 256KB SRAM bounce windows; each chunk
ends in a unique 512B sentinel that a prebuilt SDMA ring polls before copying
the chunk to VRAM, followed by an in-order drain fence that the host waits on
before re-arming a window. No timing assumptions in either direction: the
sentinel is in-stream proof of data landing, the fence proves a full drain.

Adds a small pooled async bulk-OUT layer to USB3 so staging the next chunk
overlaps the wire, and a slot_start parameter to scsi_write for the second
window. 107 -> 276 MB/s copyin on tinyc8 (Kryo-3XX host).

Co-authored-by: tiny <tiny@local>
 2026-08-21 10:38:50 -07:00
chenyuandGitHub 80169c6758 remove where push cast to branches from sym [pr] (#17533) 
* remove where push cast to branches from sym [pr]

not really needed and one less place that generates casted weak const when it's not needed

* fix
 2026-08-14 12:57:56 -04:00
nimlgenandGitHub 4c206a52b1 fix ci emu (gpt) (#17437) 
* fix ci emu

* x
 2026-08-07 22:36:59 +03:00
RaineGitHubGeorge Hotz
 		77e124e455 fix AMD WMMA emulation and test in CI (#17184) 
* fix SPEC=1 test_tensor_cores

* implement i32 WMMA for RDNA3, add regression test to CI

* gfx950 scaled mfma llvmir fix

* detect VOP3PX2 in emu

* start cdna4 scaled mfam emu

* fix gfx12 llvmir signatures

* oops

* fix

* fix src2 const field extraction (gpt)

* scaled mfma fixes cdna4 (kimi)

* fp8 out breaks mfma (glm)

* fix const signature

* another

* fix f string for linter

* lint

* clean

* and a final lint

* .

* fix mypy

* skip slow tests on ci

* reduce unroll tensor shape -> 64x64

---------

Co-authored-by: George Hotz <[email protected]>
 2026-08-04 23:25:32 -07:00
chenyuandGitHub b502fc1367 more const arg -> val (#17350) 2026-08-01 02:18:10 -04:00
chenyuandGitHub 8e2f175542 const(dtype, b) -> const(b, dtype) [PR] (#17328) 
prep for dtype removal
 2026-07-31 09:46:37 -04:00
sirhcmandGitHub aab51fb7b6 64-bit UOp.variable support, try 2 (#17256) 2026-07-29 14:39:36 -04:00
George HotzandGitHub 52c9e5a99e rename LOOP -> WEAK and STRONGLOOP -> LOOP (#17283) 2026-07-29 10:38:36 -07:00
chenyuandGitHub 4b7022e8f4 Revert "64-bit UOp.variable support (#17246)" (#17248) 
This reverts commit ab8fb191b2.
 2026-07-28 00:00:26 -04:00
sirhcmandGitHub ab8fb191b2 64-bit UOp.variable support (#17246) 2026-07-27 23:56:09 -04:00
nimlgenandGitHub 97a2265362 hcq2: amd indirect (#17220) 
* ind

* mock
 2026-07-26 21:36:01 +03:00
George HotzandGitHub 960430a5e5 Revert "nv: set lower interleave level to reduce GPU hogging (ai slop) (#15518)" (#17218) 
This reverts commit ac12914506.
 2026-07-26 08:15:16 -07:00
JYCGitHubYasko CClaude Opus 4.6
 		ac12914506 nv: set lower interleave level to reduce GPU hogging (ai slop) (#15518) 
Fixes #10773. The NV backend makes desktop systems unusable (cursor lag,
video drops) because the channel group runs at the default HIGH interleave
level, monopolizing the GPU and starving the display compositor.

Sets tsgInterleaveLevel to LOW (0) by default so the GPU scheduler can
preempt compute work for display refresh. Dedicated compute machines can
restore full priority with NV_INTERLEAVE=2.

Also adds SET_INTERLEAVE_LEVEL to the mock GPU driver's pass-through list.

Co-authored-by: Yasko C <[email protected]>
Co-authored-by: Claude Opus 4.6 (1M context) <[email protected]>
 2026-07-26 08:12:05 -07:00
chenyuandGitHub 74c2121d99 promo (uint64, int) -> weakfloat like JAX [pr] (#17204) 2026-07-25 15:20:42 -04:00
George HotzandGitHub b53cd35cff llm: make tokenizer fast (kimi) (#17077) 
* llm: make tokenizer fast

* simpler

* re.escape + qcom mypy fix
 2026-07-18 17:31:59 -07:00
nimlgenandGitHub d6fddb066f usb: keep only custom (#17029) 
* usb: keep only custom

* mockgpu by gpt

* gpt said sorry

* revert

* reset

* fix

* flash
 2026-07-15 22:40:52 +03:00
chenyuandGitHub 681a5e0cfd remove UOp cast and bitcast override [PR] (#17011) 2026-07-13 14:23:11 -04:00
George HotzandGitHub 95681f17ee remove extra dtypes from tests (#16954) 
* remove extra dtypes from tests

* a few more
 2026-07-09 14:59:56 -07:00
George HotzandGitHub 1df49a7bf5 dtype doesn't need to be explicit in most places now (glm) [PR] (#16951) 
* dtype doesn't need to be explicit in most places now (glm) [PR]

* fix amd pcode

* image idx long/int meh

* real image fix
 2026-07-09 14:41:34 -07:00
George HotzandGitHub fdffc6c0c8 remove dtypes base (#16931) 
* remove dtypes base

* find/replace bug

* vcount is junk too
 2026-07-08 11:48:11 -07:00
George HotzandGitHub 40d112d4d6 remove ptr=True from index (#16898) 2026-07-06 18:34:18 -07:00
George HotzandGitHub 6b8b2f5aeb remove PtrDtype from tests (#16896) 
* remove PtrDtype from tests

* fixes

* not needed

* no -1
 2026-07-06 18:22:22 -07:00
George HotzandGitHub a6ed4237e5 remove Ops.VCAT and Ops.PTRCAT (glm) (#16771) 
* remove Ops.VCAT and Ops.PTRCAT (glm)

* fix stack, and remove useless casts
 2026-06-26 18:35:38 -07:00
George HotzandGitHub e72ecd101f split decomp into files (#16745) 
* split decomp into files

* that's in op
 2026-06-25 08:40:02 -07:00
George HotzandGitHub 54887cbbdf move decomp files into codegen (#16744) 2026-06-25 08:19:02 -07:00
George HotzandGitHub 649971f02a remove DEFINE_LOCAL and DEFINE_REG (gpt) (#16673) 
* remove define_local and define_reg (gpt)

* fix precommit

* cleanups

* regalloc fix

* cleanups 2
 2026-06-19 10:07:50 -07:00
George HotzandGitHub d7b10c69bc update placeholder to not create DEFINE_LOCAL/DEFINE_REG (#16671) 
* update placeholder to not create DEFINE_LOCAL/DEFINE_REG

* simpler

* define_local
 2026-06-18 21:21:06 -07:00
George HotzandGitHub 4a4b6956df remove DEFINE_VAR from codebase (gpt) (#16666) 
* remove DEFINE_VAR from codebase

* junk

* remove junk
 2026-06-18 15:33:50 -07:00
chenyuandGitHub df015ad541 remove many type ignores [PR] (#16652) 2026-06-17 21:38:45 -04:00
sirhcmandGitHub 4e2e2e9956 ocelot: use c.DLL (#16540) 2026-06-08 21:27:28 -04:00
sirhcmandGitHub 80eeb4dd21 mockgpu: use autogen.libc (#16479) 2026-06-02 19:59:36 -04:00
George HotzandGitHub 20242fdf1d update test + spec from shrink_in_render (#16467) 
* update test + spec from shrink_in_render

* cast
 2026-06-01 19:24:43 -07:00
George HotzandGitHub 556defa0f7 minor updates from vec removal (#16456) 2026-05-31 09:48:51 -07:00
George HotzandGitHub 1e7f1dcf49 add ParamArgs [pr] (#16421) 
* add ParamArgs

* fix export

* cleanups

* fixes

* simpler
 2026-05-28 19:17:17 -07:00
George HotzandGitHub bac82d4949 fix emu bug in gfx950 (#16381) 
* fix emu bug in gfx950

* fix renderer
 2026-05-26 10:32:03 -07:00
chenyuandGitHub 9b00defc8c Revert "remove unique_const (#16372)" (#16380) 
This reverts commit 09019d6761.
 2026-05-26 12:30:07 -04:00
chenyuandGitHub 09019d6761 remove unique_const (#16372) 
* remove unique_const

* fix SDWA thing

* that?
 2026-05-26 12:18:03 -04:00
sirhcmandGitHub 7cdd9cbdeb PYTHONREMU: V_CVT_PK_BF8_F32 saturation (#16268) 2026-05-19 19:29:59 -04:00
sirhcmandGitHub bb2a51f1ea fix mypy mockgpu and add tinygrad.renderer.isa to packages (#16265) 2026-05-19 16:45:03 -04:00
sirhcmandGitHub a178301dbe PYTHONREMU: fix CDNA VOP3 conditional writes (#16258) 2026-05-19 13:31:31 -04:00
sirhcmandGitHub 1c8cb0769a am: autogen asic_regs (#16004) 2026-05-04 22:52:07 -04:00
George HotzandGitHub 26406bed83 amd uses .valid, not index src valid (#16042) 2026-05-04 18:35:15 -07:00
nimlgenandGitHub 7787f76dcc get_runner -> get_runtime (#15967) 
* get_runner -> get_runtime

* do not use get_runner

* fix

* remove get_tunner

* remove

* fix

* x
 2026-04-29 18:29:49 +03:00
sirhcmandGitHub cbf4946ea6 usb: multiple gpus and better error messages (#15900) 2026-04-24 01:57:19 -04:00