sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 8 Activity
14,221 Commits 336 Branches 15 Tags
22bc5b40b2a0d8e2dff1b577a930fdb759bc81e7
Commit Graph
14221 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
geohot 22bc5b40b2 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 2026-08-03 22:13:36 +00:00
George HotzandGitHub c2625c78cb scalar ALU index fix + llm: preserve_thinking (#17381) 
* cstyle: scalar ALU index fix, serve: preserve_thinking, test: fix Handler import

- cstyle.py: return scalar directly when ALU buffer has 1 element
- cli.py: add preserve_thinking param to FallbackTemplate.render
- serve.py: pass preserve_thinking=True when rendering chat completions
- test_llm_server.py: fix import to use Handler from llm.serve

* real fix
 2026-08-03 15:10:21 -07:00
chenyuandGitHub 33755a3465 improve threefry codegen [pr] (#17379) 
decomp uint64 can handle part of it
 2026-08-03 17:24:25 -04:00
YassineYousfiandGitHub 104ee90ccf usb: wait for PCIe link after power on (#17380) 2026-08-03 14:19:05 -07:00
geohot 74fd4c2aa1 simpler 2026-08-03 21:01:07 +00:00
geohot 69008bcaa5 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 2026-08-03 20:30:39 +00:00
geohot 1b1bc4ce4c simpler 2026-08-03 20:26:26 +00:00
chenyuandGitHub a2385ae21d MAX_LINE_COUNT=26000 (#17378) 
oh well
 2026-08-03 15:37:58 -04:00
wozeparrotandGitHub 3331944547 gptoss: fix moe routing (#17377) 2026-08-03 11:16:44 -07:00
geohot f7579a2040 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 2026-08-03 16:33:10 +00:00
geohot f26128e8d2 400 lines 2026-08-03 16:28:20 +00:00
geohot 79ef0a16c0 +499 lines 2026-08-03 15:02:58 +00:00
nimlgenandGitHub 7c1ce50f63 hcq2: epoch (#17376) 
* hcq2: epoch

* x

* minor
 2026-08-03 16:37:25 +03:00
qazalandGitHub be5f62d269 llama: refactor amax stuff and skip in fp4 (#17375) 2026-08-03 20:05:52 +09:00
nimlgenandGitHub e22935c758 hcq2: inputs table (#17374) 
* revert this

* x

* simpler

* fix
 2026-08-03 13:40:43 +03:00
chenyuandGitHub 314df72b5f deflake test_hcq with MOCKGPU (#17370) 
for MOCKGPU we compare with e2e wall time which would be device agnostic
 2026-08-03 13:22:59 +03:00
geohot 0dda620216 llm: fix recurrent rangeify and client cache reuse 2026-08-03 03:30:32 +00:00
geohot 6414b1b2e1 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 2026-08-03 03:03:46 +00:00
chenyuandGitHub 23c7813f44 no hard coded dtype int for rangeify debuf [PR] (#17373) 2026-08-02 20:43:04 -04:00
geohot de37fe0d8f kernel cleanups 2026-08-02 22:00:18 +00:00
geohot 269f821421 llm: retain master model formatting 2026-08-02 20:25:41 +00:00
geohot 41b7a02103 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 
# Conflicts:
#	tinygrad/llm/model.py
 2026-08-02 20:12:15 +00:00
geohot 9230322266 llm: keep sequential AMD startup under a minute 2026-08-02 20:04:55 +00:00
George HotzandGitHub 05bc7c6994 fix llm reasoning and Linear import (#17372) 2026-08-02 12:31:52 -07:00
chenyuandGitHub 09dabfe05e minor pm_float_decomp cleanup [PR] (#17371) 
make the rule order independently correct
 2026-08-02 15:17:33 -04:00
geohot ffc4507fb4 llm: recover packed weights in linear 2026-08-02 19:06:45 +00:00
chenyuandGitHub 59df317b12 use UOp.const to create new consts [PR] (#17368) 
replace arg won't work with ConstArg
 2026-08-02 13:31:55 -04:00
geohot 71869224b4 llm: share AMD quant kernel helpers 2026-08-02 15:53:39 +00:00
geohot c64f8aeff8 Merge remote-tracking branch 'origin/master' into qwen36_27b_amd_900 2026-08-02 15:38:58 +00:00
geohot 82025dfe1f llm: keep 131k Qwen cache on AMD 2026-08-02 15:38:04 +00:00
geohot 756a936be2 llm: report interrupted stream statistics 2026-08-02 15:12:29 +00:00
geohot ce071d7f0e llm: fix recurrent server startup and reasoning routing 2026-08-02 15:03:17 +00:00
geohot 21f91bac40 llm: reuse generic Qwen embedding 2026-08-02 14:44:24 +00:00
geohot 73f0aa7d45 llm: add Qwen AMD acceptance benchmark 2026-08-02 14:35:04 +00:00
geohot d1e1d587af llm: reuse standard sampling path 2026-08-02 14:32:51 +00:00
geohot 8f3337c46f llm: checkpoint recurrent prompt state 2026-08-02 14:30:06 +00:00
geohot f92ac85fbd llm: simplify AMD Qwen kernels 2026-08-02 14:17:43 +00:00
geohot fb53442c17 llm: use standard RoPE table allocation 2026-08-02 14:13:06 +00:00
geohot eba359128e llm: reuse master recurrent cache semantics 2026-08-02 14:09:36 +00:00
geohot 3804a87b60 llm: keep Qwen warmup changes scoped 2026-08-02 13:55:10 +00:00
geohot 9d02a3fe68 llm: remove unused Qwen AMD paths 2026-08-02 13:55:10 +00:00
geohot 35dbe53d5d llm: trim unused AMD quant paths 2026-08-02 13:55:10 +00:00
geohot ca29776f74 llm: fast packed Qwen3.6 inference on AMD 2026-08-02 13:55:10 +00:00
wozeparrotandGitHub e14cadb1fb gptoss: set ASM_GEMM (#17363) 2026-08-02 06:52:36 -07:00
chenyuandGitHub 0258c7fefc minor argstr and alloc stack cleanup [PR] (#17361) 2026-08-01 22:37:06 -04:00
George HotzandGitHub fb607fb990 faster devectorizer with one line (#17360) 2026-08-01 13:06:35 -07:00
George HotzandGitHub 15c936db01 merge devectorize + indexing (#17354) 
* external benchmark schedule in 5 sec (codex slop)

* prune

* real?

* delete
 2026-08-01 11:40:15 -07:00
wozeparrotandGitHub 98b700bad1 gptoss optim fixes (#17356) 2026-08-01 09:10:06 -07:00
chenyuandGitHub 8e524ca467 CONST related cleanups [pr] (#17352) 
ConstFloat(nan) != nan should be False, and some Invalid bool cleanups
 2026-08-01 09:54:28 -04:00
nimlgenandGitHub 665822ab34 hcq2: faster replace (#17353) 
* hcq2: use runtime device for submit params

* hcq2: parameterize buffers in linear time
 2026-08-01 16:32:04 +03:00