sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 4 Activity
14,300 Commits 336 Branches 15 Tags
simple_rangeify
Commit Graph
17 Commits
Author SHA1 Message Date
George HotzandGitHub c2625c78cb scalar ALU index fix + llm: preserve_thinking (#17381) 
* cstyle: scalar ALU index fix, serve: preserve_thinking, test: fix Handler import

- cstyle.py: return scalar directly when ALU buffer has 1 element
- cli.py: add preserve_thinking param to FallbackTemplate.render
- serve.py: pass preserve_thinking=True when rendering chat completions
- test_llm_server.py: fix import to use Handler from llm.serve

* real fix
 2026-08-03 15:10:21 -07:00
George HotzandGitHub 05bc7c6994 fix llm reasoning and Linear import (#17372) 2026-08-02 12:31:52 -07:00
George HotzandGitHub 08eceb0ad9 llm: fix generated tokens in usage accounting (#17174) 2026-07-23 21:38:07 -07:00
George HotzandGitHub f7ce7f330d llm: minor fixes + tests (#17099) 
* llm: minor fixes + tests

* error
 2026-07-20 14:31:20 -07:00
George HotzandGitHub 86a6ad8ed2 llm: split cli.py into serve.py with the HTTP server (#17065) 
* llm: split cli.py into serve.py with the HTTP server

* min edit
 2026-07-17 10:45:37 -07:00
George HotzandGitHub 3ee2baf71d llm: add tool calling support (kimi) (#17061) 
* llm: add tool calling support

* simpler

* cls

* gpt cleanup

* more gpt cleanups

* tests for tools calling
 2026-07-17 10:20:01 -07:00
George HotzandGitHub 46172bb7c7 llm: add optional jinja template support (kimi) (#17058) 
* add jinja template support (kimi)

* fix tests

* lil

* more crap to fallback
 2026-07-16 19:02:58 -07:00
George HotzandGitHub 7e6d617935 addrspace cleanups (#16565) 
* addrspace cleanups

* bumps

* eh, relax a little
 2026-06-10 15:57:18 -07:00
George HotzandGitHub a9b6cfece0 refactor llm into files (#15780) 
* refactor llm into files

* chat.html

* tokenizer cleanup

* cleanup

* tests
 2026-04-17 12:33:11 +08:00
George HotzandGitHub ec00cefa5b llm is the only app (#15779) 
* tinygrad/llm is the only app

* upd pyproject

* claude refs

* scoping

* min diff
 2026-04-17 10:44:48 +08:00
b1tgandGitHub 4e88d875ba llm: glm 4.7 flash (#15738) 
* glm 4.7

* test

* temperature, server enable_thinking

* --no-think

* remove think stuff
 2026-04-16 22:42:04 +08:00
George HotzandGitHub b5a9465b13 llm: add support for moonlight (deepseek MLA) (#15466) 
* add gguf Q5_0

* it works

* rebase

* simpler test

* class

* less diff

* dicts

* normal names

* simplify

* this

* simpler

* work

* work
 2026-04-11 10:32:48 +08:00
b1tgandGitHub 9ab1415937 llm: fix streaming UTF-8 decode (#15653) 2026-04-10 17:01:02 +08:00
George HotzandGitHub fe2690399b llm: support assistant prefill + refactor to TransformerConfig (#15457) 
* llm: support assistant prefill

* refactor to ModelConfig

* TransformerConfig

* more
 2026-03-25 10:50:48 +08:00
George HotzandGitHub a33ac869aa llm server: temperature + test client (#15444) 
* improvements to the llm server

* eval script

* eval llm

* better eval gets 58.71

* cleanups

* add temperature, but multinomial is absurdly slow

* claude is so smart

* lint

* remove slop

* no more stop
 2026-03-24 21:07:15 +08:00
George HotzandGitHub 8a82b26522 llm: print the prefill cache size (#15146) 
* print the llm prefill cache size

* mock that too
 2026-03-05 12:13:28 +08:00
George HotzandGitHub d59e6e7a37 move more tests to test/null, split some existing ones (#14512) 
* move more tests to test/null, split some existing ones

* null work

* null work

* move more

* fixes

* move PIL

* PIL in CLIP

* don't move that
 2026-02-03 20:20:20 +08:00