sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions Activity
8,329 Commits 336 Branches 15 Tags
f7b38fa94c3beb4e9f73093d4078207447fc9474
Commit Graph
338 Commits
Author SHA1 Message Date
geohot 8660fecb02 unroll both sides 2025-03-26 15:12:02 +08:00
geohot f1ff18acec prepad kernel weights 2025-03-26 12:13:46 +08:00
geohot f6e64a5e8e optional conv 2025-03-25 19:00:48 +08:00
George HotzandGitHub 554a490751 Merge branch 'master' into dsp_search 2025-03-24 12:29:22 +08:00
geohot de7d6cec3a hotfix: DEBUG 5 prints the ast 2025-03-24 11:43:11 +08:00
geohot fd73ec2b1b knum 2025-03-22 18:59:54 +08:00
geohot e1d2bec4a4 opt 2025-03-22 18:52:56 +08:00
geohot 26b02a037c fix 33 2025-03-22 17:17:47 +08:00
Ignacio SicaandGitHub eddafb84e5 Bugfix for TC=3 (#9464) 
* wrong but uses less shared

* for size 8 tc1 with devectorize in 0 loads into local before wmma and works

* improvements over tc1 devectorize

* fix tc=3

* works for handcoded tc opts

* clean bugfix tc=3

* fix

* revert changes
 2025-03-21 16:43:42 -07:00
chenyuandGitHub 6da78164f9 assert Kernel ast.op to be Ops.SINK [pr] (#9539) 
rest of the code assumes self.ast is defined anyway
 2025-03-21 18:09:44 -04:00
geohot 0416b0998d revert those 2025-03-21 17:15:38 +08:00
geohot 5ce951fb34 l2 2025-03-21 11:14:12 +08:00
geohot e5ccd9e846 work 2025-03-20 15:20:03 +08:00
George HotzandGitHub 52ae9af4dd Fast DSP for MobileNetV2 (try 2) (#9467) 
* Fast DSP for MobileNetV2 (try 2)

* enable fast path on uchar

* fix tests
 2025-03-17 15:10:36 +08:00
chenyuandGitHub ca5064a5b6 remove Kernel.float4_axis [pr] (#9448) 2025-03-14 17:54:32 -04:00
George HotzandGitHub a73d8717f3 fast amd gemm (#9318) 
* 50 TFLOP AMD gemm

* add lds tiling

* register tiling

* flip locals

* work

* comment

* remove those
 2025-03-03 12:01:14 +08:00
chenyuandGitHub 2e7c2780a9 CLANG -> CPU (#9189) 2025-02-20 18:03:09 -05:00
qazalandGitHub cf315d544b rename can_pad arg to cache [pr] (#9170) 2025-02-19 12:24:59 +01:00
George HotzandGitHub a330f3338c save applied opts in ProgramSpec [pr] (#9150) 2025-02-19 00:40:03 +08:00
geohot ff9b985d9f hotfix: View Base AST 2025-02-18 18:48:34 +08:00
George HotzandGitHub ddddcc165b colors back in DEBUG=2 [pr] (#9155) 2025-02-18 16:17:57 +08:00
George HotzandGitHub caee42e8a6 Revert "name from uops [pr] (#9151)" (#9154) 
This reverts commit 28897be9a2.
 2025-02-18 16:06:44 +08:00
George HotzandGitHub 28897be9a2 name from uops [pr] (#9151) 2025-02-18 15:52:03 +08:00
George HotzandGitHub a4dab3ec3f add name uop (#9149) 
* add name uop, TODO: refactor renderer to use

* renderer uses name uop

* fix tests

* render

* ptx
 2025-02-18 15:26:58 +08:00
George HotzandGitHub df3b320f46 rewriter -> devectorizer [pr] (#9147) 2025-02-18 12:42:08 +08:00
George HotzandGitHub 9289425170 add ast to ProgramSpec + pre matcher [pr] (#9128) 
* add ast to ProgramSpec + pre matcher [pr]

* cleaner cast + test fix
 2025-02-17 16:39:14 +08:00
chenyuandGitHub d129ccda4c add RAWAST back to DEBUG=3 [pr] (#9107) 2025-02-15 09:12:51 -05:00
George HotzandGitHub 81f5a7af7d improve DEBUG=3 [pr] (#9105) 2025-02-15 18:44:56 +08:00
chenyuandGitHub f53b819648 UOps. -> Ops. [pr] (#9044) 
updated the comments and doc except extra
 2025-02-12 12:53:23 -05:00
Ignacio SicaGitHubGeorge Hotz
 		aaed315fee add AMX support to LLVM (#8957) 
* init amx support for llvm

* revert elf changes

* fix attributes for AMX asm calls

* add comments

* add llvm amx job to benchmarks

* cleanup

* cleanup

* hotfix: improve comments

* comment for aux buffers

* hotfix:

* move amx_tc to ClangRenderer

* merge master

* refactor

* add docs

* add corsix docs reference

---------

Co-authored-by: George Hotz <[email protected]>
 2025-02-12 16:01:18 +08:00
George HotzandGitHub 2983285315 use HEX_REG_QEMU_INSN_CNT from qemu as a DSP timer [pr] (#8993) 
* use HEX_REG_QEMU_INSN_CNT from qemu as a DSP timer [pr]

* add quantize test to dsp

* fix tests

* older onnx

* debug, let's see what's happening
 2025-02-10 11:07:35 +08:00
George HotzandGitHub a3c78d47b3 speed docs + upgrades [pr] (#8964) 
* add some docs about speed [pr]

* better torch gemm

* enable locals on llvm/clang

* disable locals for beam speed on LLVM/CLANG

* 0x20 alignment in llvm allows ymm use
 2025-02-08 17:28:52 +08:00
qazalandGitHub b92f36179d don't use set in schedule + add GroupOp.All [pr] (#8882) 
* don't use set in schedule + add GroupOp.All [pr]

* update that
 2025-02-04 08:19:27 +01:00
Ali LadjevardiandGitHub 73c75d6ee1 DEFINE_LOCAL variable names start from temp0, not temp1 (#8870) 2025-02-03 22:50:38 +08:00
Ali LadjevardiandGitHub 6e523e4d17 Remove size arg from DEFINE_LOCAL [pr] (#8845) 
* remove size arg form DEFINE_LOCAL

* make mypy happy

* whitespace

* dont change code in extra

* revert to temp1 to pass pr
 2025-02-02 19:47:32 +08:00
qazalandGitHub af4f9d1aa9 use matchers to verify AST shape [pr] (#8828) 
* use matchers to verify kernel AST [pr]

* work

* use swizzle_cnt

* add comment

* imports

* modified_ast comment

* brief
 2025-01-31 09:17:42 +02:00
George HotzandGitHub 643c09a6c6 tensor uop spec should be in spec.py [pr] (#8827) 
* tensor uop spec should be in spec.py [pr]

* err, spec.py

* print uops can stay
 2025-01-31 13:54:04 +08:00
Ignacio SicaandGitHub 260df1a17f tc_select noop (#8801) 
* tc_select noop

* revert changes in test
 2025-01-29 13:53:23 -05:00
qazalGitHubGeorge Hotz
 		ba17786068 do not construct unmasked VALID (#8759) 
* new lines that exist in codegen/ops

* update tests

* update sops.gz (13071 -> 13070 asts)

* fix viz too

* remove that TODO

* diff pruning

* mask assert + device

* work

* diff pruning

* re: fix viz too

---------

Co-authored-by: George Hotz <[email protected]>
 2025-01-28 20:51:21 +02:00
qazalandGitHub aefbc2637f test fixups from unmasked valid deletion [pr] (#8776) 2025-01-28 09:23:30 +02:00
Ignacio SicaandGitHub 2c71c60719 opt arg is int or tuple (#8780) 2025-01-28 11:02:32 +09:00
Ignacio SicaGitHubchenyu
 		b240f12593 [TIP-9] rename Opt's amt to arg 2 (#8770) 
* rename Opt amt to arg

* ignore_beam_cache for test_tiny

* move ignore_beam_cache to test_tiny

* move to separate pr

* revert space change

---------

Co-authored-by: chenyu <[email protected]>
 2025-01-27 14:19:04 -05:00
George HotzandGitHub 3ed146a5ff Revert "rename Opt amt to arg (#8767)" (#8769) 
This reverts commit bf041659a5.
 2025-01-27 23:46:37 +09:00
Ignacio SicaandGitHub bf041659a5 rename Opt amt to arg (#8767) 2025-01-27 23:36:47 +09:00
George HotzandGitHub 98d01a059d rename uopgraph to rewriter [pr] (#8682) 2025-01-19 17:03:12 -08:00
qazalandGitHub 586e730d32 use UOp.st for kernel reduce axes (#8499) 
* use UOp.st for kernel reduce axes [pr]

* do not return dict
 2025-01-13 06:24:11 -05:00
qazalandGitHub 79738d768c do not require PYTHONPATH=. for process replay [pr] (#8567) 2025-01-11 09:45:34 -05:00
qazalandGitHub 60503c8621 use CAPTURE_PROCESS_REPLAY=1 in CI [pr] (#8564) 2025-01-11 06:03:48 -05:00
chenyuandGitHub 6c639dee5c more informative kernel opt error messages [pr] (#8487) 2025-01-03 14:29:36 -05:00
qazalandGitHub 96f2a83a62 has_st shouldn't exist anymore [pr] (#8446) 
* has_st shouldn't exist anymore [pr]

* const also shouldn't be there
 2024-12-30 18:52:18 +08:00