sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 6 Activity
11,106 Commits 336 Branches 15 Tags
python_speed
Commit Graph
11106 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ignacio SicaGitHubGeorge Hotz
 		956a8391a5 minor cleanup on test_tensor_core_opts tests (#10924) 
* minor cleanup on test_tensor_core_opts tests

Tests now notify when skipped
Before, they silently skipped if backend didn't had half precision and
accumulation
Also cleaned up atol and rtol setup

* refactor test_tensor_core_opts_group

---------

Co-authored-by: George Hotz <[email protected]>
 2025-06-23 16:30:21 -07:00
ttomsaandGitHub 897e42fd1b change clang -march flag to -mcpu on arm (#10841) 
* change clang -march flag to -mcpu with fp16 disassembly test

* fix

* add capstone to macos dependencies

* just check no cast in test

* rm import

* woops

* lets check

* move check

* llvm init before cpu chcek

* try this

* bump autogen llvm version

* also update libclang?

* revert

* add comment

* skip llvm test and add comment

* linter
 2025-06-23 16:28:48 -07:00
Sieds LyklesandGitHub 772cd02ad2 Perform index validation on load/store, not on the index (#10849) 
* move index validation to load/stores

* add name

* add linearizer_failure

* add validate_store with implicit gates

* linearizer_failure_58 is fixed!

* add test_uop_graph test

* rename cond to gate

* test gated load/stores

* use or_casted()
 2025-06-23 16:25:05 -07:00
geohot ae4d2d71b4 bump line count to 14500 2025-06-23 15:32:27 -07:00
Harsh NatuskarandGitHub 79d7cdd9ba Fix device (#10929) 
* fix: pkg

* better

* added test

* less lines
 2025-06-23 15:30:19 -07:00
George HotzandGitHub e15754db28 remove (some) kernelize from llama and test schedule speed (#10939) 
* remove kernelize from llama

* 405B

* space
 2025-06-23 15:07:31 -07:00
chenyuandGitHub 3699d1d3ba hotfix llama3 temperature is float (#10938) 2025-06-23 15:20:56 -04:00
uuuvnandGitHub 4e2c9e36c7 Remote multihost (p2p transfer) (#10601) 2025-06-23 11:47:29 -07:00
chenyuandGitHub 42b1c9625b skip test TestKiTS19Dataset::test_training_set (#10936) 
flaky
 2025-06-23 14:27:24 -04:00
patrini32GitHubwozeparrot
 		9e9fd44987 refactor test/external/external_llama_eval.py (#10567) 
Co-authored-by: wozeparrot <[email protected]>
 2025-06-23 10:43:20 -07:00
chenyuandGitHub 785b4ea8ac optim flatten().shape[0] is numel (#10935) 2025-06-23 13:11:19 -04:00
qazalandGitHub ac39f27ae6 viz: non blocking UOp tracing (#10913) 
* viz: non blocking UOp tracing

* u.arg

* no if Ops.KENREL

* drop replace

* switch to weakref.WeakKeyDictionary

* back

* remove ram usage skips, viz works here

* cache on reconstruct
 2025-06-23 19:59:28 +03:00
Ignacio SicaandGitHub b8d09a1dae tc with group/grouptop (#10903) 2025-06-23 09:58:41 -07:00
qazalandGitHub 9944c2c02d viz: show time taken on hover (#10934) 2025-06-23 19:00:40 +03:00
geohot 1e99a7f1c9 hotfix: don't viz the indexing rewrites 2025-06-23 08:20:26 -07:00
chenyuandGitHub f9b59924f1 OPTIM_DTYPE to specify dtype for optim params (#10925) 
one more flag
 2025-06-23 10:32:03 -04:00
qazalandGitHub 7820aeca8e update codegen process replay to use get_program [pr] (#10921) 
* update codegen process replay to get_program [pr]

* precommit

* try str replace

* +to_function_name

* fixup tc

* local2.sh

* fix openpilot NOLOCALS

* new local.sh

* correct merge

* beam cache

* back

* revert beam thing

* adding opts_override and name_override makes output of get_program
reproducible

* min diff
 2025-06-23 17:31:41 +03:00
nimlgenandGitHub eceb7a00d2 nv: rename iface mem functions (#10931) 2025-06-23 16:34:51 +03:00
qazalandGitHub 4e864bd304 fix: getenv("NOLOCALS")/NOLOCALS context var (#10927) 
OptOps shouldn't rely on os.environ.
 2025-06-23 11:23:59 +03:00
alpharushandGitHub 22f9696522 Fix/hcqfuzz harnesss bug (#10923) 
* update command so extra module is found

* fix empty range in randrange errors

* lint
 2025-06-23 11:22:30 +03:00
qazalandGitHub f037f85532 s/getenv("TC")/USE_TC context var (#10922) 2025-06-23 00:39:45 +03:00
qazalandGitHub 9201224e0b viz: remove Kernel check [pr] (#10920) 
* viz: remove Kernel check [pr]

* TestVizIntegration

* test/unit allows opening of devices

* kernel -> Kernel
 2025-06-22 20:47:54 +03:00
nimlgenandGitHub 3ccdb2356b system: factor out PCIIfaceBase (#10917) 
* system: factor out PCIIfaceBase

* linter

* typing
 2025-06-22 20:03:14 +03:00
George HotzandGitHub b09c47366f opt transforms the ast into an optimized ast (#10900) 
* opt transforms the ast into an optimized ast

* fix get_kernel order and to_function_name

* function_name property

* update docs

* copy from kernel.py

* improve docs

* ci didn't trigger?
 2025-06-22 09:41:26 -07:00
qazalandGitHub ffddf165f8 viz: color by kernel names in profiler (#10919) 
* viz: color by kernel names in profiler

* ellipsis stays in bounds
 2025-06-22 18:07:52 +03:00
nimlgenandGitHub 36536ef6f0 nv: minor changes from nvpci (#10918) 2025-06-22 18:04:39 +03:00
geohotstanandGitHub 4ab7d792cc ONNX improve dtype fallback (#10800) 
* fix

* add early verbose demo test

* is this how to write tests :s

* is definition drift even a thing? gemini says it is

* clean up

* better

* even better

* try add to CI

* doesn't work quite yet

* much more work to be done

* whoops

* partition the test heh

* skipif

* some nits for better names

* add webgpu test for onnxrunner

* fix reference links

* flush for now
 2025-06-21 19:29:45 -04:00
chenyuandGitHub 0480139def log_perplexity metrics (#10912) 2025-06-21 10:44:47 -04:00
nimlgenandGitHub 0e7bd9fd03 factor out generic MemoryManager (#10910) 
* allocator -> memory

* just moveout it

* mm is abstracted

* need entry abstraction

* fix

* mypy
 2025-06-21 16:18:33 +03:00
qazalandGitHub c7ec913210 viz: cleanup unit tests (#10909) 
* cleanup test_viz

* tree view
 2025-06-21 12:35:09 +03:00
chenyuandGitHub 1373071f19 simplify logcumsumexp (#10908) 
clarify and remove some flatten and squeeze/unsqueeze
 2025-06-20 22:56:42 -04:00
George HotzandGitHub fa52bdb50f applied_opts is in the optimized ast] (#10906) 2025-06-20 18:56:23 -07:00
chenyuandGitHub 2d9c61e39e test more dims in test_logsumexp and test_logcumsumexp (#10907) 
refactoring squeeze and unsqueeze is easy to get wrong
 2025-06-20 21:42:18 -04:00
Nino RisteskiandGitHub 3771cc0f77 fix test logcumsumexp broken devectorize=0 (#10880) 
* fix test logcumsumexp numerical

* lint

* Use dtypes.min instead of -1e4
 2025-06-20 20:54:50 -04:00
George HotzandGitHub 7636d2cdc5 flip order of get_program args (#10905) 2025-06-20 17:23:23 -07:00
George HotzandGitHub 1ce63f8d04 move functions to view and update docs [pr] (#10904) 
* move functions to view and update docs [pr]

* move quantize
 2025-06-20 16:47:58 -07:00
George HotzandGitHub b41e0563a3 move stuff to kernelize folder (#10902) 
* move stuff to kernelize folder

* oops, forgot that
 2025-06-20 16:10:20 -07:00
George HotzandGitHub d399a4587d move mem estimate to ProgramSpec [pr] (#10901) 2025-06-20 15:54:28 -07:00
George HotzandGitHub 92678e59ee move kernel to opt (#10899) 2025-06-20 15:22:28 -07:00
nimlgenandGitHub bb0299b9e5 system: shared pci logic (#10894) 
* moveout pci logic

* fixes

* oops

* types

* more type

* one style

* thi is imp
 2025-06-21 00:09:49 +03:00
nimlgenandGitHub c83fdc50d1 nv: driver iface (#10895) 
* nv: driver iface

* fixes

* ops

* not used anymore

* fix mypy

* too long

* fix

* fixed

* mypy

* ugh, it's misc

* rename to NVK
 2025-06-20 22:36:08 +03:00
George HotzandGitHub fc9f883870 if upat returns self, it's none (#10898) 
* if upat returns self, it's none

* fix pm tests
 2025-06-20 12:11:19 -07:00
qazalandGitHub 4f179b9ddb viz: gate launch behind a ContextVar [pr] (#10892) 2025-06-20 17:30:32 +03:00
chenyuandGitHub 3f29c7edda minor onnx dropout cleanup (#10891) 
we should consider removing numpy random and test it similar to test_randomness, unless how seed works is part of spec?
 2025-06-20 10:18:34 -04:00
simone-pietroandGitHub e94ac6e20c Cast ptr to int in test_from_mv_to_mv (#10876) 
* Cast ptr to int in test_from_mv_to_mv

* Add type hints for from_mv
 2025-06-20 14:52:34 +03:00
qazalandGitHub 000eb30f04 viz: remove prev profiler file (#10888) 
The new profiler is integrated in the main VIZ tab.

Will also delete perfetto.html after matching [final features](https://github.com/tinygrad/tinygrad/pull/10763#issuecomment-2980543715) soon.
 2025-06-19 23:05:46 +03:00
chenyuandGitHub 62a540066e remove DEBUG=2 in mi300x bert setup (#10886) 
seems fine now, not sure what the issue was
 2025-06-19 13:28:53 -04:00
Nino RisteskiandGitHub 5a56710ff4 small fix replacing download_file with fetch (#10877) 
* imported a missing os and replaced download_file with fetch from tg helpers

* use fetch directly

* Remove if not os.path.isfile
 2025-06-19 12:12:09 -04:00
chenyuandGitHub 8d721a4ead add 405B params to llama3.py (#10884) 
tested with `python examples/llama3.py --model /raid/weights/llama31_405b/ --size 405B --shard 8 --benchmark` on tinyamd2
 2025-06-19 11:45:37 -04:00
chenyuandGitHub a3dae51085 lower test_gemm_8192 on red (#10883) 2025-06-19 10:01:25 -04:00