geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions 3 Activity
12,045 Commits 4 Branches 15 Tags
f9cfb64cd94dea5b734f492922064722cbdf4880
Commit Graph
160 Commits
Author SHA1 Message Date
sirhcmandGitHub 2931b52875 skip autogen if MTLCompiler is loaded (#14466) 2026-02-01 22:12:27 -05:00
nimlgenandGitHub 486d53d646 device: call free for external_ptr (#14448) 
* device: call free for external_ptr

* lin
 2026-01-30 23:53:17 +03:00
nimlgenandGitHub 26220a472e no core_id (#14265) 
* no core_id

* kwargs

* est

* linters

* ugh

* revert this

* deps

* glb

* should work?

* nn

* line

* fx

* ym

* z

* d

* um?

* revert

* this one?

* first half

* um p2

* all?

* um

* cleaner

* um
 2026-01-23 21:30:12 +03:00
qazalandGitHub b1c5a242b7 Revert "move is_dtype_supported logic to renderer (#14188)" (#14237) 
This reverts commit 161fee9a48.
 2026-01-20 12:19:14 +09:00
sirhcmandGitHub 161fee9a48 move is_dtype_supported logic to renderer (#14188) 
* move is_dtype_supported logic to renderer

* fix CPU_COUNT

* mypy happy

* early import libclang too with llvm

* run with debug

* skip autogen tests if MTLCompiler or llvm is loaded

* run autogen tests separately in CI

* lint
 2026-01-18 22:37:04 -05:00
chenyuandGitHub fcbb896e05 remove unused to_struct [pr] (#13973) 2026-01-02 08:54:57 -05:00
nimlgenandGitHub 77a76d1b13 device: respect compiler ContextVars (#13523) 
* device: envvars for cc

* fix

* fix

* x

* um

* fix

* remote

* em

* cleanup

* typing

* fix

* debug

* lvp?

* ugh

* singl

* rm

* lol

* fix

* ?

* this?

* why?

* rev

* mod test

* l
 2025-12-02 14:42:04 +03:00
sirhcmGitHubGeorge Hotz
 		d1bb08c5a1 In-tree autogen: objective c (#13223) 
* checkout changes from autogen branch

* move assert

---------

Co-authored-by: George Hotz <[email protected]>
 2025-11-14 14:08:42 -08:00
nimlgenandGitHub fb96394ff5 auto-select available compilers (#12094) 
* device: auto select compilers

* fix

* metal+opencl

* nv/cuda

* test without ptx

* ptx

* fix tests

* fix

* fix test

* rename

* test + cleaner

* xx

* ops

* better test

* win?

* um?

* types

* debug

* win??

* sep rung

* wtf?

* debug

* skip win

* revert this

* types
 2025-09-10 19:52:01 +03:00
nimlgenandGitHub 8a7be0a747 metal: workaround for transfers sync issue (#11622) 
* metal: workaround for transfers sync issue

* metal tracsfer sync is broken

* hm

* rm it?

* keep it
 2025-08-12 16:16:34 +03:00
nimlgenandGitHub a5371f514b cpu: copies in profile (#11392) 
* cpu: copies in profile

* fix

* rename to tiny?
 2025-07-27 20:56:27 +03:00
qazalandGitHub 3466a220de viz: disassembly viewer (#11393) 
* test

* CPU=1 disasm works

* METAL=1 disasm works

* fix that

* work

* can unwrap

* work p2

* don't crash
 2025-07-27 18:44:28 +03:00
chenyuandGitHub 54924f9969 type remove Union and Optional [pr] (#11283) 
use `|` for consistency
 2025-07-19 14:05:52 -04:00
qazalandGitHub bde80c0cdf record GraphEvents in metal graph (#11145) 
* record GraphEvents in metal graph

* add TestProfiler.test_graph, revert old stuff

* move profile capture to MetalGraph

* comment

* don't double record graph command buffers

* wait_check

* explicit delete
 2025-07-10 21:32:06 +03:00
Pyry KovanenandGitHub 32117402dd metal: fix incorrect _free on interpreter exit (#11158) 2025-07-10 14:01:30 +03:00
qazalandGitHub 3dfc0ff887 move cpu_profile and shared ProfileEvents from device.py to helpers [pr] (#11126) 
* move cpu_profile and shared ProfileEvents to helpers [pr]

* TestProfiler.test_cpu_profile

* update test_viz.py

* TestProfiler.test_profile_multiops ordering, it's different streams now
 2025-07-08 12:14:03 +03:00
simone-pietroandGitHub 58252e3c49 Change type hint for init_c_struct_t and to_struct [pr] (#10878) 
* Change type hint for init_c_struct_t

* Change type hint for to_struct
 2025-06-19 13:22:44 +03:00
geohot 4b1f1a47bb hotfix: allow ModuleNotFoundError in metal llvm import 2025-05-18 20:46:31 -07:00
uuuvnandGitHub 7bc4864bc4 Make dev a property of Allocator (#10286) 
* Make `dev` a property of `Allocator`

(this is a prereq refactor for #10285)

At least `BufferXfer.copy` accesses it assuming it's always present,
currently most devices just add this property on their own repeating
the same code over and over again.

This is also a bit footguny, see `RemoteAllocator` that named this
property `device` instead of `dev`, i could obviously just change that
in one place but doing it globally seems like a better solution (and it
reduces code duplication too).

`MallocAllocator` is a bit special, but passing `None` works just fine.

* typing

* ignore type instead of cast
 2025-05-13 17:01:01 -07:00
uuuvnandGitHub 82a6160ff7 Detect metal paravirtualization bug via device name instead of CI (#10225) 2025-05-08 19:31:47 -07:00
uuuvnandGitHub dba073e5c0 Less messy broken graph on paravirtualized metal workaround (#10182) 
* Less messy broken graph on paravirtualized metal workaround

GitHub CI macOS runners use paravirtualized metal which is broken with
graph (some comments say that ICB in particular is broken but in my
testing it was fine sometimes, but other times hitting an assert inside
metal's code related to resouces, so not sure).

> Assertion failed: (resource != nil), function -[IOGPUMetalResource initWithResource:], file IOGPUMetalResource.m, line 458.

This can be reproduced locally with any virtualization software (like utm)
that can create macOS VMs with apple's own virtualization framework.

* unused import
 2025-05-06 20:41:02 +03:00
George HotzandGitHub 5c7b549eab use functools.cache instead of lru_cache(None) [pr] (#9714) 
* use functools.cache instead of lru_cache(None) [pr]

* more cache
 2025-04-03 11:47:13 +08:00
nimlgenGitHubgeohot
 		56288243e6 metal PyTorch interop (#9229) 
* add from_blob support to mps cuda

* objc_id

* metal pytorch interop

* fix comments

---------

Co-authored-by: George Hotz <[email protected]>
 2025-02-24 22:36:08 +03:00
nimlgenandGitHub f986e12f91 metal: choose compile spec based on macos (#9188) 
* metal: choose compile spec based on macos

* correction
 2025-02-21 00:43:39 +03:00
uuuvnandGitHub 9b9c1e14da Late MTLCompiler load (#8963) 
Moved loading MTLCompiler (and trying to load normal llvm before it)
to MetalCompiler, like in CPUProgram with helper
 2025-02-08 17:29:23 +08:00
uuuvnandGitHub 6090cbe3be Try to open llvm first when opening metal (#8949) 
* Try to open llvm first when opening metal

* Use more specific FileNotFoundError
 2025-02-07 18:58:37 +08:00
uuuvnandGitHub 67b70e4f6c Fix incorrect __del__ (#8950) 
CPython doesn't make any guarantees about order in which globals like
`msg` or `libobjc` are destroyed when the interpreter shuts down

https://github.com/tinygrad/tinygrad/pull/8949 triggered the
unlucky ordering which lead to a bunch of errors at exit

There is also a bunch of other places where similar problems exist
 2025-02-07 18:21:44 +08:00
George HotzandGitHub 1249e8dd3b objc fast msg, try 2 [pr] (#8927) 2025-02-06 19:06:21 +08:00
George HotzandGitHub 1c53e8bf27 Revert "objc fast msg (#8922)" (#8926) 
This reverts commit c3f99a727e.
 2025-02-06 17:50:49 +08:00
George HotzandGitHub c3f99a727e objc fast msg (#8922) 
* benchmark kernel launch

* don't realize unneeded

* faster

* faster metal

* fix mypy

* new objc message style [pr]

* without sync

* no div 0

* lru cache that

* no sync in the profile

* fix

* update all to new style

* remove comment

* graph one kernel

* fix graph one kernel

* remove that sync
 2025-02-06 17:49:06 +08:00
George HotzandGitHub a8e54df363 benchmark single kernel launch (#8921) 
* benchmark kernel launch

* don't realize unneeded

* faster

* faster metal

* fix mypy

* without sync

* no div 0

* lru cache that

* no sync in the profile
 2025-02-06 13:35:34 +08:00
nimlgenandGitHub 5afb0a4a81 metal: fix transfer profiling (#8659) 2025-01-17 23:47:01 +03:00
uuuvnandGitHub 615d5276b1 Suppress 'X warnings generated.' in MTLCompiler (#8489) 
'-fno-caret-diagnostics' is what clang-tidy uses when user passes --quiet
 2025-01-04 10:22:37 -05:00
chenyuandGitHub 7ea633f94f remove from __future__ import annotations from runtimes [pr] (#8373) 
it's not needed if we move the Device before Program and Allocator, which need Device.

not updating hcq because it has a lot more stuff, and CLDevice requires CLDevice
 2024-12-21 23:46:07 -05:00
George HotzandGitHub 9c77e9f9b7 replace Tuple with tuple [pr] (#8344) 
* replace Tuple with tuple [pr]

* replace List with list [pr]

* replace Dict with dict [pr]

* replace Set with set [pr]
 2024-12-19 21:27:56 -08:00
nimlgenandGitHub 777d2aec05 metal profiler + cpu_profile (#8291) 
* metal + cpu_profile

* gpt example

* linter + revert gpt2 for now

* a bit of readme

* linter

* unrelated

* tests

* linter

* b
 2024-12-18 00:06:56 +03:00
chenyuandGitHub 2e4c7d4cfb add "tinygrad" to be part of cache_dir [pr] (#8188) 
instead of having sqlite / http download / metal compile to add "tinygrad" separately. also make it non-private since it's used in metal
 2024-12-12 12:09:44 -05:00
nimlgenandGitHub e180a31c5e tiny metal cleanup (#8089) 
* tiny metal cleanup

* cast

* sry
 2024-12-06 21:44:32 +03:00
uuuvnGitHubGeorge Hotz
 		e9c5b23ba1 Use MTLCompiler directly (v2) (#7920) 
* Use MTLCompiler directly (v2)

* to_block_literal and REQUEST_TYPE_COMPILE

* Rewrite command encoding

* Revert to_block_literal

* Maybe that's more readable to some people?

* Typo and comment about stdlib caching

* Update ops_metal.py

* Update ops_metal.py

* Update ops_metal.py

---------

Co-authored-by: George Hotz <[email protected]>
 2024-12-04 16:36:48 +08:00
chenyuandGitHub 04bee97d2a hotfix ctypes.c_ulong(size) for metal _alloc (#7902) 
fix `Tensor.ones(1000, 1000, 1000).contiguous().realize()` on METAL
 2024-11-25 18:25:33 -05:00
George HotzandGitHub eb0bb7dc0b final dname to device [pr] (#7806) 
* final dname to device [pr]

* oops, fix nv
 2024-11-20 20:20:28 +08:00
George HotzandGitHub 6688539bc9 rename device to dev so Buffer can be Allocator [pr] (#7799) 
* rename device to dev to Buffer can be Allocator [pr]

* missed those

* update the Program classes also

* more renames

* oops
 2024-11-20 15:47:26 +08:00
George HotzandGitHub 913a27ee27 from_buffer on metal was never called [pr] (#7791) 2024-11-20 00:35:17 +08:00
George HotzandGitHub d71fe7faa5 rename allocator methods to not conflict [pr] (#7788) 
* rename allocator methods to not conflict [pr]

* forgot those

* transfer + offset
 2024-11-20 00:10:29 +08:00
chenyuandGitHub 573f145dcf METAL raise RuntimeError with no compiler and bad src (#7603) 
fixed BEAM if src is invalid on METAL. it currently only accept RuntimeError in `_time_program`
 2024-11-08 17:09:12 -05:00
George HotzandGitHub 6bb230287b pass the src into Metal [pr] (#7518) 
* pass the src into Metal [pr]

* put that comment back

* keep old functionality

* move all to disassembler

* metal supports parallel beam

* touchups

* comment in correct place
 2024-11-04 12:35:30 +08:00
chenyuandGitHub 6021bf87f4 unify T = TypeVar("T") (#7342) 2024-10-28 18:43:44 -04:00
George HotzandGitHub 9f32a6f496 Revert "move metal tc check to renderer [pr] (#7248)" (#7251) 
This reverts commit 72ddcdb4d1.
 2024-10-24 10:57:09 +08:00
George HotzandGitHub 72ddcdb4d1 move metal tc check to renderer [pr] (#7248) 2024-10-24 10:38:57 +08:00
mesozoic-eggGitHubMesozoic Egg
 		0e8bcda07e get readable error from wait_check (#6965) 
Co-authored-by: Mesozoic Egg <[email protected]>
 2024-10-09 17:28:58 +03:00