sirhcm/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests 2 Actions 4 Activity
14,216 Commits 336 Branches 15 Tags
more_kernelcount
Commit Graph
121 Commits
Author SHA1 Message Date
chenyuandGitHub a60b5f77ac fix torch backend out= into a view (#17210) 2026-07-25 21:04:42 -04:00
chenyuandGitHub 076b37e1ae failing batch norm test (#17206) 
* failing batch norm test

running stats does not schedule in training now since there's no reader

* not that
 2026-07-25 18:46:49 -04:00
chenyuandGitHub f902513355 derive torch backend dispatch from the aten schema (#17203) 2026-07-25 14:21:38 -04:00
chenyuandGitHub 983ad3bd95 fix torch backend batchnorm backward (#17201) 2026-07-25 13:15:09 -04:00
chenyuandGitHub 9f78504304 checked cast in torch backend unwrap (#17199) 2026-07-25 12:34:08 -04:00
chenyuandGitHub 8a10892f5a fix torch backend as_strided (#17195) 
0 means 0 offset
 2026-07-25 02:24:17 -04:00
chenyuandGitHub 4c58b260fb less wrong calculate_storage_offset (#17194) 
initially for speed, then realized it's just wrong
 2026-07-25 01:53:54 -04:00
chenyuandGitHub 9970a0aad0 fix Tensor << Tensor for x86 (#17082) 
* fix Tensor << Tensor for x86

* torch
 2026-07-19 12:31:05 -04:00
sirhcmandGitHub c759301865 ci: cleanup torch backend tests (#16750) 2026-06-25 14:39:36 -04:00
George HotzandGitHub aef85ddc4d addrspace special/range (#16647) 
* addrspace special/range

* just include indexing

* define var is alu

* bring old ignore indexing back

* mults to fix

* fixes

* ALU

* fixes
 2026-06-17 15:57:37 -07:00
George HotzandGitHub 7e6d617935 addrspace cleanups (#16565) 
* addrspace cleanups

* bumps

* eh, relax a little
 2026-06-10 15:57:18 -07:00
chenyuandGitHub 2c915c61ed no CONST(DEVICE) in torch_backend (#16499) 2026-06-04 00:26:47 -04:00
chenyuandGitHub 8a4203638a make full with buffer=False deviceless (#16483) 
affects arange and eye
 2026-06-03 12:35:59 -04:00
chenyuandGitHub 7e7b481ba7 less CONST(DEVICE) (#16452) 
* less CONST(DEVICE)

no DEVICE for single device in const_like, multi has other issues

* maybe

* that?
 2026-06-01 15:55:12 -04:00
sirhcmandGitHub 434cfa96a3 ci: no fetch in backend tests (#16438) 
should make for less actions cache thrashing
 2026-05-29 17:11:16 -04:00
George HotzandGitHub edca5df25a flip offset and shape in pad and shrink (#16414) 
* flip offset and shape in pad and shrink

* dumb test
 2026-05-28 11:58:19 -07:00
George HotzandGitHub 8ee3a37524 shrink/pad use (new_shape, offset) (#16405) 
* shrink uses offset and shape

* pad does too

* fix
 2026-05-27 15:13:08 -07:00
chenyuandGitHub c33b767407 bring back test and torch backend change for unique const (#16403) 2026-05-27 15:16:08 -04:00
chenyuandGitHub 945ed4f689 revert const unique changes (#16395) 2026-05-27 00:06:41 -04:00
chenyuandGitHub d861c50dce remove unique_const (#16382) 2026-05-26 13:53:31 -04:00
chenyuandGitHub 9b00defc8c Revert "remove unique_const (#16372)" (#16380) 
This reverts commit 09019d6761.
 2026-05-26 12:30:07 -04:00
chenyuandGitHub 09019d6761 remove unique_const (#16372) 
* remove unique_const

* fix SDWA thing

* that?
 2026-05-26 12:18:03 -04:00
chenyuandGitHub 31424cda71 Tensor.requires_grad -> is_param (#16325) 
for optimizer
 2026-05-21 19:39:57 -04:00
chenyuandGitHub 409bb0c9ad requires_grad cannot be None (#16212) 
final goal is to remove requires_grad, first change the default to True, and don't allow None
 2026-05-15 02:01:04 -04:00
chenyuandGitHub 3942a80f66 fix wrong kwargs passed into rands (#16149) 
working towards explicit args for these
 2026-05-11 22:22:06 -04:00
Vikram RangarajanandGitHub effa263865 Torch backend aten::cat.out fix (#16121) 
* Handle empty 1D tensors in cat_out

* Undid other changes

* Fixed torch cat

* Improved cat.out, added more tests

* Cleaned code

* Type hinted dim

* Removed whitespace
 2026-05-11 16:28:16 -07:00
George HotzandGitHub d1cce7a476 put the ranges on store instead of after (#15759) 
* put the ranges on store instead of after

* better assert

* fix stuff

* comment out slow rules i don't understand

* simpler rule

* closer

* return false for store

* fix loop

* only a few schedule failures remain

* remove stores to self

* all tests pass locally

* remove junk

* regression test and fix

* better test, bump broken torch count

* bugfix with regression test

* new fusion is better
 2026-04-16 19:06:40 +08:00
chenyuandGitHub 1483f7e71c support shift by Tensor (#15623) 
* support shift by Tensor

* use mixin
 2026-04-06 15:14:57 -04:00
chenyuandGitHub 6e30a5f5ea update shifts in torch backend (#15622) 2026-04-06 14:08:33 -04:00
wozeparrotandGitHub b45edeb965 fix: rand supports large tensors (#15329) 2026-03-17 15:45:41 -07:00
chenyuandGitHub 842c978df3 remove staticmethod dtypes.max/min (#15227) 
always use x.dtype.max/min
 2026-03-11 23:11:24 -04:00
Roelof van DijkandGitHub d65923bda5 tensor.py: add normalize function (#15159) 
* tensor.py: add normalize function

* p==0 should match torch
 2026-03-05 18:55:53 +08:00
chenyuandGitHub 71f228f80f test exact kernel count in torch_backend/test_kernel_fusion (#15091) 2026-03-02 14:26:32 -05:00
George HotzandGitHub 8ef5544e4a realized PYTHON copies (#14934) 
* realized PYTHON copies

* comment that out

* fix that test

* append afters

* contig

* disk copies

* should be 124

* 332
 2026-02-21 20:29:31 +08:00
George HotzandGitHub 55d3a5def9 preallocate all realized buffers (#14823) 
* preallocate all realized buffers

* contiguous

* work

* comment that out

* move to schedule

* better

* correct fix

* just buffer

* disk bufs

* fixes disk tensor stuff

* fix symbolic stuff

* fix multi

* 162 failures

* bugfixes

* don't check that anymore

* fix schedule tests

* mnist should be contiguious

* type and buffer

* fix tests

* shrink axis correction

* mypy fixes

* tests skips

* same 37 failures

* dedup

* no shrink in the graph

* 29 failures

* skips

* fix custom kernel

* fix training

* those optimizations aren't supported currently

* simpler

* more correct

* tests

* 14 failures

* works

* fix that test

* broken

* 11 failures

* only kernel counts left

* fixes

* all tests pass

* remove tensor_map

* op test

* 200 -> 230

* test fixes

* fixes

* revert test_tiny thing

* guard

* revert that

* test tiny passes

* no contigs there

* base realize back

* Revert "no contigs there"

This reverts commit c45bb9fcfd.

* revert that

* chop many assigns

* 12 failures

* fix tests

* tests

* apply after

* pre-commit

* remove old code

* delete that

* fix types

* remove extra contig

* fix dataloader

* torch fix

* disk fix

* update kernel fusion numbres

* runs on amd

* restore kernel count

* add that rule back

* that

* disable that

* wrong

* add the correct rule for that folding

* more tests

* guard c1.arg

* no newlines

* realize those

* split into a different file

* remove detach/contig back

* skip 2

* update that
 2026-02-20 20:05:54 +08:00
chenyuandGitHub 9052db678f remove allow_shape_mismatch in Tensor.replace (#14536) 
move all logic to torch_backend and not hacking Tensor method
 2026-02-04 12:38:18 -05:00
chenyuandGitHub 67f91e897b UOp.is_contiguous -> UOp.has_buffer_identity [pr] (#14530) 
one more confusing buffer related method, but it's definitely not is_contiguous
 2026-02-04 09:21:26 -05:00
chenyuandGitHub e3601788fa update torch backend function (#14333) 
those have tensor.py implementation
 2026-01-25 16:39:34 -05:00
chenyuandGitHub 986e865830 fix TINY_BACKEND=1 cumsum (#14138) 
* fix TINY_BACKEND=1 cumsum

old hack was wrong, need to apply contiguous on the input

* test time

* test_linalg_svd is slow
 2026-01-14 09:54:49 -05:00
chenyuandGitHub fe00682502 clean up svd tests (#14133) 
removed from test_ops and added to TestTorchBackend
 2026-01-13 16:32:21 -05:00
chenyuandGitHub e610821c52 Tensor.cummin and Tensor.nonzero (#14131) 2026-01-13 15:09:56 -05:00
chenyuandGitHub 176a934ddd Tensor.diagonal support offset and dims (#14130) 2026-01-13 14:49:06 -05:00
chenyuandGitHub 2a217ba206 tinybackend isin and log10 (#14120) 
can use tinygrad directly
 2026-01-13 14:14:09 -05:00
chenyuandGitHub 05fcb57696 also return index in Tensor.cummax (#14117) 
* also return index in Tensor.cummax

* fix
 2026-01-12 22:42:10 -05:00
Roelof van DijkandGitHub 1058748440 torch backend: no aten.detach for torch 2.10 compat (#13381) 
* this works, less cpp?

* simpler = better

* keep torch 2.9 working as well
 2025-11-20 09:12:15 -08:00
Roelof van DijkGitHubGeorge Hotz
 		0dc2ff431d fix: revive torch backend (#13280) 
* fix: revive torch backend

* as_strided view vs copy

* Revert "as_strided view vs copy"

This reverts commit 82a61223f2.

* add extra tests (move inplace, add fusion tests)

* better fusion with inplace_op

* no optimizer hooks (break mnist training fusion)

* split off fusion tests in separate file, assert on resnet fusion

fix: remove comments

* cleanup, reduce diff

* reduce diff

* better fusion and identity checks

---------

Co-authored-by: George Hotz <[email protected]>
 2025-11-19 15:26:50 -08:00
DanielGitHubchenyu
 		d65bd669f8 update tiny torch backend hook (#12575) 
* update the backend to fix torch deprecation warning

* use param_hook to avoid full backward hook needlessly firing on inputs which do not require gradients

* fix indentation

---------

Co-authored-by: chenyu <[email protected]>
 2025-10-15 14:02:33 -04:00
George HotzandGitHub fb61f3519f remove assign contiguous hack (#12659) 
* remove assign contiguous hack

* remove bad contiguous usage in torch backend

* assign
 2025-10-14 16:42:14 +08:00
chenyuandGitHub e701106a64 remove FUSE_ARANGE (#12511) 
it was the default already
 2025-10-08 04:54:07 -04:00
George HotzandGitHub 0f25b4b289 move frontend dir to nn [pr] (#12470) 2025-10-07 10:42:22 +08:00