nimlgen/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Activity
11,453 Commits 334 Branches 15 Tags
remove_programspec
Commit Graph
1427 Commits
Author SHA1 Message Date
geohot d3feea302d much cleaner way to write onnx ops 2023-02-24 08:46:28 -08:00
geohot f6d946853c more bugfixes 2023-02-24 00:21:29 -08:00
geohot b1b2d8f440 onnx : some op tests working 2023-02-23 23:58:13 -08:00
geohot b287b1d529 fix yolov8 to get to ConvTranspose 2023-02-23 22:46:48 -08:00
geohot 2d59b25ead onnx backend test : enable only the model tests 2023-02-23 22:36:26 -08:00
geohot d8b6f241f1 external_test_onnx_backend 2023-02-23 21:55:07 -08:00
SohaibGitHubSohaib Errabii
 		8835df7a5c upgrade onnx to 1.13.0 (#588) 
- remove protobuf from direct dependencies
- replace deprecated mapping.TENSOR_TYPE_TO_NP_TYPE

Co-authored-by: Sohaib Errabii <[email protected]>
 2023-02-23 13:59:23 -08:00
calleditandGitHub 81f7c6800a Added info on simdgroup availability (#586) 
* Add info on simdgroup availability

* "osx" not "os x"

* Update metal_matmul.py

* Update metal_matmul.py
 2023-02-23 13:59:02 -08:00
geohot d22e19536b onnx: support low quality Resize. stuck on ConvTranspose will have to wait for convless 2023-02-23 09:05:23 -08:00
geohot ab3a2ae9a2 fix test_resnet in onnx now that maxpool works 2023-02-23 08:41:47 -08:00
geohot fd6082dcef support all _pool2d. conv will eventually be an hlop 2023-02-23 08:19:47 -08:00
George Hotz 76b4d0577d yolov8 works up to the MaxPool 2023-02-22 19:32:13 -08:00
George HotzandGitHub c4c2c28738 a sustainable approach to float4 (#582) 
* a sustainable approach to float4

* can_float4

* fix tests

* fix float4

* delete dead code

* types and minor cleanup
 2023-02-22 09:45:08 -08:00
geohot c5e2126d49 move DEBUG to helpers 2023-02-22 06:52:11 -08:00
geohot 4d232c7c95 optional networkx + DEBUGCL=2 2023-02-20 09:50:46 -08:00
geohot bbfec2fde7 8.46 TFLOPS 2023-02-19 13:21:25 -08:00
geohot 1ba847963d reshape and retain metal_matmul 2023-02-19 13:07:23 -08:00
KirillandGitHub 7944cfdadc Remove Tensor.data (#565) 2023-02-18 16:36:12 -08:00
Jacky LeeandGitHub 9fd41632c6 Import get_parameters from tinygrad.nn (#559) 
* get_parameter is in optim

* Update all imports for get_parameters

* Clean up

* use optim.get_paramters
 2023-02-17 15:22:26 -08:00
geohot 82c257e8f5 more kernel search 2023-02-12 10:34:56 -08:00
geohot de71c13934 test speed v torch uses jit 2023-02-12 07:43:17 -08:00
geohot ba3bf5bdf7 cifar stops learning 2023-02-11 17:21:42 -08:00
geohot 40f3949742 fancier KOPT 2023-02-11 16:40:25 -08:00
geohot 446442dbb3 fix tests symbolic 2023-02-11 15:16:47 -08:00
geohot 20a351a3c6 hand optim CONVW 2023-02-11 14:41:08 -08:00
geohot 031edd01e6 switch openpilot compile to TinyJit 2023-02-11 09:51:44 -08:00
geohot 608fd730d3 put the JIT in extra 2023-02-11 00:35:18 -06:00
geohot fed95119dc CL.mem_used -> GlobalCounters.mem_used 2023-02-10 23:13:29 -06:00
KirillandGitHub 27154db99a Downloads weights in examples/stable_diffusion.py (#537) 
* Downloads weights in examples/stable_diffusion.py

* use download_file_if_not_exists in fetch

* make consistent with previous NOCACHE behavior
 2023-02-10 14:37:04 -06:00
geohot 5ed3622965 add dump to kernel_search 2023-02-10 12:13:30 -06:00
geohot d9555bc478 that turned out to be dumb 2023-02-08 16:52:29 -06:00
George HotzandGitHub 3d63934995 refactor to keep cl in the runtime (#545) 
* refactor to keep cl in the runtime

* fix thneed, rename cl to _cl

* bugfix + _cuda

* fix tests

* thneed more correct
 2023-02-08 16:46:09 -06:00
George HotzandGitHub 2844482a60 Mypy fun (#541) 
* mypy fun

* things are just faster

* running fast

* mypy is fast

* compile.sh

* no gpu hack

* refactor ops_cpu and ops_torch to not subclass

* make weak buffer work

* tensor works

* fix test failing

* cpu/torch cleanups

* no or operator on dict in python 3.8

* that was junk

* fix warnings

* comment and touchup
 2023-02-08 09:56:51 -06:00
geohot 185d2e3678 fix map_buffer and add some __slots__ 2023-02-07 15:32:48 -06:00
geohot d93563f39f fix KOPT 2023-02-07 06:56:33 -06:00
George HotzandGitHub f7291f6ca3 fixes big KOPT, breaks opencl (#505) 
* fixes big KOPT, breaks opencl

* fix optimizer

* KernelCache

* oops, broke batchnorm

* hack to fix it

* fix llvm, less hacky gpu

* disable the cache

* cache just breaks things
 2023-02-05 10:46:17 -08:00
George HotzGitHubMartin Loretz
 		cd97b036cc A Triton backend for tinygrad (#470) 
* triton can add

* print stuff from triton

* write out file

* ops triton working

* reduce ops

* sort of works

* Triton bugfixes & implementation of remaining ops (#490)

* padding

* support pow, max, relu, gt0

* allocate return buffer

* Fix reduce

* Add tests for power op

* Fix triton illegal memory accesses and memory leak (#512)

* Fix mypy issue

* Add triton to setup.py

* Replace torch with pycuda

* Use one cuda stream for data transfer and kernels

* Remove triton submodule

* Fix memory leak by using weakrefs for caching

* Fix memory access by adding valid as mask for load

* Fix invalid kernel launches by flattening the grid (#515)

---------

Co-authored-by: Martin Loretz <[email protected]>
 2023-02-01 11:53:57 -08:00
Jacky LeeandGitHub 799b3f185a Refactor getenv into helpers (#508) 
* Refactor getenv into helpers

* Remove unused os

* Fix default value

* Fix more defaults for CI

* Fix bracket

* Revert changes to openpilot/compile.py

* Use getenv from helpers when possible
 2023-01-31 15:09:09 -08:00
geohot 60ccddb58b reenable SWAP 2023-01-30 17:32:02 -08:00
geohot aea55eb196 found failing upcast 2023-01-30 16:12:56 -08:00
geohot b67f997864 tests pass w/o float4 2023-01-30 15:40:49 -08:00
geohot c6f570a2e6 improve progress bar 2023-01-30 14:50:28 -08:00
geohot 7118602c97 goat progress bar 2023-01-30 14:37:26 -08:00
geohot cccfea4b25 factor out KOPT code 2023-01-30 13:13:55 -08:00
geohot de2c419fd4 make_pair and first attempt at hlb_cifar10 2023-01-30 11:07:23 -08:00
AllentDanandGitHub 7b6b1f32b1 [Fix] fix typo: test_mnist -> datasets (#492) 
* test_mnist -> datasets

* fix mnist_gan
 2023-01-29 21:30:47 -08:00
George HotzandGitHub 2db272c7f7 Kernel Optimizer (#489) 
* kernel optimizer

* 10x faster, but wrong. not good deal

* move test -> extra

* print x speedup

* clcache

* fix clcache + DEBUG

* GFLOPS estimate

* i==3
 2023-01-29 17:15:00 -08:00
geohot bb0cdc2442 111.51x speedup for reduce 2023-01-29 03:06:00 -08:00
geohot 45c0aa6e2d search with SHIFT, REDUCE 2023-01-29 02:42:20 -08:00
geohot 87879cf4b6 improve search more 2023-01-29 02:08:57 -08:00