geohot/tinygrad
1
0
Fork 0
forked from tinygrad/tinygrad
Code Pull Requests Actions Activity
2,360 Commits 4 Branches 15 Tags
25be7f745de71b9ac45fdcc496bd032ecdd76702
Commit Graph
2360 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jordan WrightandGitHub 25be7f745d Tensor.uniform with dtype=int bug fix (#1593) 2023-08-26 01:59:53 -04:00
Roelof van DijkGitHubRoelof van Dijk
 		f702a8f497 [ready] avoid in-function graph imports in lazy.py (#1666) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-25 13:56:28 -04:00
Roelof van DijkGitHubRoelof van Dijk
 		02e64da678 refactor: tuples can be concatenated with + (#1671) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-25 12:37:13 -04:00
Yixiang GaoandGitHub 173850f599 fix CIFAR jit (#1657) 
* update mask function

* kept 94 with the new fetcher

clean up batch fetcher

* 94.04% without cutmix

* 94.04% with cutmix

* move batch fetcher to avoid fetching additional batch last STEP
 2023-08-24 16:14:40 -07:00
chenyuandGitHub f00325e77d ops_metal newCommandQueueWithMaxCommandBufferCount_(1024) (#1664) 2023-08-24 15:42:00 -07:00
DavidFaragoGitHubDave Farago
 		1ba8f0dca3 Quickstart: Upgrade section "Training" to new code (#1663) 
Co-authored-by: Dave Farago <[email protected]>
 2023-08-24 17:12:16 -04:00
DavidFaragoGitHubDave Farago
 		29adae84eb Quickstart: Use tensors to compute train accuracy (#1662) 
Co-authored-by: Dave Farago <[email protected]>
 2023-08-24 17:09:12 -04:00
George HotzandGitHub d37d092c14 split linearizer into 3 files (#1654) 2023-08-23 14:58:47 -07:00
George HotzandGitHub 1b8c40234f Uast start (#1650) 
* work

* more tests

* more tests 2

* don't break it
 2023-08-23 12:00:06 -07:00
geohotstanandGitHub 484708da87 #1615 fix (#1616) 2023-08-23 14:51:05 -04:00
Pavol RusnakandGitHub b57c374164 add accelerator links to readme (#1649) 2023-08-23 14:47:55 -04:00
George HotzandGitHub 82623697a8 Move asm renderer (#1648) 
* teeny changes

* teeny updates

* move to renderer
 2023-08-23 10:06:43 -07:00
George HotzandGitHub a89363574d teeny changes (#1647) 
* teeny changes

* teeny updates
 2023-08-23 09:53:39 -07:00
George HotzandGitHub a6d842af7a move device to ops (#1646) 
* move device to ops

* mlops types

* 2 lines
 2023-08-23 08:30:17 -07:00
nimlgenandGitHub a65ae1198b do replace div->mul for non-floats (#1644) 2023-08-23 07:34:31 -07:00
geohot da694d4241 move that image import 2023-08-22 21:30:55 -07:00
George HotzandGitHub 41e83be3dd simple where broadcast (#1643) 2023-08-22 21:24:49 -07:00
George HotzandGitHub c831218139 Optional: Reduce line count and simplify the LazyBuffer interface (#1642) 
* less lines in lazybuffer, def e

* custom function

* cast

* reorder functions

* lb type
 2023-08-22 21:01:10 -07:00
George HotzandGitHub d25046e66a matvec tests (#1634) 
* matvec tests

* f16

* f16 is broken
 2023-08-22 17:33:58 -07:00
George HotzandGitHub 643cbdfd50 make embedding and GPT-2 fast (#1631) 
* make embedding fast

* jit more, variable shape support

* print mem bw
 2023-08-22 15:14:38 -07:00
Niklas DandGitHub a7752ad65d Fix link to state.py in quickstart (#1632) 2023-08-22 17:39:30 -04:00
c143andGitHub c9c40bb16f Import whole math module in tensor.py (#1628) 2023-08-22 17:07:46 -04:00
Roelof van DijkGitHubRoelof van Dijk
 		6fcfa50b35 [ready] perf: no noop cast just to make mypy happy (#1626) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-22 17:07:22 -04:00
Roelof van DijkGitHubRoelof van Dijk
 		f04a6d7882 perf: faster partition (#1625) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-22 11:56:41 -07:00
geohot d3c401ba3c llama quantize: scale uses mul, not div 2023-08-22 11:48:56 -07:00
geohot 696e4d20a1 fix KOPT=2 with variable shape 2023-08-22 11:34:34 -07:00
George HotzandGitHub de1fcc418f no more toCPU path (#1624) 2023-08-22 11:07:26 -07:00
George HotzandGitHub 463dece63e auto arg dtypes (#1623) 2023-08-22 10:22:40 -07:00
George HotzandGitHub db8344ab83 add noalias to llvm (#1622) 2023-08-22 09:26:01 -07:00
chenyuandGitHub 89e13f2f04 support symbols in shrink (#1611) 2023-08-22 09:08:21 -07:00
George HotzandGitHub 718ced296c move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
Umut ZenginandGitHub 1e93fd5449 Readability for unreadable functions (#1610) 
* cleaned

* typing

* typing

* if format

* if format

* mypy

* update argmax

* argmax more readable

* More stable def pad

* lint
 2023-08-22 07:09:08 -07:00
George HotzandGitHub 86a32ffb1a lt sum (#1617) 2023-08-21 21:19:16 -07:00
geohot c64c47a6ae test arange simple 2023-08-21 20:16:17 -07:00
George HotzandGitHub 4f459841bc Symbolic JIT for GPT2 (#1613) 
* not fast yet

* simpler

* symbolic jit

* fp16 GOPS and GB
 2023-08-21 19:44:57 -07:00
Yixiang GaoandGitHub 4f02491cd4 add cpu if torch tensor (#1609) 2023-08-21 16:57:59 -07:00
Umut ZenginandGitHub f720682beb np.argmax to Tensor.argmax (#1608) 
* to tensor argmax

* removed keepdim

* training update
 2023-08-21 15:22:29 -07:00
George Hotz 4ea00bad38 track down llama bug 2023-08-21 15:14:21 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		b02f77b354 perf: faster broadcasted (#1601) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-21 14:21:46 -07:00
Yixiang GaoandGitHub 4d54afb6df sparse cat cross entropy (#1597) 
* add sparse cat cross entropy

* minor fix

* add log_softmax into loss function

* add test

* update docs

* fix training loss

* add device
 2023-08-21 14:14:54 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		109100656f refactor: no len if it is not needed (#1598) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-21 14:06:32 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		2c8f8ac611 perf: no ret needed (#1604) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-21 14:05:13 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		750714c386 perf: namedtuples are hashable, don't need a key (#1607) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-21 14:01:10 -07:00
George HotzandGitHub aaa6fdf347 this was unused code (#1600) 2023-08-21 12:02:58 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		8e8724d3a8 perf: if argument order (mops) (#1599) 
Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-21 11:20:39 -07:00
George HotzandGitHub 2e60920317 Revert "sparse cat cross entropy (#1591)" (#1596) 
This reverts commit f0ee850e98.
 2023-08-21 10:04:26 -07:00
Yixiang GaoandGitHub f0ee850e98 sparse cat cross entropy (#1591) 
* add sparse cat cross entropy

* minor fix

* add log_softmax into loss function

* add test

* update docs
 2023-08-21 09:56:41 -07:00
Yixiang GaoandGitHub 8d6662a741 .cpu().numpy() -> .numpy() (#1594) 
* .cpu().numpy() -> .numpy()

* restore ops_torch

* restore test_speed_v_torch
 2023-08-21 09:53:29 -07:00
Umut ZenginandGitHub 35bf21276f Argmax/Argmin Feature (#1576) 
* implemented argmax and argmin

* lint

* lint

* match torch behaviour

* format

* removed flip
 2023-08-20 18:46:46 -07:00
Roelof van DijkGitHubRoelof van Dijk
 		1900acda09 [READY] ci: setup venv cache (#1475) 
* ci: cache installed packages

* ci: trigger jobs

* ci: fix hashfiles argument

---------

Co-authored-by: Roelof van Dijk <[email protected]>
 2023-08-20 18:43:16 -07:00