Commit Graph
13471 Commits
Author SHA1 Message Date
wozeparrotandGitHub 8b354b3f73 feat: version bump! (#1687) v0.7.0 2023-08-27 12:38:58 -04:00
abaa605f71 [ready] perf: start enumerate at 1 instead of checking all i (#1691)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-27 12:00:32 -04:00
2730ed657f perf: faster lazyop eq (#1693)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-27 11:17:02 -04:00
6ca509a485 perf: constant in while in for in busy func (#1688)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-27 11:13:16 -04:00
b89d81330f fix: restore old behaviour (#1689)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-27 10:45:53 -04:00
chenyuandGitHub 66fbf4800b fix symbolic_ops tests with Tensor.training=True (#1686) 2023-08-26 23:19:56 -04:00
6c5dc9c153 [ready] perf: faster lazyop init (#1673)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-26 22:59:10 -04:00
wozeparrotandGitHub f61d0657d1 document new envvars (#1676)
* feat: document some new envvars

* feat: actually put values

* feat: no more cifar torch

* feat: no fakedata
2023-08-26 20:17:02 -04:00
Yixiang GaoandGitHub 9d93a82354 remove FAKEDATA (#1685) 2023-08-26 20:15:54 -04:00
chenyuandGitHub b5d700adae update openpilot supercombo.onnx to 0.9.4 (#1681)
* update openpilot supercombo.onnx to 0.9.4

* update tests for the new model

* comment out comma models from external_model_benchmark
2023-08-26 19:16:08 -04:00
89b529c07f [ready] ci: add py38 to linters (#1674)
* ci: add py38 to linters

* fix: run linters only on py38

---------

Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-26 09:34:15 -04:00
Jordan WrightandGitHub 25be7f745d Tensor.uniform with dtype=int bug fix (#1593) 2023-08-26 01:59:53 -04:00
f702a8f497 [ready] avoid in-function graph imports in lazy.py (#1666)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-25 13:56:28 -04:00
02e64da678 refactor: tuples can be concatenated with + (#1671)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-25 12:37:13 -04:00
Yixiang GaoandGitHub 173850f599 fix CIFAR jit (#1657)
* update mask function

* kept 94 with the new fetcher

clean up batch fetcher

* 94.04% without cutmix

* 94.04% with cutmix

* move batch fetcher to avoid fetching additional batch last STEP
2023-08-24 16:14:40 -07:00
chenyuandGitHub f00325e77d ops_metal newCommandQueueWithMaxCommandBufferCount_(1024) (#1664) 2023-08-24 15:42:00 -07:00
1ba8f0dca3 Quickstart: Upgrade section "Training" to new code (#1663)
Co-authored-by: Dave Farago <[email protected]>
2023-08-24 17:12:16 -04:00
29adae84eb Quickstart: Use tensors to compute train accuracy (#1662)
Co-authored-by: Dave Farago <[email protected]>
2023-08-24 17:09:12 -04:00
George HotzandGitHub d37d092c14 split linearizer into 3 files (#1654) 2023-08-23 14:58:47 -07:00
George HotzandGitHub 1b8c40234f Uast start (#1650)
* work

* more tests

* more tests 2

* don't break it
2023-08-23 12:00:06 -07:00
geohotstanandGitHub 484708da87 #1615 fix (#1616) 2023-08-23 14:51:05 -04:00
Pavol RusnakandGitHub b57c374164 add accelerator links to readme (#1649) 2023-08-23 14:47:55 -04:00
George HotzandGitHub 82623697a8 Move asm renderer (#1648)
* teeny changes

* teeny updates

* move to renderer
2023-08-23 10:06:43 -07:00
George HotzandGitHub a89363574d teeny changes (#1647)
* teeny changes

* teeny updates
2023-08-23 09:53:39 -07:00
George HotzandGitHub a6d842af7a move device to ops (#1646)
* move device to ops

* mlops types

* 2 lines
2023-08-23 08:30:17 -07:00
nimlgenandGitHub a65ae1198b do replace div->mul for non-floats (#1644) 2023-08-23 07:34:31 -07:00
geohot da694d4241 move that image import 2023-08-22 21:30:55 -07:00
George HotzandGitHub 41e83be3dd simple where broadcast (#1643) 2023-08-22 21:24:49 -07:00
George HotzandGitHub c831218139 Optional: Reduce line count and simplify the LazyBuffer interface (#1642)
* less lines in lazybuffer, def e

* custom function

* cast

* reorder functions

* lb type
2023-08-22 21:01:10 -07:00
George HotzandGitHub d25046e66a matvec tests (#1634)
* matvec tests

* f16

* f16 is broken
2023-08-22 17:33:58 -07:00
George HotzandGitHub 643cbdfd50 make embedding and GPT-2 fast (#1631)
* make embedding fast

* jit more, variable shape support

* print mem bw
2023-08-22 15:14:38 -07:00
Niklas DandGitHub a7752ad65d Fix link to state.py in quickstart (#1632) 2023-08-22 17:39:30 -04:00
c143andGitHub c9c40bb16f Import whole math module in tensor.py (#1628) 2023-08-22 17:07:46 -04:00
6fcfa50b35 [ready] perf: no noop cast just to make mypy happy (#1626)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-22 17:07:22 -04:00
f04a6d7882 perf: faster partition (#1625)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-22 11:56:41 -07:00
geohot d3c401ba3c llama quantize: scale uses mul, not div 2023-08-22 11:48:56 -07:00
geohot 696e4d20a1 fix KOPT=2 with variable shape 2023-08-22 11:34:34 -07:00
George HotzandGitHub de1fcc418f no more toCPU path (#1624) 2023-08-22 11:07:26 -07:00
George HotzandGitHub 463dece63e auto arg dtypes (#1623) 2023-08-22 10:22:40 -07:00
George HotzandGitHub db8344ab83 add noalias to llvm (#1622) 2023-08-22 09:26:01 -07:00
chenyuandGitHub 89e13f2f04 support symbols in shrink (#1611) 2023-08-22 09:08:21 -07:00
George HotzandGitHub 718ced296c move state to nn/state (#1619) 2023-08-22 07:36:24 -07:00
Umut ZenginandGitHub 1e93fd5449 Readability for unreadable functions (#1610)
* cleaned

* typing

* typing

* if format

* if format

* mypy

* update argmax

* argmax more readable

* More stable def pad

* lint
2023-08-22 07:09:08 -07:00
George HotzandGitHub 86a32ffb1a lt sum (#1617) 2023-08-21 21:19:16 -07:00
geohot c64c47a6ae test arange simple 2023-08-21 20:16:17 -07:00
George HotzandGitHub 4f459841bc Symbolic JIT for GPT2 (#1613)
* not fast yet

* simpler

* symbolic jit

* fp16 GOPS and GB
2023-08-21 19:44:57 -07:00
Yixiang GaoandGitHub 4f02491cd4 add cpu if torch tensor (#1609) 2023-08-21 16:57:59 -07:00
Umut ZenginandGitHub f720682beb np.argmax to Tensor.argmax (#1608)
* to tensor argmax

* removed keepdim

* training update
2023-08-21 15:22:29 -07:00
George Hotz 4ea00bad38 track down llama bug 2023-08-21 15:14:21 -07:00
b02f77b354 perf: faster broadcasted (#1601)
Co-authored-by: Roelof van Dijk <[email protected]>
2023-08-21 14:21:46 -07:00