Commit Graph
11106 Commits
Author SHA1 Message Date
geohot 46e7dfade1 REQUIRES_SIMPLE_REDUCE 2022-07-19 11:42:14 -07:00
geohot acbeaf0ba9 adam in benchmark_train_efficientnet 2022-07-19 09:33:07 -07:00
geohot ef1100fdff touchups 2022-07-19 09:30:06 -07:00
George HotzandGitHub 5d45c6e516 Fold reduce (#362)
* folding reduce

* fold through movementops

* fixup shapes

* was too aggressive

* i knew we needed that

* don't recompute reduce

* working

* fix openpilot compile

* prunegraph openpilot

* types and reduce_shape

* refactor

* cleanups

* neater

* 1009

* 1004

* clean up reduce for 998
2022-07-19 09:24:02 -07:00
Comma Device 2d402d1135 buffer_id is 8 bytes 2022-07-18 20:27:45 -07:00
Comma Device 577c23731e outputs with size 2022-07-18 20:21:33 -07:00
Comma Device 29581b5c85 inputs and outputs 2022-07-18 20:17:26 -07:00
Comma Device ae30641b0d fix row pitch 2022-07-18 19:48:19 -07:00
Comma Device 02f23e526c output file to disk 2022-07-18 19:23:22 -07:00
geohot ef4afdb5d2 tests maybe 2022-07-18 08:24:14 -07:00
geohot a2c4bcf313 disable opencl tests 2022-07-18 08:17:21 -07:00
geohot 5093455166 don't shuffle if there's children involved 2022-07-17 21:15:40 -07:00
geohot f76d41812b prune graph 2022-07-17 15:38:43 -07:00
geohot eda6f071b2 default opt level 2 2022-07-17 14:54:40 -07:00
geohot 73b0471b25 join expands 2022-07-17 13:42:05 -07:00
geohot cfabbbd6bb more crap to remove without convs 2022-07-17 13:02:27 -07:00
geohot 5e96ed523a fix opencl bug, no training on opencl 2022-07-17 12:55:26 -07:00
geohot f93e297804 fix bug caused by rounding 2022-07-17 12:49:58 -07:00
geohot cff297ef9d w/e, that's a later prob 2022-07-17 12:32:50 -07:00
geohot 4bc07326d4 we need that opt to make gpu decent speed 2022-07-17 12:26:18 -07:00
geohot 6375e7129a opencl not imported 2022-07-17 12:14:39 -07:00
geohot bf299802f8 fixup tests 2022-07-17 12:11:53 -07:00
geohot 762e859089 testopencl 2022-07-17 11:56:40 -07:00
geohot 608e2431f7 test opencl, commit to removing the crap conv code from GPU 2022-07-17 11:55:37 -07:00
geohot 3c4565fa21 SLICE -> PAD,SHRINK 2022-07-17 11:33:59 -07:00
geohot 9574dd8559 some permutes are reshapes 2022-07-17 10:34:24 -07:00
geohot 77806e0d64 fix permute stacking 2022-07-17 10:24:57 -07:00
geohot c28a99087b add PAD movementop 2022-07-17 10:22:03 -07:00
geohot 4527c0453d get_movementroot 2022-07-17 09:37:27 -07:00
geohot b00cc93102 bugfixes 2022-07-17 09:19:22 -07:00
geohot d07f379038 don't merge movement ops 2022-07-17 09:09:50 -07:00
geohot f6ea7c022a Revert "EXPAND -> REPEAT"
This reverts commit 115d2eadf5.
2022-07-17 08:42:10 -07:00
geohot cca089b11d Revert "more expand -> repeat"
This reverts commit 2e7b1630a8.
2022-07-17 08:41:48 -07:00
geohot 2e7b1630a8 more expand -> repeat 2022-07-17 08:40:49 -07:00
geohot 115d2eadf5 EXPAND -> REPEAT 2022-07-17 08:38:54 -07:00
geohot 1eb247f823 contiguous and same length 2022-07-16 08:49:07 -07:00
geohot d04b274cd2 noop removal can replace with reshape 2022-07-16 08:32:42 -07:00
geohot d985217fa4 skip reduce noops 2022-07-16 07:47:43 -07:00
bcf422dfdd Device2 (#358)
* option for matmul

* fixups

* fast like a nascar

* running

* thneed runner

* no buffer id makes no backing buffer

* move constant folding to the top

* runs on mac

* folded biases

* was v slow

* maybe just that

* elu touchup

* speed and float32

Co-authored-by: Comma Device <[email protected]>
2022-07-16 07:26:19 -07:00
George Hotz d651caa864 fixup openpilot/compile.py 2022-07-11 13:59:09 -07:00
geohot 5e46561f7e no_grad = NOT backward 2022-07-10 20:54:57 -07:00
geohot b34ae7876f lol chr(10) not chr(13) 2022-07-10 20:03:11 -07:00
George HotzandGitHub 817b64f5e5 A conv is a reduce op (#356)
* universal strided conv

* more correct

* hmm, CPU works

* cleaner cl code output

* make noconv a flag

* cleanup __getitem__

* refactor broadcasting

* put that back

* unneeded reshape in getitem

* fix strided for torch
2022-07-10 19:58:50 -07:00
geohot 057e4f5aa5 a little faster and cleaner 2022-07-09 08:14:01 -07:00
geohot c77ba7fa3f ops_cpu readibility 2022-07-09 07:48:54 -07:00
geohot 0a36475700 no einsum for now 2022-07-09 00:04:40 -07:00
geohot c39a245696 that's not where i thought we'd lose lines... 2022-07-08 23:52:38 -07:00
geohot 75e1848b09 always SHUFFLE_RESHAPE_OPS 2022-07-08 23:19:39 -07:00
geohot 44848ee5dc prints show we can precompute from the outside 2022-07-08 10:59:20 -07:00
geohot 68959be05d precompute weights for opencl 2022-07-08 10:56:48 -07:00