Commit Graph
13471 Commits
Author SHA1 Message Date
George Hotz cfb7a4c41a back to 1000 lines 2022-01-17 10:44:39 -08:00
geohot a482d56229 don't save for backward pass if we don't need to. add purple edges to graph 2022-01-16 12:18:41 -08:00
geohot 8dfdc4e11f GRAPH and DEBUG can be independent. under 1k lines 2022-01-16 12:04:10 -08:00
geohot 2f531e35be add ctx saved tensors to graph 2022-01-16 11:18:36 -08:00
geohot 2a10116bfa support drawing graphs 2022-01-16 10:45:58 -08:00
geohot 6a5cb6842e make profiler work for backward pass too 2022-01-16 09:35:10 -08:00
George Hotz 2cae2dfa07 don't crash the dataloader for imagenet 2022-01-16 08:41:26 -08:00
George Hotz 907ff7dbb6 imagenet is training 2022-01-15 23:27:31 -08:00
George Hotz d1e082e0ef add imagenet training support 2022-01-15 23:16:38 -08:00
George Hotz ade2af7ac0 data doesn't require grad 2022-01-15 22:41:27 -08:00
George Hotz 0973e54eb0 fix DEBUG for GPU 2022-01-15 22:14:28 -08:00
George Hotz d844ecee27 track running stats by default, and detach 2022-01-15 21:46:54 -08:00
George Hotz d541e2a8e5 move assert, remove comment 2022-01-15 21:36:58 -08:00
George Hotz 845bb1fc34 bs 4 -> 2 in training test 2022-01-15 21:34:21 -08:00
George Hotz c0d1254003 don't run unneeded grads 2022-01-15 21:32:13 -08:00
George Hotz ecc0903451 Revert "faster deepwalk"
This reverts commit 931500a098.
2022-01-15 21:02:18 -08:00
George Hotz 931500a098 faster deepwalk 2022-01-15 20:57:57 -08:00
cjg91andGitHub 7025c9bbeb Transfer learning for ResNet (#295)
* Transfer learning for ResNet

* moved ResNet depth specifics into the class
2022-01-15 23:22:10 -05:00
George Hotz 55d792b065 Revert "fixup resnet"
This reverts commit 4eabe677ed.
2022-01-15 20:22:01 -08:00
George Hotz 4eabe677ed fixup resnet 2022-01-15 20:21:02 -08:00
George Hotz e0bef0bd01 training is False by default 2022-01-15 19:57:41 -08:00
George Hotz 8ba3d1f803 fix bn test, affine is True 2022-01-15 19:52:15 -08:00
George Hotz 8ec2341cca fix bn training 2022-01-15 19:47:01 -08:00
George Hotz 0e6832a8ea support torch GPU, only autoinit cuda in the buffer 2022-01-15 19:15:12 -08:00
George Hotz d8d19ed468 wikimedia wasn't returning 200 2022-01-15 19:09:29 -08:00
George Hotz 52918fbf78 cuda stub 2022-01-15 19:02:17 -08:00
Jacky LeeandGitHub 81664baf64 Fix OpenCL installation (#301) 2022-01-06 10:35:48 -05:00
geohot b0511f9392 Revert "does pybind fix CI?"
This reverts commit d128e4fcae.
2021-12-30 14:13:58 -05:00
geohot d128e4fcae does pybind fix CI? 2021-12-30 14:11:39 -05:00
geohot 5efb6653c4 a bit of work on metal 2021-12-30 13:53:08 -05:00
geohot c0c2c0b041 support larger ViT models 2021-12-12 10:45:10 -08:00
geohot 785fe8ead7 unify torch Slice 2021-11-30 16:25:37 -05:00
geohot e59381d0da cleanups, remove np 2021-11-30 16:22:00 -05:00
geohot e28cdfb0cf clean up resnet 2021-11-30 16:14:54 -05:00
geohot 8f5779eeaa very minor change 2021-11-30 15:54:03 -05:00
geohot d31ef0ae48 make vit names match pytorch 2021-11-30 11:34:14 -05:00
geohot 4b7c31b5b7 break vit into it's own file 2021-11-30 11:19:22 -05:00
geohot 46bbbcf7f0 model touchups 2021-11-30 11:13:34 -05:00
geohot 7d7e2b690d clean up Conv2d 2021-11-30 11:02:55 -05:00
geohot 835869974c clean up vit code 2021-11-30 10:58:03 -05:00
geohot 6884add850 save two lines 2021-11-30 01:16:48 -05:00
geohot 9b538629bb cosmetic 2021-11-30 01:01:39 -05:00
geohot 38dccb3a2e same simpler sum and max for gpu 2021-11-30 00:59:05 -05:00
geohot 5d60df2b10 simpler sum and max 2021-11-30 00:53:27 -05:00
geohot c39824bc62 oops, forgot some stars 2021-11-30 00:46:14 -05:00
geohot 908db3bdea support bias in conv like linear 2021-11-30 00:44:59 -05:00
geohot bd21304e3c linear takes in weight and bias 2021-11-30 00:38:47 -05:00
geohot 535f02cc64 use sequential 2021-11-30 00:25:39 -05:00
geohot de938c2d9d vit is now tested 2021-11-30 00:23:06 -05:00
geohot aff810e722 unify transformer block 2021-11-29 18:58:15 -05:00