Commit Graph

Select branches

Hide Pull Requests

geohot/updates

gh-pages

master

remove_anchors

#1

#2

#3

v0.10.0

v0.10.1

v0.10.2

v0.10.3

v0.11.0

v0.12.0

v0.13.0

v0.4.0

v0.5.0

v0.6.0

v0.7.0

v0.8.0

v0.9.0

v0.9.1

v0.9.2

Mono Color

• 1f5c9618ef refactor in readme and issue #225 geohot 2020-12-29 17:30:04 -05:00
• f9170505b3 if you like your transformers twice as slow, use the GPU geohot 2020-12-29 17:14:23 -05:00
• 6a6a82e999 support multidot on GPU geohot 2020-12-29 16:56:30 -05:00
• 27208d729b add GPU max thanks to marcelbischoff geohot 2020-12-29 16:44:14 -05:00
• 4bbad11afe link to papers geohot 2020-12-29 14:15:46 -05:00
• 3f8e137b6f extra/transformer geohot 2020-12-29 14:14:00 -05:00
• c4e7a1ae59 accessors are dumb geohot 2020-12-29 14:10:26 -05:00
• fb6aaefb9b save 2 lines geohot 2020-12-29 14:02:50 -05:00
• ea341c84fe logsoftmax good, div bad geohot 2020-12-29 13:59:39 -05:00
• f18801c7db simple pool. swimming is very easy now geohot 2020-12-29 13:48:50 -05:00
• 8f9232d59b readmee geohot 2020-12-29 13:40:34 -05:00
• 837aaacfbf Unpad2D on GPU: geohot 2020-12-29 13:16:14 -05:00
• 02655c07d5 break maxpool2d on GPU geohot 2020-12-29 13:05:57 -05:00
• 061e37de39 touchups geohot 2020-12-29 12:41:21 -05:00
• a2e6562330 fix max op, less lines geohot 2020-12-29 10:47:04 -05:00
• dc8fa7999c Transpose on GPU (#221) Marcel BischoffandGitHub 2020-12-29 10:40:11 -05:00
• 36579f66bf max op geohot 2020-12-28 23:54:52 -05:00
• bcb3ceeca3 set training in functions geohot 2020-12-28 22:45:46 -05:00
• 51bf164b72 dropout, training geohot 2020-12-28 22:12:23 -05:00
• 7b8fee038d it works! forgot the sqrt geohot 2020-12-28 16:23:52 -05:00
• 1faf05ef67 ahh, it's better if i don't train the embedding geohot 2020-12-28 16:07:02 -05:00
• c3832e1bde hmm, fix layernorm to not be batchnorm and it breaks geohot 2020-12-28 13:06:21 -05:00
• 2e89e75dcb layernorm fixes transformer instability geohot 2020-12-28 12:58:15 -05:00
• 628d21f899 doc touchup geohot 2020-12-28 10:45:26 -05:00
• fafece9db7 avgpool2d is a second class op geohot 2020-12-28 10:41:59 -05:00
• 593233b668 log and exp are first class ops geohot 2020-12-28 10:00:30 -05:00
• ffff98db78 Evaluation in Transformers (#218) Marcel BischoffandGitHub 2020-12-28 09:24:51 -05:00
• 65b07d2f4f fix onehot embed geohot 2020-12-27 18:50:38 -05:00
• d864e1c71a transformer is training geohot 2020-12-27 18:46:32 -05:00
• a361ef6861 fixup training loop geohot 2020-12-27 18:35:56 -05:00
• f15bec6dbc make multidot work on CPU geohot 2020-12-27 17:25:37 -05:00
• 131e04c90c cpu only decorator geohot 2020-12-27 17:18:55 -05:00
• 2f1b2c0a3b add transpose, start on transformer geohot 2020-12-27 16:59:12 -05:00
• d379502c04 Cleaning (#211) 3 people 2020-12-27 15:58:51 +01:00
• 8a335f03ad clock speed 32x32 geohot 2020-12-22 18:18:52 -05:00
• aae2e35208 benchmarking 512x512 GEMM geohot 2020-12-22 18:01:36 -05:00
• bd18e03138 conv from weights works geohot 2020-12-22 17:42:17 -05:00
• b3cf53e39b more docs geohot 2020-12-22 17:14:38 -05:00
• 4065eae0fb docs for tensor stride geohot 2020-12-22 17:06:36 -05:00
• 6fb127d5c7 l2 cache note geohot 2020-12-22 16:48:19 -05:00
• 78a06a1285 more readme geohot 2020-12-22 16:23:08 -05:00
• 0ab951f21c better readme geohot 2020-12-22 15:57:33 -05:00
• 6ca449afd2 sum works geohot 2020-12-22 12:53:20 -05:00
• ebc7f8305c 3x3 gemm in conv geohot 2020-12-22 12:00:44 -05:00
• ff52f832dc conv hwx geohot 2020-12-22 11:49:54 -05:00
• 5b93d9c03a aneregs geohot 2020-12-22 10:41:12 -05:00
• ccfd03e401 parse ane struct geohot 2020-12-22 10:16:46 -05:00
• 06f359baa3 issue-193 - Move torch loader out of efficientnet code (#213) Nicklas BomanandGitHub 2020-12-22 06:19:16 +01:00
• 3abda29648 add debug to ane lib geohot 2020-12-21 18:49:33 -05:00
• c48917fdf0 ane reg notes geohot 2020-12-21 15:26:52 -05:00
• 451e944648 aneregs from debug geohot 2020-12-21 13:37:02 -05:00
• 16f0cb7d80 fix sign python geohot 2020-12-20 15:44:10 -05:00
• e03759f01d channels concat geohot 2020-12-19 09:43:21 -08:00
• 73ae6d7821 working on gemm geohot 2020-12-19 09:30:29 -08:00
• 075cf4bc02 Update examples to new API (#205) LiamandGitHub 2020-12-19 18:04:12 +01:00
• 3c9150a9f4 lil note geohot 2020-12-18 09:54:20 -08:00
• be41e73ad9 ane docs continue geohot 2020-12-18 09:49:13 -08:00
• e5f2055776 ane refactor, fix examples geohot 2020-12-18 09:19:06 -08:00
• fbcd1912cf ane struct geohot 2020-12-18 09:06:25 -08:00
• 56d44637f3 fixed pylint, formatted python files iwth cblack on localhost (#204) 3 people 2020-12-17 17:37:31 -05:00
• 799ad5ba17 refactor/softmax (#201) 3 people 2020-12-17 12:53:28 -05:00
• dad061dafb Added Python 3 style super() without arguments (#200) 3 people 2020-12-17 05:50:16 +01:00
• bcf1518309 All devices are equal! (#196) LiamandGitHub 2020-12-16 08:44:08 +01:00
• 78210b5e40 less lines (#197) James RobertsandGitHub 2020-12-14 23:53:00 +02:00
• b86bbd2e72 readmes geohot 2020-12-13 21:32:20 -08:00
• da72a0eed4 Big MNIST model with PIL augmentation and load/save (#160) Marcel BischoffandGitHub 2020-12-13 23:45:55 -05:00
• f50dcc12ac 1k lines geohot 2020-12-13 20:37:58 -08:00
• 4d8235d5f7 readme update geohot 2020-12-13 20:24:33 -08:00
• 1a1c63a08b Gan is real...Look what tiny just generated! (#192) NeuralLinkandGitHub 2020-12-14 09:53:12 +05:30
• 6785614239 tinygrad.utils to extra.utils fix in mnist_gan (#190) Marcel BischoffandGitHub 2020-12-12 23:52:36 -05:00
• d901ef6b23 🎉 effort to generate mnist data using GAN with tinygrad. [WIP] (#166) NeuralLinkandGitHub 2020-12-13 07:28:04 +05:30
• e6a5c6c93e Added indentation linter (#187) Mufeed VHandGitHub 2020-12-13 06:45:09 +05:30
• f95e79dab7 update readme geohot 2020-12-12 17:14:10 -08:00
• a5aced8d47 30 MEGAReLUs. we need to lose 12 lines geohot 2020-12-12 17:07:34 -08:00
• 49da969d25 Fixed a typo. (#189) WillemKaufandGitHub 2020-12-12 19:25:33 -05:00
• bc5df477de readme and .ane() geohot 2020-12-12 16:15:38 -08:00
• da873cd556 Single ReLU in ANE (#188) George HotzandGitHub 2020-12-12 16:11:34 -08:00
• 07ece2105e actually move it geohot 2020-12-12 15:26:58 -08:00
• 1d10559d1d tinygrad.utils -> extra.utils geohot 2020-12-12 15:26:07 -08:00
• 59358304a3 ane geohot 2020-12-12 15:23:21 -08:00
• 36d4eee323 fix compiler segfault geohot 2020-12-12 15:10:47 -08:00
• abb7b74208 relu in python geohot 2020-12-12 14:50:05 -08:00
• d3886035dd ane dylib geohot 2020-12-12 13:41:09 -08:00
• cf66d549c1 fix example ane geohot 2020-12-12 13:32:49 -08:00
• 566045cefc uint8 nope geohot 2020-12-12 13:13:29 -08:00
• 8c25431619 Faster but still general binop broadcasting (#159) 3 people 2020-12-12 12:19:46 -08:00
• bf9ba8718a Profile GPU and CPU copying. (#182) LiamandGitHub 2020-12-12 21:15:47 +01:00
• 8e8cbc74b3 Minor clean up (#184) James RobertsandGitHub 2020-12-12 00:25:29 +02:00
• f4faf401bc require_init_gpu() function selects GPU as device and falls back to CPU if none are available (#180) SkoshandGitHub 2020-12-11 19:21:59 +02:00
• c7e95ddb21 Add diamond model test (#181) DauletandGitHub 2020-12-11 17:21:36 +00:00
• 38b29f49dd abs (#172) Marcel BischoffandGitHub 2020-12-10 12:24:35 -05:00
• e79cda6dad Add pyopencl to dependency installs (#174) LiamandGitHub 2020-12-10 18:24:08 +01:00
• 8ab8a71d5d refactor (#178) NeuralLinkandGitHub 2020-12-10 22:53:36 +05:30
• d204f09316 some progress on batchnorms (draft) (#147) Marcel BischoffandGitHub 2020-12-10 01:14:27 -05:00
• 5d46df638a abs as non-first class operation using relu (#171) Marcel BischoffandGitHub 2020-12-09 15:20:34 -05:00
• 4c55c7208f no pow if mul will do geohot 2020-12-09 08:19:29 -08:00
• b85f17f247 more optim cleanup geohot 2020-12-09 08:18:10 -08:00
• 9a64d13b94 add conv biases and max pool geohot 2020-12-09 08:01:20 -08:00
• 99fa65f057 enable batchnorm in serious mnist geohot 2020-12-09 03:29:40 -08:00
• ffb96b2d0b batchnorm by marcelbischoff geohot 2020-12-09 03:23:04 -08:00