chenyuandGitHub 18e854cdbf shrink MLB on sharded axis (#3255) ...

* shrink MLB on sharded axis

use onehot structure to store the real partition. goal is unsynced batchnorm2d that can be run on multigpu for training.

draft version in https://github.com/chenyuxyz/tinygrad/pull/109

* SYNCBN flag

* test unclean shrinks

* UnsyncedBatchNorm reuses BatchNorm

* more robust pad arg check

* better types

* more tests!

* 6 gpus in benchmark

* disable slow GPUS=6 benchmark

2024-01-31 21:48:25 -05:00

..

external

onnx update for trilu and argmax (#3283)

2024-01-30 18:39:16 -05:00

imported

fix pad 0 size (#3277)

2024-01-30 08:58:10 -08:00

models

Fix metal tests (#3266)

2024-01-27 18:09:42 -08:00

testextra

fix test extra issue (#3159)

2024-01-17 11:58:08 -08:00

unit

name upcast variables (#3200)

2024-01-22 11:37:28 -05:00

web

fast path for copy (#2548)

2023-12-01 11:34:47 -08:00

__init__.py

All devices are equal! (#196)

2020-12-15 23:44:08 -08:00

Dockerfile

Docker fix (#1039)

2023-06-25 10:38:58 -07:00

helpers.py

new lazy, benchmark (#2878)

2023-12-20 14:33:21 -08:00

test_assign.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_conv_shapetracker.py

fix some tests related to JitItem (#2279)

2023-11-11 23:00:35 -05:00

test_conv.py

make WINO a context var, and LATEWINO in hlb_cifar (#3161)

2024-01-17 20:21:26 -05:00

test_copy_speed.py

Disk shm refactor (#2912)

2023-12-22 09:23:37 -08:00

test_custom_function.py

the runner does the build (#3220)

2024-01-23 18:45:43 -08:00

test_device_speed.py

compiler support (#3260)

2024-01-26 23:36:40 -08:00

test_dtype_alu.py

Simple RDNA3 emulator (#2974)

2024-01-30 10:39:28 -08:00

test_dtype.py

tests for Tensor init data dtype and resulting dtype (#3247)

2024-01-27 00:13:42 -08:00

test_fusion_op.py

Christopherm99 ptx (#3139)

2024-01-15 16:44:20 -08:00

test_gc.py

fix up eye and fix gc test

2023-02-27 06:53:18 -08:00

test_image_dtype.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_jit.py

const cleanup with dtype.Scalar (#3257)

2024-01-26 21:16:22 -05:00

test_kernel_cache.py

move the compiler cache to be global (#2957)

2024-01-01 10:59:56 -08:00

test_lazybuffer.py

fix pad 0 size (#3277)

2024-01-30 08:58:10 -08:00

test_lazyop.py

move fromcpu out of lazy.py (#3122)

2024-01-14 18:21:08 -08:00

test_linearizer_failures.py

fix padto when with late reduce (#3180)

2024-01-19 14:01:44 -05:00

test_linearizer.py

wmma: fix the upcasts after WMMA to be hcopt ordering invariant (#3250)

2024-01-29 11:51:57 -08:00

test_masked_st.py

multitensor start (#2676)

2023-12-07 17:07:05 -08:00

test_method_cache.py

add test that the compiler isn't used (#3025)

2024-01-05 17:24:01 -08:00

test_multitensor.py

shrink MLB on sharded axis (#3255)

2024-01-31 21:48:25 -05:00

test_net_speed.py

Remove pytest markers (#2831)

2023-12-18 18:53:28 -05:00

test_nn.py

make WINO a context var, and LATEWINO in hlb_cifar (#3161)

2024-01-17 20:21:26 -05:00

test_ops.py

minor cleanups to test_ops (#3290)

2024-01-31 19:01:25 -05:00

test_optim.py

remove realize from optimizer (#2880)

2023-12-20 16:42:41 -08:00

test_randomness.py

fix some long lines in tests (#3006)

2024-01-03 23:53:33 -05:00

test_sample.py

enable test_sample for all backend (#2593)

2023-12-03 17:20:27 -05:00

test_schedule.py

early gate the graph (#3070)

2024-01-09 20:17:13 -08:00

test_search.py

St real size (#3046)

2024-01-08 14:44:53 -08:00

test_specific_conv.py

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

test_speed_v_torch.py

move globalcounters to ops (#2960)

2024-01-01 14:21:02 -08:00

test_symbolic_jit.py

new lazy, benchmark (#2878)

2023-12-20 14:33:21 -08:00

test_symbolic_ops.py

fix gpt2 with empty prompt take 2 (#3102)

2024-01-12 14:46:36 -05:00

test_symbolic_shapetracker.py

unbind view or shapetracker also returns var_val (#3067)

2024-01-09 21:45:05 -05:00

test_tensor_data.py

dtype fmt (#3132)

2024-01-15 11:31:54 -08:00

test_tensor.py

shard and to should preserve requires_grad (#3224)

2024-01-24 00:15:10 -05:00

test_to_numpy.py

Apply ruff linting rules to tests (#2473)

2023-11-27 21:24:06 -08:00

test_uops.py

compiler support (#3260)

2024-01-26 23:36:40 -08:00

test_winograd.py

reintroduce merge views in update benchmark (#3279)

2024-01-30 09:47:20 -08:00

test_zero_copy.py

remove numpy from device (#3123)

2024-01-14 19:36:05 -08:00