George HotzandGitHub a33ac869aa llm server: temperature + test client (#15444) ...

* improvements to the llm server

* eval script

* eval llm

* better eval gets 58.71

* cleanups

* add temperature, but multinomial is absurdly slow

* claude is so smart

* lint

* remove slop

* no more stop

2026-03-24 21:07:15 +08:00

..

__init__.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_attention.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_autogen.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_compile_failures.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_const_folding.py

fixes and test relaxations from prealloc_bufs (#14875)

2026-02-19 11:37:25 +08:00

test_device.py

fix compilers autoselect (#15346)

2026-03-18 18:19:53 +08:00

test_disk_cache.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_dtype_spec.py

remove staticmethod dtypes.max/min (#15227)

2026-03-11 23:11:24 -04:00

test_dtype.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_elf.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_gc.py

move more to null/unit tests (#14658)

2026-02-10 13:35:17 +08:00

test_gpudims.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_gradient.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_graph_rewrite.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_hcq_iface.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_helpers.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_indexing.py

clean up test/null/test_indexing.py (#14720)

2026-02-12 22:36:53 -05:00

test_linearizer_failures.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_linearizer_rewrite.py

KernelInfo is required on get_program (#14571)

2026-02-06 10:49:27 +08:00

test_llm_server.py

llm server: temperature + test client (#15444)

2026-03-24 21:07:15 +08:00

test_llm_tokenizer.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_memory_planner.py

memplan on linears (#15422)

2026-03-23 19:50:16 +08:00

test_method_cache.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_microbenchmarks.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_mnist_dataset.py

buffer view is like buffer (#15082)

2026-03-03 09:52:33 +08:00

test_multitensor.py

memplanner opt copy bufs (#15110)

2026-03-08 22:28:01 +03:00

test_null.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_pattern_matcher.py

dtype mixin (#14763)

2026-02-15 16:03:48 +08:00

test_process_replay.py

fix opt in process replay [pr] (#14599)

2026-02-06 16:49:56 -05:00

test_real_world.py

memplan on linears (#15422)

2026-03-23 19:50:16 +08:00

test_rearrange_einops.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_resnet.py

everything has dtype.long now (#14661)

2026-02-10 15:08:50 +08:00

test_rewrite_bottom_up_gate.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_schedule_cache.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_schedule.py

llama compute gradients explicitly + 243 GB of RAM on MP=8 (#15343)

2026-03-18 19:54:40 +08:00

test_simplify_valid_idx.py

remove IMAGE=2 (#15312)

2026-03-20 06:26:52 -04:00

test_symbolic_failures.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_symbolic_tensor.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_tensor_io.py

move more tests to test/null, split some existing ones (#14512)

2026-02-03 20:20:20 +08:00

test_tensor_metadata.py

jit: captures linears, not execitems (#15399)

2026-03-21 16:32:12 +08:00

test_tensor_uop_representation.py

more test relaxations from prealloc_bufs (#14880)

2026-02-19 14:23:28 +08:00

test_tensor.py

canonicalize device from tuple (#15348)

2026-03-18 20:35:52 +08:00

test_tinyfs.py

revert some late_buffer_view change (#14578)

2026-02-05 22:51:40 -05:00

test_tqdm.py

relax test_tqdm_perf (#15134)

2026-03-04 12:58:47 -05:00

test_transcendental_helpers.py

rename all DEFINE_GLOBAL to PARAM (#14511)

2026-02-03 15:09:38 +08:00

test_uop_graph.py

amd flash attention cleanups + emulator fixes (#15431)

2026-03-24 10:10:46 +08:00

test_uop_repr.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_uop_resolve.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_uop_symbolic.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_uop_vmin_vmax.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_uops_stats.py

more test relaxations from prealloc_bufs (#14880)

2026-02-19 14:23:28 +08:00

test_uops.py

fixes and test relaxations from prealloc_bufs (#14875)

2026-02-19 11:37:25 +08:00

test_upat_compile.py

move files that pass with NULL=1 to test/null (#14508)

2026-02-03 13:52:36 +08:00

test_validate_oob.py

dtypes.index -> dtypes.weakint (#15377)

2026-03-20 01:08:46 -04:00

test_viz.py

viz: all tests can run on the NULL device (#15328)

2026-03-18 04:14:20 +09:00

test_winograd.py

preallocate all realized buffers (#14823)

2026-02-20 20:05:54 +08:00