chenyu and GitHub
ac3f56a1a2
more shift tests ( #17083 )
2026-07-19 16:05:13 -04:00
chenyu and GitHub
89117d8b9e
use real shift in l2i decomp [pr] ( #17080 )
...
works for variable shift distace too, also fixed signed arithmetic fill
2026-07-19 13:15:06 -04:00
chenyu and GitHub
9970a0aad0
fix Tensor << Tensor for x86 ( #17082 )
...
* fix Tensor << Tensor for x86
* torch
2026-07-19 12:31:05 -04:00
chenyu and GitHub
0146a30125
improve cast to unsign min_max [pr] ( #17078 )
2026-07-18 21:58:41 -04:00
George Hotz and GitHub
b53cd35cff
llm: make tokenizer fast (kimi) ( #17077 )
...
* llm: make tokenizer fast
* simpler
* re.escape + qcom mypy fix
2026-07-18 17:31:59 -07:00
Rick Wierenga and GitHub
82debb4557
only allow x86_64 target arch on X86Renderer ( #17076 )
2026-07-18 19:51:01 -04:00
wozeparrot and GitHub
ee290b3e39
optim: mxfp8 zero 1 allgathers in fp8 ( #17073 )
2026-07-18 07:44:50 -07:00
nimlgen and GitHub
232529ce88
hcq2: simpler sync ( #17069 )
...
* x
* y
* n
2026-07-18 16:27:44 +03:00
qazal and GitHub
24d8681be7
viz: better sidebar collapse ux ( #17072 )
2026-07-18 18:07:58 +09:00
chenyu and GitHub
47629f4bcf
more weak dtype materialization raise ( #17071 )
2026-07-17 23:15:14 -04:00
chenyu and GitHub
f315df29a0
no weak Tensor from and to real buffer ( #17067 )
...
* no weak Tensor from and to real buffer
creation, assign, safe_save
* is_numpy_ndarray to tensor
* one more
2026-07-17 16:09:10 -04:00
George Hotz and GitHub
86a6ad8ed2
llm: split cli.py into serve.py with the HTTP server ( #17065 )
...
* llm: split cli.py into serve.py with the HTTP server
* min edit
2026-07-17 10:45:37 -07:00
George Hotz and GitHub
3ee2baf71d
llm: add tool calling support (kimi) ( #17061 )
...
* llm: add tool calling support
* simpler
* cls
* gpt cleanup
* more gpt cleanups
* tests for tools calling
2026-07-17 10:20:01 -07:00
qazal and GitHub
7dd3422c63
llama: replace two stage amax with atomics ( #17063 )
...
* atomic amax in c kernels
* quantize fp8 UOp kernel
* diff
2026-07-17 19:27:10 +09:00
wozeparrot and GitHub
a836c3822a
gptoss: 3d mx block scale ( #17062 )
2026-07-16 23:30:24 -07:00
sirhcm and GitHub
6f1176ea90
benchmarks: test usbgpu copy speeds on comma ( #17060 )
2026-07-17 02:02:21 -04:00
George Hotz and GitHub
46172bb7c7
llm: add optional jinja template support (kimi) ( #17058 )
...
* add jinja template support (kimi)
* fix tests
* lil
* more crap to fallback
2026-07-16 19:02:58 -07:00
chenyu and GitHub
88826a6f35
no weak dtype for randn_like either ( #17055 )
2026-07-16 18:29:12 -04:00
chenyu and GitHub
3bfd62e915
fix 0 size tolist to match numpy ( #17054 )
2026-07-16 17:42:52 -04:00
nimlgen and GitHub
709babb97c
system: remove sibling functions of PCIDevice ( #17052 )
2026-07-17 00:15:32 +03:00
George Hotz and GitHub
d8b83daac6
set tc_upcast_axes to None when done with it ( #17053 )
...
* set tc_upcast_axes to None when done with it
* no tag needed
2026-07-16 14:15:21 -07:00
stylishvoid and GitHub
c74149c973
avoid repeated parsing and toposort in _valid_priority [PR] ( #17049 )
...
* avoid repeated parsing and toposort in _valid_priority
* use backward_slice_with_self instead
2026-07-16 16:24:08 -04:00
chenyu and GitHub
6fa0b2b19e
materialize weak dtype casts to default ( #17051 )
...
in clone and _buffer
2026-07-16 16:12:33 -04:00
George Hotz and GitHub
4d8c3d3fc9
add test_hgemm to test_tiny ( #17050 )
...
* add test_hgemm to test_tiny
* dsp skip
2026-07-16 13:12:10 -07:00
George Hotz and GitHub
2b1146b3f4
further clean up wmma ( #17048 )
...
* further clean up wmma
* comment
2026-07-16 11:43:23 -07:00
chenyu and GitHub
f6a92d0a16
sum_acc_dtype(weak) is weak ( #17047 )
...
also no explicit weak for rand
2026-07-16 14:32:37 -04:00
George Hotz and GitHub
61e104bdfb
use UOp.wmma everywhere ( #17045 )
...
* use UOp.wmma everywhere
* fix
2026-07-16 10:40:48 -07:00
chenyu and GitHub
5a4156c5d1
bitcast and element_size raise for weak dtypes ( #17046 )
2026-07-16 13:07:45 -04:00
nimlgen and GitHub
7eb197b1bb
nv: always wait for reset ( #17043 )
...
* nv: always wait for reset
* x
2026-07-16 16:35:12 +03:00
chenyu and GitHub
dba8b6b505
allow weak alu operands ( #17044 )
2026-07-16 09:33:20 -04:00
nimlgen and GitHub
e33e96415f
hcq2: tiny cleanupg ( #17042 )
2026-07-16 16:14:54 +03:00
810d8732f9
fix n^2 in limit_bufs by memoizing reachable loads [PR] ( #17017 )
...
* fix n^2 in limit_bufs by memoizing reachable loads [pr]
* Update test_schedule.py
---------
Co-authored-by: Jacob Kitchen <[email protected] >
2026-07-15 23:54:04 -07:00
1c74e044a4
search /usr/lib/wsl/lib first for linux ( #17027 )
...
Co-authored-by: George Hotz <[email protected] >
2026-07-15 23:28:17 -07:00
George Hotz and GitHub
8b0dd870ce
use wmma helper ( #17038 )
2026-07-15 23:25:17 -07:00
qazal and GitHub
783042d216
viz: graph stays in place when sidebars resize ( #17037 )
...
* viz: sidebars can resize independent of main graph
* both sidebars
* fix device-list
* more work
* no variables
* raw 15%
* fix custom view
* minor detail
2026-07-16 11:47:22 +09:00
chenyu and GitHub
e8d3047a50
dtype_from_uop cleanup [PR] ( #17036 )
2026-07-15 21:52:21 -04:00
chenyu and GitHub
6b7fee7d9f
minor lower_alu_dtype cleanup [PR] ( #17034 )
2026-07-15 17:42:23 -04:00
chenyu and GitHub
be075b200a
weak dtypes in dtype_from_uop [PR] ( #17032 )
...
* weak dtypes in dtype_from_uop [PR]
* no weak in spec_program
* weak const fold tests
2026-07-15 16:54:31 -04:00
chenyu and GitHub
3ffb4dc4bc
unify lower index in lower_alu_dtype [PR] ( #17033 )
...
will work for weak types too
2026-07-15 16:38:42 -04:00
nimlgen and GitHub
d6fddb066f
usb: keep only custom ( #17029 )
...
* usb: keep only custom
* mockgpu by gpt
* gpt said sorry
* revert
* reset
* fix
* flash
2026-07-15 22:40:52 +03:00
wozeparrot and GitHub
0d30f97584
mlperf: make v6.1 dir ( #17031 )
2026-07-15 10:40:55 -07:00
chenyu and GitHub
c23d8188e1
remove _ensure_float [pr] ( #17030 )
...
do this cast late. allow `SQRT(int)`
2026-07-15 11:19:20 -04:00
chenyu and GitHub
0d19970edc
least_upper_dtype in dtype_from_uop [PR] ( #17028 )
2026-07-15 09:27:53 -04:00
chenyu and GitHub
ebe26420a7
update where Invalid rules [pr] ( #17026 )
...
fixed TestInvalidTensor.test_tensor_index
2026-07-15 00:00:30 -04:00
wozeparrot and GitHub
06169f5013
gptoss: small fixes ( #17025 )
2026-07-14 20:40:23 -07:00
chenyu and GitHub
47ddf94f17
remove InvalidType lt and gt ( #17023 )
...
not really used
2026-07-14 21:59:15 -04:00
sirhcm and GitHub
c9baa2ef79
use pattern matcher in contiguous_view_offset [PR] ( #17022 )
2026-07-14 19:37:36 -04:00
nimlgen and GitHub
4257939e50
remove copyin/copyout from Buffer ( #17020 )
...
* remove copyin/copyout from Buffer
* x
* x
* x
* x
2026-07-14 19:47:22 +03:00
qazal and GitHub
939f28d571
fused qkv rope custom kernel ( #17021 )
...
* work
* fused qkv_norm
* work
* speed
* not that yet
* test cleanup
* just clone
* remove .realize()
* cleanup tests
2026-07-15 01:08:42 +09:00
chenyu and GitHub
82fbca43c5
fix Tensor(np) dtype and support fp8 safetensor ( #17019 )
2026-07-14 09:31:21 -04:00