 wozeparrotandGitHub
|
87c4ec1724
|
llama: use flat llama (#15353)
|
2026-03-19 22:12:38 -07:00 |
|
|
George HotzandGitHub
|
4091d37e8e
|
flat llama step work (#15355)
* flat llama step work
* fp8 support
* blacklisted matmul
* chestertons fence
|
2026-03-20 09:06:12 +08:00 |
|
|
George HotzandGitHub
|
5524916e39
|
llama compute gradients explicitly + 243 GB of RAM on MP=8 (#15343)
* llama compute gradients explicitly
* apply grads
* fix multi issue
* multi BUFFER_VIEW support
* simpler
* skip the flaky test
|
2026-03-18 19:54:40 +08:00 |
|
|
George HotzandGitHub
|
6e196195d8
|
add test for flat llama (#15327)
* add test for flat llama
* simpler
* back to split w1/w3
* env
* still too much ram
* invalid
|
2026-03-18 15:16:33 +08:00 |
|
|
George HotzandGitHub
|
2605840ee2
|
flat llama (#15324)
* FlatTransformer
* works
* pass in buffer views
* print stuff
* print
* bugfixes
|
2026-03-17 19:39:55 +08:00 |
|
|
wozeparrotandGitHub
|
a191ac0566
|
llama: use mlperf model (#15257)
|
2026-03-13 08:08:32 -07:00 |
|