3 people 45e2f916a3 add quantize fp8 in llama3 (#12893) ...

* add quantize fp8 in llama3

* don't truncate fp8 alu result

* cast to float32 before matmul

* --model weights/LLaMA-3/8B-SF-DPO/

---------

Co-authored-by: chenyu <[email protected]>

2025-10-27 10:22:57 -04:00

..

actions

NIR: Check for brew packages tinymesa and tinymesa_cpu (#12739)

2025-10-21 09:38:43 +08:00

workflows

add quantize fp8 in llama3 (#12893)

2025-10-27 10:22:57 -04:00