new versions of llms not supported with the onde ampere computing llama.cpp, can you guys update or give the source so we can do it?
Activity
indiealexh commentedon Oct 6, 2026
Agreed, I get 10 t/s on self compiled LLAMA.cpp but if there is more to gain from the Ampere specific one I would like it.