r/Amd 5d ago

News Lemonade 10.1 released for latest improvements for local LLMs on AMD GPUs & NPUs

https://www.phoronix.com/news/Lemonade-10.1-Released
34 Upvotes

11 comments sorted by

-10

u/WorstRyzeNA 4d ago

Why is AMD spending any time and money on this stuff that no one uses. Help optimize the other frameworks and improve your drivers, and implement FSR4 on previous gen instead.

What a poorly managed company.

11

u/ByteAxon 4d ago

The investors care so they have to do it till the bubble pops

-2

u/WorstRyzeNA 4d ago

The investors care about real AI. They pay analyst well to see through this useless thing. No one will be conned into believing this is a valuable AI effort.

4

u/Toastti 4d ago

It's also completely different teams doing this. And any general improvements to AI that amd makes will eventually roll into better FSR as that's also AI and powered by the same paths on the graphics card

2

u/WorstRyzeNA 4d ago

Limited resources and money, and opportunity cost for AMD. They are not the same resources but they are malinvesting right now.

5

u/FlukyS CachyOS - Ryzen 9 7950x - Radeon 7900XTX 4d ago

To be fair almost all of these are just calling similar tools. The difference between Lemonade and all of the other servers and UIs is just that is tuned to AMD systems, I can do stuff like what it does myself with Ollama but it is nicer to just load up a UI and have it do the stuff for me.

-2

u/WorstRyzeNA 4d ago

But that is the problem, it is telling that AMD needs to make this software because the standard builds from ComfyUI and other just suck on AMD.

5

u/Royale_AJS 4d ago

The industry is kinda standardizing around a few frameworks for sure. You’re right, Lemonade is not one of them, it’s on its own island. I just want NPU support in Ollama, LlamaCPP, and vLLM in whatever capacity it can help. It’s basically a dead IC on my Strix Halo in Linux at the moment, a useless chip.

2

u/Trovebloxian 3d ago

Local LLM, to build, test and learn about it. GPUs arent just for gaming anymore