Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Smaller models, probably.
https://tokencalculator.com/tools/llm-ram-calculator
Sure, but how many people who actually know how to install a local LLM are using it on a laptop with 8GB ram? I guess if they have an NPU it might help